00002000:00100000:1.0:1787119485.903943:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (12963840->12967935) req@ffff92a6072f8380 x1873929633204736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:521/0 lens 488/4536 e 0 to 0 dl 1787119496 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119485.903956:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8380 with x1873929633204736 ext(12963840->12967935) 00002000:00010000:1.0:1787119485.903959:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8380 00000100:00100000:1.0:1787119485.903976:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8849 00000100:00100000:1.0:1787119485.903983:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633204864:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119485.910217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119485.941590:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633205632 00000100:00100000:1.0:1787119485.941603:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633205632 00000100:00100000:1.0:1787119485.941670:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19350 00000100:00100000:1.0:1787119485.941681:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+243:32727:x1873929633205632:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119485.941736:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119485.941763:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e24fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047158e5 expref: 243 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119485.941782:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119485.941787:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119485.943009:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2525 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119485.943028:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119485.943038:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119485.943095:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976164 00000004:00010000:1.0:1787119485.943121:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002259c3d8 reply state 00000000e915007f transno 4294976165 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119485.943135:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119485.943235:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+245:32727:x1873929633205632:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1554us (3807us total) trans 4294976165 rc 0/0 00000100:00100000:1.0:1787119485.943243:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19350 00000020:00080000:1.0:1787119485.943249:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119485.946735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119485.946768:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633205760 00000100:00100000:1.0:1787119485.946774:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633205760 00002000:00100000:1.0:1787119485.946806:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (12943360->13008895) req@ffff92a6072fad80 x1873929633205760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:521/0 lens 504/0 e 0 to 0 dl 1787119496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119485.947844:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fad80 with x1873929633205760 ext(12943360->13008895) 00002000:00010000:1.0:1787119485.947851:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fad80 00000100:00100000:1.0:1787119485.947882:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8853 00000100:00100000:1.0:1787119485.947892:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633205760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119485.957829:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633205760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9918us (11077us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119485.957843:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8853 00002000:00100000:1.0:1787119485.957857:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (12943360->13008895) req@ffff92a6072fad80 x1873929633205760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:521/0 lens 504/440 e 0 to 0 dl 1787119496 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119485.957867:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fad80 with x1873929633205760 ext(12943360->13008895) 00002000:00010000:1.0:1787119485.957874:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fad80 00000100:00100000:1.0:1787119485.967566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119485.967605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119485.986804:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633204480:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 84835us (85401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119485.986830:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4941 00000001:00080000:1.0:1787119485.986869:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968783 is committed 00000100:00100000:1.0:1787119485.991177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119485.991219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119485.991244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119485.991272:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633206656 00000100:00100000:1.0:1787119485.991282:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633206656 00000100:00100000:1.0:1787119485.991342:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4943 00000100:00100000:1.0:1787119485.991353:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633206656:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119486.006740:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633206784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12398us (15509us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119486.006753:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8861 00002000:00100000:1.0:1787119486.006768:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (58757120->58822655) req@ffff92a6072f9500 x1873929633206784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:521/0 lens 504/440 e 0 to 0 dl 1787119496 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.006778:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9500 with x1873929633206784 ext(58757120->58822655) 00002000:00010000:1.0:1787119486.006784:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9500 00000001:00080000:1.0:1787119486.027291:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968994 is committed 00000100:00100000:1.0:1787119486.047765:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633208064 00000100:00100000:1.0:1787119486.047778:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633208064 00002000:00100000:1.0:1787119486.047873:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (58777600->58830341) req@ffff92a63ebd5f80 x1873929633208064/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.047935:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5f80 with x1873929633208064 ext(58777600->58830341) 00002000:00010000:1.0:1787119486.047942:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5f80 00000100:00100000:1.0:1787119486.047970:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8868 00000100:00100000:1.0:1787119486.047980:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633208064:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119486.048636:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633208192 00000100:00100000:1.0:1787119486.048644:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633208192 00002000:00100000:1.0:1787119486.048687:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (51257344->51261439) req@ffff92a63ebd6300 x1873929633208192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.048696:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6300 with x1873929633208192 ext(51257344->51261439) 00002000:00010000:1.0:1787119486.048700:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd6300 00000100:00100000:1.0:1787119486.048723:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8869 00000100:00100000:1.0:1787119486.048731:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633208192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.048939:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633208192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 207us (863us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.048946:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8869 00002000:00100000:1.0:1787119486.048953:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (51257344->51261439) req@ffff92a63ebd6300 x1873929633208192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.048962:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6300 with x1873929633208192 ext(51257344->51261439) 00002000:00010000:1.0:1787119486.048965:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd6300 00000100:00100000:1.0:1787119486.062224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.073544:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633208064:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 25559us (25865us total) trans 4294968997 rc 0/0 00000100:00100000:1.0:1787119486.073557:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8868 00002000:00100000:1.0:1787119486.073568:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (58777600->58830341) req@ffff92a63ebd5f80 x1873929633208064/t4294968997(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/448 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.073578:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5f80 with x1873929633208064 ext(58777600->58830341) 00002000:00010000:1.0:1787119486.073583:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5f80 00000100:00100000:1.0:1787119486.116092:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633209984 00000100:00100000:1.0:1787119486.116105:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633209984 00000100:00100000:1.0:1787119486.116157:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4946 00000100:00100000:1.0:1787119486.116166:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633209984:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119486.139565:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633210368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6603us (7156us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119486.139579:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8882 00002000:00100000:1.0:1787119486.139592:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (33419264->33484799) req@ffff92a63ebd6d80 x1873929633210368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.139602:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6d80 with x1873929633210368 ext(33419264->33484799) 00002000:00010000:1.0:1787119486.139608:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd6d80 00000100:00100000:1.0:1787119486.153186:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633208576:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 89307us (90972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119486.153197:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4944 00000001:00080000:1.0:1787119486.153230:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968996 is committed 00000001:00080000:1.0:1787119486.153247:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968997 is committed 00000100:00100000:1.0:1787119486.153673:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633210752 00000100:00100000:1.0:1787119486.153678:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633210752 00002000:00100000:1.0:1787119486.153707:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (33484800->33521663) req@ffff92a63ebd7480 x1873929633210752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.153718:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7480 with x1873929633210752 ext(33484800->33521663) 00002000:00010000:1.0:1787119486.153723:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd7480 00000100:00100000:1.0:1787119486.153752:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8884 00000100:00100000:1.0:1787119486.153759:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633210752:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.157870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.176025:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633210752:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22266us (22419us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119486.176035:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8884 00002000:00100000:1.0:1787119486.176045:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (33484800->33521663) req@ffff92a63ebd7480 x1873929633210752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.176054:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7480 with x1873929633210752 ext(33484800->33521663) 00002000:00010000:1.0:1787119486.176060:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd7480 00000100:00100000:1.0:1787119486.176076:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633211264 00000100:00100000:1.0:1787119486.176079:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633211264 00002000:00100000:1.0:1787119486.176098:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (12967936->12972031) req@ffff92a506008380 x1873929633211264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.176106:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008380 with x1873929633211264 ext(12967936->12972031) 00002000:00010000:1.0:1787119486.176110:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008380 00000100:00100000:1.0:1787119486.176136:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8886 00000100:00100000:1.0:1787119486.176143:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633211264:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.176312:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633211264:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 169us (401us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.176318:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8886 00002000:00100000:1.0:1787119486.176324:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (12967936->12972031) req@ffff92a506008380 x1873929633211264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.176332:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008380 with x1873929633211264 ext(12967936->12972031) 00002000:00010000:1.0:1787119486.176335:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008380 00000100:00100000:1.0:1787119486.181125:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633211520 00000100:00100000:1.0:1787119486.181135:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633211520 00002000:00100000:1.0:1787119486.181179:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (12943360->13008895) req@ffff92a509134700 x1873929633211520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.181191:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134700 with x1873929633211520 ext(12943360->13008895) 00002000:00010000:1.0:1787119486.181197:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509134700 00000100:00100000:1.0:1787119486.181226:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8887 00000100:00100000:1.0:1787119486.181234:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633211520:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.191704:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633209984:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 75537us (78297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119486.191716:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4946 00000100:00100000:1.0:1787119486.200509:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633211904 00000100:00100000:1.0:1787119486.200525:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633211904 00002000:00100000:1.0:1787119486.200580:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (33439744->33443839) req@ffff92a5098a4e00 x1873929633211904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.200591:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633211904 ext(33439744->33443839) 00002000:00010000:1.0:1787119486.200597:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:1.0:1787119486.200640:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8890 00000100:00100000:1.0:1787119486.200650:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633211904:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.200879:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633211904:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 229us (2085us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.200886:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8890 00002000:00100000:1.0:1787119486.200893:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (33439744->33443839) req@ffff92a5098a4e00 x1873929633211904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.200902:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633211904 ext(33439744->33443839) 00002000:00010000:1.0:1787119486.200906:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:1.0:1787119486.206306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.206379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.206401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.206427:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633212160 00000100:00100000:1.0:1787119486.206436:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633212160 00002000:00100000:1.0:1787119486.206511:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (61837312->61841407) req@ffff92a519d1a680 x1873929633212160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.206523:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a680 with x1873929633212160 ext(61837312->61841407) 00002000:00010000:1.0:1787119486.206530:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1a680 00000100:00100000:1.0:1787119486.206558:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633212288 00000100:00100000:1.0:1787119486.206561:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633212288 00002000:00100000:1.0:1787119486.206577:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (33443840->33447935) req@ffff92a519d1ad80 x1873929633212288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.206585:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1ad80 with x1873929633212288 ext(33443840->33447935) 00002000:00010000:1.0:1787119486.206589:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1ad80 00000100:00100000:1.0:1787119486.206608:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8891 00000100:00100000:1.0:1787119486.206629:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633212160:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.207004:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633212160:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 386us (623us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.207012:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8891 00002000:00100000:1.0:1787119486.207019:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (61837312->61841407) req@ffff92a519d1a680 x1873929633212160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.207028:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a680 with x1873929633212160 ext(61837312->61841407) 00002000:00010000:1.0:1787119486.207031:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1a680 00000100:00100000:1.0:1787119486.207051:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8892 00000100:00100000:1.0:1787119486.207058:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633212288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.207149:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633212288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 89us (745us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.207155:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8892 00002000:00100000:1.0:1787119486.207160:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (33443840->33447935) req@ffff92a519d1ad80 x1873929633212288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.207167:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1ad80 with x1873929633212288 ext(33443840->33447935) 00002000:00010000:1.0:1787119486.207171:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1ad80 00000100:00100000:1.0:1787119486.221668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.221701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.221723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.238413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.238557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.283487:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633213440 00000100:00100000:1.0:1787119486.283500:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633213440 00002000:00100000:1.0:1787119486.283552:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (15335424->15400959) req@ffff92a5098a6d80 x1873929633213440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.283563:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633213440 ext(15335424->15400959) 00002000:00010000:1.0:1787119486.283569:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a6d80 00000100:00100000:1.0:1787119486.283594:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8900 00000100:00100000:1.0:1787119486.283603:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633213440:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.292098:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633213440:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8485us (9491us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119486.301468:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8900 00002000:00100000:1.0:1787119486.301490:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (15335424->15400959) req@ffff92a5098a6d80 x1873929633213440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.301501:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633213440 ext(15335424->15400959) 00002000:00010000:1.0:1787119486.301508:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a6d80 00000100:00100000:1.0:1787119486.301538:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633213696 00000100:00100000:1.0:1787119486.301546:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633213696 00002000:00100000:1.0:1787119486.301581:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (61882368->61902847) req@ffff92a506f13480 x1873929633213696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.301588:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506f13480 with x1873929633213696 ext(61882368->61902847) 00002000:00010000:1.0:1787119486.301592:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506f13480 00000100:00100000:1.0:1787119486.304789:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633213824 00000100:00100000:1.0:1787119486.304869:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633213824 00002000:00100000:1.0:1787119486.304928:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (33439744->33488895) req@ffff92a506f11f80 x1873929633213824/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.304940:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506f11f80 with x1873929633213824 ext(33439744->33488895) 00002000:00010000:1.0:1787119486.304946:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506f11f80 00000100:00100000:1.0:1787119486.304977:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633213952 00000100:00100000:1.0:1787119486.304980:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633213952 00002000:00100000:1.0:1787119486.304994:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (29188096->29253631) req@ffff92a506f10380 x1873929633213952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.305002:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506f10380 with x1873929633213952 ext(29188096->29253631) 00002000:00010000:1.0:1787119486.305005:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506f10380 00000100:00100000:1.0:1787119486.305019:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633214080 00000100:00100000:1.0:1787119486.305021:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633214080 00002000:00100000:1.0:1787119486.305031:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (15400960->15437823) req@ffff92a506f13800 x1873929633214080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.305046:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506f13800 with x1873929633214080 ext(15400960->15437823) 00002000:00010000:1.0:1787119486.305049:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506f13800 00000100:00100000:1.0:1787119486.305062:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8902 00000100:00100000:1.0:1787119486.305070:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633213696:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.308663:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633213696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3583us (12911us total) trans 0 rc 20480/20480 00000100:00100000:1.0:1787119486.308675:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8902 00002000:00100000:1.0:1787119486.308688:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (61882368->61902847) req@ffff92a506f13480 x1873929633213696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.308699:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506f13480 with x1873929633213696 ext(61882368->61902847) 00002000:00010000:1.0:1787119486.308704:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506f13480 00000100:00100000:1.0:1787119486.316398:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506f13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633214080:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9492us (14490us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119486.316411:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8905 00002000:00100000:1.0:1787119486.316424:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (15400960->15437823) req@ffff92a506f13800 x1873929633214080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.316435:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506f13800 with x1873929633214080 ext(15400960->15437823) 00002000:00010000:1.0:1787119486.316462:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506f13800 00000100:00100000:1.0:1787119486.324747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.340327:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633214592 00000100:00100000:1.0:1787119486.340332:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633214592 00000100:00100000:1.0:1787119486.340560:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633214976 00000100:00100000:1.0:1787119486.340565:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633214976 00000100:00100000:1.0:1787119486.360470:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633215232 00000100:00100000:1.0:1787119486.360481:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633215232 00000100:00100000:1.0:1787119486.360525:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633215488 00000100:00100000:1.0:1787119486.360529:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633215488 00000100:00100000:1.0:1787119486.360551:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4951 00000100:00100000:1.0:1787119486.360559:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633215232:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119486.369663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.391667:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633215744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8543us (8713us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119486.391684:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8912 00002000:00100000:1.0:1787119486.391699:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (61816832->61882367) req@ffff92a506009180 x1873929633215744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.391710:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009180 with x1873929633215744 ext(61816832->61882367) 00002000:00010000:1.0:1787119486.391718:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506009180 00000001:00080000:1.0:1787119486.416920:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968788 is committed 00000100:00100000:1.0:1787119486.417961:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633214976:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 75387us (78207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119486.417974:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4950 00000100:00100000:1.0:1787119486.421265:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633216128 00000100:00100000:1.0:1787119486.421279:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633216128 00000100:00100000:1.0:1787119486.421346:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19357 00000100:00100000:1.0:1787119486.421356:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+250:32727:x1873929633216128:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119486.421424:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119486.421473:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e600/0xcaba3de8463e2548 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715901 expref: 250 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119486.421498:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119486.421504:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119486.421736:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e256b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119486.421750:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e256b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119486.421760:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e256b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119486.421817:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976172 00000004:00010000:1.0:1787119486.421841:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fdea781 reply state 0000000084e5ec2f transno 4294976173 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e256b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119486.421850:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119486.421949:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+252:32727:x1873929633216128:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 593us (751us total) trans 4294976173 rc 0/0 00000100:00100000:1.0:1787119486.421958:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19357 00000020:00080000:1.0:1787119486.421963:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119486.436908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.456672:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633216768 00000100:00100000:1.0:1787119486.456687:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633216768 00002000:00100000:1.0:1787119486.456756:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (51453952->51458047) req@ffff92a509640a80 x1873929633216768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.456767:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640a80 with x1873929633216768 ext(51453952->51458047) 00002000:00010000:1.0:1787119486.456774:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640a80 00000100:00100000:1.0:1787119486.456811:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8918 00000100:00100000:1.0:1787119486.456823:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633216768:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.457074:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633216768:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 252us (1679us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.457082:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8918 00002000:00100000:1.0:1787119486.457089:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (51453952->51458047) req@ffff92a509640a80 x1873929633216768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.457098:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640a80 with x1873929633216768 ext(51453952->51458047) 00002000:00010000:1.0:1787119486.457101:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640a80 00000001:00080000:1.0:1787119486.478828:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968789 is committed 00000100:00100000:1.0:1787119486.484014:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633217024:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16233us (17033us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119486.484028:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8920 00002000:00100000:1.0:1787119486.484041:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (51429376->51494911) req@ffff92a506008e00 x1873929633217024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.484052:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008e00 with x1873929633217024 ext(51429376->51494911) 00002000:00010000:1.0:1787119486.484058:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008e00 00000100:00100000:1.0:1787119486.500991:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633217536 00000100:00100000:1.0:1787119486.501001:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633217536 00002000:00100000:1.0:1787119486.501040:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (51302400->51306495) req@ffff92a63eb29c00 x1873929633217536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.501051:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29c00 with x1873929633217536 ext(51302400->51306495) 00002000:00010000:1.0:1787119486.501056:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29c00 00000100:00100000:1.0:1787119486.501081:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8923 00000100:00100000:1.0:1787119486.501089:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633217536:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.509160:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633217536:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8063us (8243us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.509173:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8923 00002000:00100000:1.0:1787119486.509184:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (51302400->51306495) req@ffff92a63eb29c00 x1873929633217536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.509195:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29c00 with x1873929633217536 ext(51302400->51306495) 00002000:00010000:1.0:1787119486.509202:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29c00 00000100:00100000:1.0:1787119486.509232:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633217664 00000100:00100000:1.0:1787119486.509239:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633217664 00002000:00100000:1.0:1787119486.509270:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (51494912->51531775) req@ffff92a63eb29500 x1873929633217664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.509278:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633217664 ext(51494912->51531775) 00002000:00010000:1.0:1787119486.509281:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29500 00000100:00100000:1.0:1787119486.509329:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8924 00000100:00100000:1.0:1787119486.509338:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633217664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.534090:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633217664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 24744us (26112us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119486.534104:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8924 00002000:00100000:1.0:1787119486.534118:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (51494912->51531775) req@ffff92a63eb29500 x1873929633217664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.534129:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633217664 ext(51494912->51531775) 00002000:00010000:1.0:1787119486.534135:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29500 00000100:00100000:1.0:1787119486.551225:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633218304 00000100:00100000:1.0:1787119486.551236:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633218304 00002000:00100000:1.0:1787119486.551286:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (5566464->5636095) req@ffff92a509641180 x1873929633218304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.551308:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641180 with x1873929633218304 ext(5566464->5636095) 00002000:00010000:1.0:1787119486.551314:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641180 00000100:00100000:1.0:1787119486.551341:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633218432 00000100:00100000:1.0:1787119486.551345:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633218432 00002000:00100000:1.0:1787119486.551364:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (15355904->15359999) req@ffff92a509642300 x1873929633218432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.551372:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642300 with x1873929633218432 ext(15355904->15359999) 00002000:00010000:1.0:1787119486.551375:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509642300 00000100:00100000:1.0:1787119486.551400:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8928 00000100:00100000:1.0:1787119486.551410:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633218304:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.551717:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8929 00000100:00100000:1.0:1787119486.551726:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633218432:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.552099:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633218432:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 373us (960us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.552108:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8929 00002000:00100000:1.0:1787119486.552116:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (15355904->15359999) req@ffff92a509642300 x1873929633218432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.552125:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642300 with x1873929633218432 ext(15355904->15359999) 00002000:00010000:1.0:1787119486.552130:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509642300 00000100:00100000:1.0:1787119486.560426:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633218304:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9016us (9345us total) trans 0 rc 61440/61440 00000100:00100000:1.0:1787119486.560466:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8928 00002000:00100000:1.0:1787119486.560478:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (5566464->5636095) req@ffff92a509641180 x1873929633218304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.560489:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641180 with x1873929633218304 ext(5566464->5636095) 00002000:00010000:1.0:1787119486.560495:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641180 00000100:00100000:1.0:1787119486.560519:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633218688 00000100:00100000:1.0:1787119486.560526:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633218688 00002000:00100000:1.0:1787119486.560558:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (61837312->61901890) req@ffff92a509643800 x1873929633218688/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.560567:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643800 with x1873929633218688 ext(61837312->61901890) 00002000:00010000:1.0:1787119486.560570:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643800 00000100:00100000:1.0:1787119486.560593:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8931 00000100:00100000:1.0:1787119486.560601:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633218688:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119486.585682:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633218944 00000100:00100000:1.0:1787119486.585697:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633218944 00002000:00100000:1.0:1787119486.585758:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (5586944->51306495) req@ffff92a506155500 x1873929633218944/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.585770:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155500 with x1873929633218944 ext(5586944->51306495) 00002000:00010000:1.0:1787119486.585776:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155500 00000100:00100000:1.0:1787119486.585828:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8933 00000100:00100000:1.0:1787119486.585838:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633218944:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119486.591173:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633218688:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 30570us (30994us total) trans 4294969005 rc 0/0 00000100:00100000:1.0:1787119486.591186:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8931 00002000:00100000:1.0:1787119486.591195:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (61837312->61901890) req@ffff92a509643800 x1873929633218688/t4294969005(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/448 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.591205:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643800 with x1873929633218688 ext(61837312->61901890) 00002000:00010000:1.0:1787119486.591211:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643800 00000100:00100000:1.0:1787119486.591606:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633218944:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 5768us (8472us total) trans 4294968791 rc 0/0 00000100:00100000:1.0:1787119486.591629:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8933 00002000:00100000:1.0:1787119486.591636:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (5586944->51306495) req@ffff92a506155500 x1873929633218944/t4294968791(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/448 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.591643:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155500 with x1873929633218944 ext(5586944->51306495) 00002000:00010000:1.0:1787119486.591647:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155500 00000100:00100000:1.0:1787119486.598424:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633219456 00000100:00100000:1.0:1787119486.598464:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633219456 00000100:00100000:1.0:1787119486.598531:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4955 00000100:00100000:1.0:1787119486.598541:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633219456:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119486.610144:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633219712 00000100:00100000:1.0:1787119486.610155:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633219712 00002000:00100000:1.0:1787119486.610202:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (15355904->15359999) req@ffff92a506154e00 x1873929633219712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.610214:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154e00 with x1873929633219712 ext(15355904->15359999) 00002000:00010000:1.0:1787119486.610220:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154e00 00000100:00100000:1.0:1787119486.610248:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633219840 00000100:00100000:1.0:1787119486.610251:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633219840 00002000:00100000:1.0:1787119486.610266:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (15400960->15437823) req@ffff92a506156a00 x1873929633219840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.610274:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156a00 with x1873929633219840 ext(15400960->15437823) 00002000:00010000:1.0:1787119486.610278:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156a00 00000100:00100000:1.0:1787119486.610297:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8935 00000100:00100000:1.0:1787119486.610306:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633219712:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.610552:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633219712:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 246us (810us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.610561:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8935 00002000:00100000:1.0:1787119486.610568:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (15355904->15359999) req@ffff92a506154e00 x1873929633219712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.610576:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154e00 with x1873929633219712 ext(15355904->15359999) 00002000:00010000:1.0:1787119486.610579:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154e00 00000100:00100000:1.0:1787119486.610598:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8936 00000100:00100000:1.0:1787119486.610605:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633219840:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.616544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.640868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.663268:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633220224:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 23543us (27419us total) trans 4294969006 rc 0/0 00000100:00100000:1.0:1787119486.663283:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8939 00002000:00100000:1.0:1787119486.663296:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (15355904->15425535) req@ffff92a506155180 x1873929633220224/t4294969006(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/448 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.663312:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155180 with x1873929633220224 ext(15355904->15425535) 00002000:00010000:1.0:1787119486.663318:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155180 00000100:00100000:1.0:1787119486.731929:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633219328:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 142009us (143846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119486.731940:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4954 00000100:00100000:1.0:1787119486.765523:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633221248:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20324us (21006us total) trans 0 rc 53248/53248 00000100:00100000:1.0:1787119486.765532:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8944 00002000:00100000:1.0:1787119486.765544:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (19562496->19615743) req@ffff92a63eb2a300 x1873929633221248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.765554:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a300 with x1873929633221248 ext(19562496->19615743) 00002000:00010000:1.0:1787119486.765560:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2a300 00000100:00100000:1.0:1787119486.765577:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633221376 00000100:00100000:1.0:1787119486.765584:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633221376 00002000:00100000:1.0:1787119486.765627:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (15360000->15364095) req@ffff92a60615b100 x1873929633221376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.765636:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b100 with x1873929633221376 ext(15360000->15364095) 00002000:00010000:1.0:1787119486.765640:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b100 00000100:00100000:1.0:1787119486.765656:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633221504 00000100:00100000:1.0:1787119486.765658:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633221504 00002000:00100000:1.0:1787119486.765674:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (29212672->29216767) req@ffff92a606158000 x1873929633221504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.765682:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158000 with x1873929633221504 ext(29212672->29216767) 00002000:00010000:1.0:1787119486.765685:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158000 00000100:00100000:1.0:1787119486.765704:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8945 00000100:00100000:1.0:1787119486.765713:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633221376:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.765914:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633221376:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 201us (597us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.765921:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8945 00002000:00100000:1.0:1787119486.765927:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (15360000->15364095) req@ffff92a60615b100 x1873929633221376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.765935:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b100 with x1873929633221376 ext(15360000->15364095) 00002000:00010000:1.0:1787119486.765938:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b100 00000100:00100000:1.0:1787119486.765953:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8946 00000100:00100000:1.0:1787119486.765960:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633221504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.769218:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633221504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3245us (3862us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.769244:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8946 00002000:00100000:1.0:1787119486.769255:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (29212672->29216767) req@ffff92a606158000 x1873929633221504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.769266:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158000 with x1873929633221504 ext(29212672->29216767) 00002000:00010000:1.0:1787119486.769273:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158000 00000100:00100000:1.0:1787119486.790814:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633221760 00000100:00100000:1.0:1787119486.790824:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633221760 00002000:00100000:1.0:1787119486.790872:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (41054208->41058303) req@ffff92a606158700 x1873929633221760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.790884:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158700 with x1873929633221760 ext(41054208->41058303) 00002000:00010000:1.0:1787119486.790890:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158700 00000100:00100000:1.0:1787119486.790921:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8948 00000100:00100000:1.0:1787119486.790930:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633221760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.791193:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633221760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 263us (878us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.791202:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8948 00002000:00100000:1.0:1787119486.791209:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (41054208->41058303) req@ffff92a606158700 x1873929633221760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.791216:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158700 with x1873929633221760 ext(41054208->41058303) 00002000:00010000:1.0:1787119486.791220:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158700 00000100:00100000:1.0:1787119486.812117:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633222400 00000100:00100000:1.0:1787119486.812126:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633222400 00002000:00100000:1.0:1787119486.812177:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (61005824->61009919) req@ffff92a509637b80 x1873929633222400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.812187:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509637b80 with x1873929633222400 ext(61005824->61009919) 00002000:00010000:1.0:1787119486.812193:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509637b80 00000100:00100000:1.0:1787119486.812222:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633222144 00000100:00100000:1.0:1787119486.812225:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633222144 00002000:00100000:1.0:1787119486.812241:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (15335424->15400959) req@ffff92a509637480 x1873929633222144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.812248:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509637480 with x1873929633222144 ext(15335424->15400959) 00002000:00010000:1.0:1787119486.812251:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509637480 00000100:00100000:1.0:1787119486.812268:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8952 00000100:00100000:1.0:1787119486.812278:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633222400:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.812631:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633222400:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 352us (705us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.812639:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8952 00002000:00100000:1.0:1787119486.812646:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (61005824->61009919) req@ffff92a509637b80 x1873929633222400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.812654:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509637b80 with x1873929633222400 ext(61005824->61009919) 00002000:00010000:1.0:1787119486.812658:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509637b80 00000100:00100000:1.0:1787119486.812674:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633222528 00000100:00100000:1.0:1787119486.812677:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633222528 00002000:00100000:1.0:1787119486.812692:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (51302400->51306495) req@ffff92a509634a80 x1873929633222528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.812700:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509634a80 with x1873929633222528 ext(51302400->51306495) 00002000:00010000:1.0:1787119486.812703:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509634a80 00000100:00100000:1.0:1787119486.812719:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8953 00000100:00100000:1.0:1787119486.812726:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633222144:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.812852:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8954 00000100:00100000:1.0:1787119486.812860:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633222528:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.812961:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633222528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 101us (946us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.812966:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8954 00002000:00100000:1.0:1787119486.812972:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (51302400->51306495) req@ffff92a509634a80 x1873929633222528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.812979:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509634a80 with x1873929633222528 ext(51302400->51306495) 00002000:00010000:1.0:1787119486.812983:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509634a80 00000100:00100000:1.0:1787119486.821080:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633222144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8352us (9086us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119486.821088:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8953 00002000:00100000:1.0:1787119486.821099:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (15335424->15400959) req@ffff92a509637480 x1873929633222144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.821107:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509637480 with x1873929633222144 ext(15335424->15400959) 00002000:00010000:1.0:1787119486.821111:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509637480 00000100:00100000:1.0:1787119486.821130:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633222784 00000100:00100000:1.0:1787119486.821136:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633222784 00002000:00100000:1.0:1787119486.821162:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (61009920->61014015) req@ffff92a509634000 x1873929633222784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.821168:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509634000 with x1873929633222784 ext(61009920->61014015) 00002000:00010000:1.0:1787119486.821170:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509634000 00000100:00100000:1.0:1787119486.821186:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8956 00000100:00100000:1.0:1787119486.821192:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633222784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.821370:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633222784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 177us (474us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.821375:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8956 00002000:00100000:1.0:1787119486.821379:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (61009920->61014015) req@ffff92a509634000 x1873929633222784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.821384:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509634000 with x1873929633222784 ext(61009920->61014015) 00002000:00010000:1.0:1787119486.821386:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509634000 00000100:00100000:1.0:1787119486.824340:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633222912 00000100:00100000:1.0:1787119486.824350:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633222912 00002000:00100000:1.0:1787119486.824397:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (29208576->29220863) req@ffff92a509634e00 x1873929633222912/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 12776/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.824408:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509634e00 with x1873929633222912 ext(29208576->29220863) 00002000:00010000:1.0:1787119486.824414:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509634e00 00000100:00100000:1.0:1787119486.824528:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8957 00000100:00100000:1.0:1787119486.824538:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633222912:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119486.825050:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633222912:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 511us (857us total) trans 4294968792 rc 0/0 00000100:00100000:1.0:1787119486.825059:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8957 00002000:00100000:1.0:1787119486.825067:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (29208576->29220863) req@ffff92a509634e00 x1873929633222912/t4294968792(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 12776/448 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.825075:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509634e00 with x1873929633222912 ext(29208576->29220863) 00002000:00010000:1.0:1787119486.825079:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509634e00 00000100:00100000:1.0:1787119486.841089:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633223296 00000100:00100000:1.0:1787119486.841103:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633223296 00002000:00100000:1.0:1787119486.841160:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (60985344->61050879) req@ffff92a506156680 x1873929633223296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.841172:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156680 with x1873929633223296 ext(60985344->61050879) 00002000:00010000:1.0:1787119486.841177:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506156680 00000100:00100000:1.0:1787119486.841209:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633223424 00000100:00100000:1.0:1787119486.841213:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633223424 00002000:00100000:1.0:1787119486.841231:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (5586944->5591039) req@ffff92a506154000 x1873929633223424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.841240:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154000 with x1873929633223424 ext(5586944->5591039) 00002000:00010000:1.0:1787119486.841244:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154000 00000100:00100000:1.0:1787119486.841259:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633223552 00000100:00100000:1.0:1787119486.841262:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633223552 00002000:00100000:1.0:1787119486.841277:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (15400960->15437823) req@ffff92a506156300 x1873929633223552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.841285:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156300 with x1873929633223552 ext(15400960->15437823) 00002000:00010000:1.0:1787119486.841289:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156300 00000100:00100000:1.0:1787119486.841307:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8959 00000100:00100000:1.0:1787119486.841316:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633223296:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.841622:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8960 00000100:00100000:1.0:1787119486.841631:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633223424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.841774:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633223424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 143us (2859us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.841782:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8960 00002000:00100000:1.0:1787119486.841788:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (5586944->5591039) req@ffff92a506154000 x1873929633223424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.841808:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154000 with x1873929633223424 ext(5586944->5591039) 00002000:00010000:1.0:1787119486.841813:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154000 00000100:00100000:1.0:1787119486.841832:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8961 00000100:00100000:1.0:1787119486.841839:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633223552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.843182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.849707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.850061:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633223552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8219us (11076us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119486.850073:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8961 00002000:00100000:1.0:1787119486.850086:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (15400960->15437823) req@ffff92a506156300 x1873929633223552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.850097:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156300 with x1873929633223552 ext(15400960->15437823) 00002000:00010000:1.0:1787119486.850103:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156300 00000100:00100000:1.0:1787119486.850128:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633223808 00000100:00100000:1.0:1787119486.850136:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633223808 00002000:00100000:1.0:1787119486.850168:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (5591040->5595135) req@ffff92a519d18380 x1873929633223808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.850176:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633223808 ext(5591040->5595135) 00002000:00010000:1.0:1787119486.850180:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18380 00000100:00100000:1.0:1787119486.850202:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8963 00000100:00100000:1.0:1787119486.850210:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633223808:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.850383:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633223808:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 172us (686us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119486.850390:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8963 00002000:00100000:1.0:1787119486.850396:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (5591040->5595135) req@ffff92a519d18380 x1873929633223808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/4536 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.850405:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633223808 ext(5591040->5595135) 00002000:00010000:1.0:1787119486.850408:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18380 00000100:00100000:1.0:1787119486.850684:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633223680:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5041us (7508us total) trans 0 rc 61440/61440 00000100:00100000:1.0:1787119486.850691:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8962 00002000:00100000:1.0:1787119486.850698:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (5566464->5636095) req@ffff92a519d1b100 x1873929633223680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.850707:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b100 with x1873929633223680 ext(5566464->5636095) 00002000:00010000:1.0:1787119486.850711:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b100 00000100:00100000:1.0:1787119486.862060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.864823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.864916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.864936:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633224192 00000100:00100000:1.0:1787119486.864942:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633224192 00002000:00100000:1.0:1787119486.864972:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (5586944->51306495) req@ffff92a519d1a300 x1873929633224192/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.864982:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a300 with x1873929633224192 ext(5586944->51306495) 00002000:00010000:1.0:1787119486.864987:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1a300 00000100:00100000:1.0:1787119486.865004:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633224320 00000100:00100000:1.0:1787119486.865007:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633224320 00002000:00100000:1.0:1787119486.865022:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (5566464->5636095) req@ffff92a508cfed80 x1873929633224320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.865030:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633224320 ext(5566464->5636095) 00002000:00010000:1.0:1787119486.865034:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfed80 00000100:00100000:1.0:1787119486.865050:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8965 00000100:00100000:1.0:1787119486.865058:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633224192:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119486.865196:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8966 00000100:00100000:1.0:1787119486.865203:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633224320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119486.876050:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633224320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10833us (11119us total) trans 0 rc 61440/61440 00000100:00100000:1.0:1787119486.876066:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8966 00002000:00100000:1.0:1787119486.876081:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (5566464->5636095) req@ffff92a508cfed80 x1873929633224320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/440 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.876092:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633224320 ext(5566464->5636095) 00002000:00010000:1.0:1787119486.876098:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfed80 00000100:00100000:1.0:1787119486.880240:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633224064:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 12625us (12874us total) trans 4294969009 rc 0/0 00000100:00100000:1.0:1787119486.880254:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8967 00002000:00100000:1.0:1787119486.880264:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (15355904->15425535) req@ffff92a60615ad80 x1873929633224064/t4294969009(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/448 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.880275:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615ad80 with x1873929633224064 ext(15355904->15425535) 00002000:00010000:1.0:1787119486.880281:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615ad80 00000100:00100000:1.0:1787119486.894253:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633224448 00000100:00100000:1.0:1787119486.894257:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633224448 00002000:00100000:1.0:1787119486.894285:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (5586944->51306495) req@ffff92a506155c00 x1873929633224448/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.894296:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155c00 with x1873929633224448 ext(5586944->51306495) 00002000:00010000:1.0:1787119486.894302:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155c00 00000100:00100000:1.0:1787119486.894329:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8968 00000100:00100000:1.0:1787119486.894337:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633224448:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119486.910578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.910678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119486.910715:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633225088 00000100:00100000:1.0:1787119486.910727:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633225088 00000100:00100000:1.0:1787119486.910788:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19361 00000100:00100000:1.0:1787119486.910799:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+254:32724:x1873929633225088:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119486.910864:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119486.910894:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d7ec00/0xcaba3de8463e2510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047158ec expref: 254 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119486.910918:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119486.910924:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119486.911131:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e259c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119486.911146:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e259c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119486.911156:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e259c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119486.911206:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976174 00000004:00010000:1.0:1787119486.911229:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000600db7af reply state 0000000032b4dffb transno 4294976175 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e259c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119486.911238:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119486.911529:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+256:32724:x1873929633225088:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 730us (849us total) trans 4294976175 rc 0/0 00000100:00100000:1.0:1787119486.911537:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19361 00000020:00080000:1.0:1787119486.911542:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119486.926292:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633224448:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 31948us (32514us total) trans 4294969010 rc 0/0 00000100:00100000:1.0:1787119486.926305:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8968 00002000:00100000:1.0:1787119486.926316:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (5586944->51306495) req@ffff92a506155c00 x1873929633224448/t4294969010(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 504/448 e 0 to 0 dl 1787119497 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.926326:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155c00 with x1873929633224448 ext(5586944->51306495) 00002000:00010000:1.0:1787119486.926332:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155c00 00000100:00100000:1.0:1787119486.987466:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633226496 00000100:00100000:1.0:1787119486.987488:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633226496 00002000:00100000:1.0:1787119486.987544:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (51449856->51515391) req@ffff92a63dfba300 x1873929633226496/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:522/0 lens 488/0 e 0 to 0 dl 1787119497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119486.987555:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfba300 with x1873929633226496 ext(51449856->51515391) 00002000:00010000:1.0:1787119486.987561:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfba300 00000100:00100000:1.0:1787119486.987588:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8978 00000100:00100000:1.0:1787119486.987596:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633226496:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119487.012014:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633227008 00000100:00100000:1.0:1787119487.012030:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633227008 00000100:00100000:1.0:1787119487.012126:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4963 00000100:00100000:1.0:1787119487.012138:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633227008:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119487.035841:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633227520 00000100:00100000:1.0:1787119487.035852:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633227520 00002000:00100000:1.0:1787119487.035905:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (29208576->29212671) req@ffff92a63dfb9f80 x1873929633227520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.035918:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633227520 ext(29208576->29212671) 00002000:00010000:1.0:1787119487.035924:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000100:00100000:1.0:1787119487.035962:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8985 00000100:00100000:1.0:1787119487.035973:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633227520:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.036231:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633227520:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 259us (525us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.036238:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8985 00002000:00100000:1.0:1787119487.036245:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (29208576->29212671) req@ffff92a63dfb9f80 x1873929633227520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.036252:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633227520 ext(29208576->29212671) 00002000:00010000:1.0:1787119487.036256:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000100:00080000:1.0:1787119487.048601:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119487.058207:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633228288 00000100:00100000:1.0:1787119487.058216:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633228288 00000100:00100000:1.0:1787119487.058269:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4964 00000100:00100000:1.0:1787119487.058288:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633228288:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119487.060767:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633228416 00000100:00100000:1.0:1787119487.060779:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633228416 00002000:00010000:1.0:1787119487.060817:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (41245778->18446744073709551615) 00002000:00100000:1.0:1787119487.060822:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633228416 ext(41245778->18446744073709551615) 00002000:00010000:1.0:1787119487.060834:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb8700. 00000100:00100000:1.0:1787119487.060872:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8989 00000100:00100000:1.0:1787119487.060882:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633228416:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119487.061175:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 15923287 -> 41245778 00002000:00010000:1.0:1787119487.061179:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119485 -> 1787119485 00002000:00010000:1.0:1787119487.061182:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119483 -> 1787119483 00002000:00010000:1.0:1787119487.061184:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119485 -> 1787119485 00002000:00010000:1.0:1787119487.061186:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2189 -> 1035 00000100:00100000:1.0:1787119487.061253:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633228416:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 372us (605us total) trans 4294968795 rc 0/0 00000100:00100000:1.0:1787119487.061261:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8989 00002000:00010000:1.0:1787119487.061265:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (41245778->18446744073709551615) 00002000:00100000:1.0:1787119487.061267:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633228416 ext(41245778->18446744073709551615) 00002000:00010000:1.0:1787119487.061272:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb8700. 00000100:00100000:1.0:1787119487.122660:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633229696 00000100:00100000:1.0:1787119487.122671:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633229696 00002000:00100000:1.0:1787119487.122734:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (41185280->41245777) req@ffff92a63dc04700 x1873929633229696/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.122746:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04700 with x1873929633229696 ext(41185280->41245777) 00002000:00010000:1.0:1787119487.122752:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc04700 00000100:00100000:1.0:1787119487.122784:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8997 00000100:00100000:1.0:1787119487.122794:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633229696:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119487.131878:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633227008:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 119738us (122970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119487.131891:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4963 00000100:00100000:1.0:1787119487.139147:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633228288:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 80856us (81163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119487.139163:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4964 00000100:00100000:1.0:1787119487.153393:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633229952 00000100:00100000:1.0:1787119487.153404:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633229952 00002000:00100000:1.0:1787119487.153468:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (51449856->51453951) req@ffff92a63dc05180 x1873929633229952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.153480:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05180 with x1873929633229952 ext(51449856->51453951) 00002000:00010000:1.0:1787119487.153486:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05180 00000100:00100000:1.0:1787119487.153512:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 8998 00000100:00100000:1.0:1787119487.153522:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633229952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.153758:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633229952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 236us (559us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.153766:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 8998 00002000:00100000:1.0:1787119487.153774:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (51449856->51453951) req@ffff92a63dc05180 x1873929633229952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.153782:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05180 with x1873929633229952 ext(51449856->51453951) 00002000:00010000:1.0:1787119487.153785:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05180 00000100:00100000:1.0:1787119487.234099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.234134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.234158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.234184:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633230976 00000100:00100000:1.0:1787119487.234194:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633230976 00002000:00100000:1.0:1787119487.234242:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (61009920->61014015) req@ffff92a508cfc000 x1873929633230976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.234254:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc000 with x1873929633230976 ext(61009920->61014015) 00002000:00010000:1.0:1787119487.234260:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfc000 00000100:00100000:1.0:1787119487.234296:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633231104 00000100:00100000:1.0:1787119487.234300:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633231104 00002000:00100000:1.0:1787119487.234318:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (51453952->51458047) req@ffff92a508cfce00 x1873929633231104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.234327:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfce00 with x1873929633231104 ext(51453952->51458047) 00002000:00010000:1.0:1787119487.234331:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfce00 00000100:00100000:1.0:1787119487.234345:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633231232 00000100:00100000:1.0:1787119487.234348:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633231232 00002000:00100000:1.0:1787119487.234363:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (51494912->51531775) req@ffff92a508cfe300 x1873929633231232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.234372:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfe300 with x1873929633231232 ext(51494912->51531775) 00002000:00010000:1.0:1787119487.234375:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfe300 00000100:00100000:1.0:1787119487.234393:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9006 00000100:00100000:1.0:1787119487.234402:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633230976:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.234699:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633230976:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 297us (609us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.234708:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9006 00002000:00100000:1.0:1787119487.234714:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (61009920->61014015) req@ffff92a508cfc000 x1873929633230976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.234722:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc000 with x1873929633230976 ext(61009920->61014015) 00002000:00010000:1.0:1787119487.234726:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfc000 00000100:00100000:1.0:1787119487.234744:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9007 00000100:00100000:1.0:1787119487.234751:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633231104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.234862:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633231104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 111us (726us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.234869:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9007 00002000:00100000:1.0:1787119487.234874:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (51453952->51458047) req@ffff92a508cfce00 x1873929633231104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.234882:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfce00 with x1873929633231104 ext(51453952->51458047) 00002000:00010000:1.0:1787119487.234885:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfce00 00000100:00100000:1.0:1787119487.234897:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9008 00000100:00100000:1.0:1787119487.234904:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633231232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.268456:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9011 00000100:00100000:1.0:1787119487.268467:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633231744:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.268631:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633231744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 166us (2508us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.268643:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9011 00002000:00100000:1.0:1787119487.268658:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (29212672->29216767) req@ffff92a63dc04380 x1873929633231744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.268666:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04380 with x1873929633231744 ext(29212672->29216767) 00002000:00010000:1.0:1787119487.268670:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04380 00000100:00100000:1.0:1787119487.290553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.290589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.290629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.291671:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9014 00000100:00100000:1.0:1787119487.291681:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633232128:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.291853:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633232128:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 173us (1262us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.291861:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9014 00002000:00100000:1.0:1787119487.291868:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (3440640->3444735) req@ffff92a508cff480 x1873929633232128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.291877:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff480 with x1873929633232128 ext(3440640->3444735) 00002000:00010000:1.0:1787119487.291882:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cff480 00000100:00100000:1.0:1787119487.295048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.296170:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9016 00000100:00100000:1.0:1787119487.296242:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633232384:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.312990:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633232384:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16808us (17942us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119487.312998:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9016 00002000:00100000:1.0:1787119487.313003:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (61050880->61087743) req@ffff92a508cfd500 x1873929633232384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.313012:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd500 with x1873929633232384 ext(61050880->61087743) 00002000:00010000:1.0:1787119487.313015:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfd500 00000100:00100000:1.0:1787119487.327762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.327834:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.327869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.327913:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633232768 00000100:00100000:1.0:1787119487.327924:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633232768 00002000:00100000:1.0:1787119487.327971:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (51449856->51515391) req@ffff92a508cfd180 x1873929633232768/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.327982:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd180 with x1873929633232768 ext(51449856->51515391) 00002000:00010000:1.0:1787119487.327988:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd180 00000100:00100000:1.0:1787119487.328007:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633232896 00000100:00100000:1.0:1787119487.328010:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633232896 00002000:00100000:1.0:1787119487.328023:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (29208576->29220863) req@ffff92a508cfe680 x1873929633232896/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 12776/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.328031:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfe680 with x1873929633232896 ext(29208576->29220863) 00002000:00010000:1.0:1787119487.328036:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfe680 00000100:00100000:1.0:1787119487.328046:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633233024 00000100:00100000:1.0:1787119487.328049:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633233024 00002000:00100000:1.0:1787119487.328062:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (10244096->10289151) req@ffff92a508cff100 x1873929633233024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.328071:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633233024 ext(10244096->10289151) 00002000:00010000:1.0:1787119487.328074:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cff100 00000100:00100000:1.0:1787119487.328088:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9018 00000100:00100000:1.0:1787119487.328096:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633232768:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119487.328236:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9019 00000100:00100000:1.0:1787119487.328243:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633232896:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119487.328765:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633232896:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 520us (928us total) trans 4294969015 rc 0/0 00000100:00100000:1.0:1787119487.328774:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9019 00002000:00100000:1.0:1787119487.328781:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (29208576->29220863) req@ffff92a508cfe680 x1873929633232896/t4294969015(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 12776/448 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.328791:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfe680 with x1873929633232896 ext(29208576->29220863) 00002000:00010000:1.0:1787119487.328795:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfe680 00000100:00100000:1.0:1787119487.328814:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9020 00000100:00100000:1.0:1787119487.328821:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633233024:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.340528:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633232768:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 12426us (12772us total) trans 4294969016 rc 0/0 00000100:00100000:1.0:1787119487.340542:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9018 00002000:00100000:1.0:1787119487.340557:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (51449856->51515391) req@ffff92a508cfd180 x1873929633232768/t4294969016(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/448 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.340568:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd180 with x1873929633232768 ext(51449856->51515391) 00002000:00010000:1.0:1787119487.340575:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd180 00000100:00100000:1.0:1787119487.343296:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4970 00000100:00100000:1.0:1787119487.343308:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633233536:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119487.357902:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633233024:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 29080us (30031us total) trans 0 rc 45056/45056 00000100:00100000:1.0:1787119487.357911:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9020 00002000:00100000:1.0:1787119487.357920:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (10244096->10289151) req@ffff92a508cff100 x1873929633233024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.357929:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633233024 ext(10244096->10289151) 00002000:00010000:1.0:1787119487.357933:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cff100 00000100:00100000:1.0:1787119487.362237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.384250:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633234432 00000100:00100000:1.0:1787119487.384260:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633234432 00002000:00100000:1.0:1787119487.384309:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (7147520->7213055) req@ffff92a63403a300 x1873929633234432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.384320:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a300 with x1873929633234432 ext(7147520->7213055) 00002000:00010000:1.0:1787119487.384326:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403a300 00000100:00100000:1.0:1787119487.384361:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9026 00000100:00100000:1.0:1787119487.384371:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633234432:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.388054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000001:00080000:1.0:1787119487.397610:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969014 is committed 00000100:00100000:1.0:1787119487.443018:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633235072 00000100:00100000:1.0:1787119487.443029:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633235072 00002000:00010000:1.0:1787119487.443073:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (1130685->18446744073709551615) 00002000:00100000:1.0:1787119487.443080:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ca80 with x1873929633235072 ext(1130685->18446744073709551615) 00002000:00010000:1.0:1787119487.443090:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ca80. 00000100:00100000:1.0:1787119487.443128:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9029 00000100:00100000:1.0:1787119487.443138:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633235072:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119487.443472:0:20838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 41245778 -> 1130685 00002000:00010000:1.0:1787119487.443476:0:20838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119485 -> 1787119486 00002000:00010000:1.0:1787119487.443478:0:20838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119483 -> 1787119485 00002000:00010000:1.0:1787119487.443480:0:20838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119485 -> 1787119486 00002000:00010000:1.0:1787119487.443482:0:20838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1035 -> 1293 00000100:00100000:1.0:1787119487.443536:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633235072:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 400us (708us total) trans 4294968798 rc 0/0 00000100:00100000:1.0:1787119487.443543:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9029 00002000:00010000:1.0:1787119487.443547:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (1130685->18446744073709551615) 00002000:00100000:1.0:1787119487.443549:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ca80 with x1873929633235072 ext(1130685->18446744073709551615) 00002000:00010000:1.0:1787119487.443553:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ca80. 00000100:00100000:1.0:1787119487.485658:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633233408:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 142740us (143243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119487.485669:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4969 00000100:00100000:1.0:1787119487.485719:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633233536:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 142414us (142922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119487.485726:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4970 00000100:00100000:1.0:1787119487.500057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.500102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.508808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.525512:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633237120 00000100:00100000:1.0:1787119487.525522:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633237120 00002000:00100000:1.0:1787119487.525567:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (41164800->41230335) req@ffff92a63403bb80 x1873929633237120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.525578:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633237120 ext(41164800->41230335) 00002000:00010000:1.0:1787119487.525583:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403bb80 00000100:00100000:1.0:1787119487.525646:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633237248 00000100:00100000:1.0:1787119487.525649:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633237248 00002000:00100000:1.0:1787119487.525666:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (51429376->51494911) req@ffff92a63403b100 x1873929633237248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.525674:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b100 with x1873929633237248 ext(51429376->51494911) 00002000:00010000:1.0:1787119487.525677:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b100 00000100:00100000:1.0:1787119487.525692:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9042 00000100:00100000:1.0:1787119487.525700:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633237120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.536676:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633237120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10975us (11331us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119487.536743:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9042 00002000:00100000:1.0:1787119487.536754:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (41164800->41230335) req@ffff92a63403bb80 x1873929633237120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.536765:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633237120 ext(41164800->41230335) 00002000:00010000:1.0:1787119487.536771:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403bb80 00000100:00100000:1.0:1787119487.545264:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633237504 00000100:00100000:1.0:1787119487.545276:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633237504 00002000:00100000:1.0:1787119487.545330:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (41054208->41058303) req@ffff92a6181ac700 x1873929633237504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.545343:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ac700 with x1873929633237504 ext(41054208->41058303) 00002000:00010000:1.0:1787119487.545351:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ac700 00000100:00100000:1.0:1787119487.545386:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9045 00000100:00100000:1.0:1787119487.545396:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633237504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.546061:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633237504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 662us (1099us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.546070:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9045 00002000:00100000:1.0:1787119487.546077:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (41054208->41058303) req@ffff92a6181ac700 x1873929633237504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.546087:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ac700 with x1873929633237504 ext(41054208->41058303) 00002000:00010000:1.0:1787119487.546091:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ac700 00000100:00100000:1.0:1787119487.585960:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633238272 00000100:00100000:1.0:1787119487.585967:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633238272 00000100:00100000:1.0:1787119487.586012:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19370 00000100:00100000:1.0:1787119487.586020:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:32728:x1873929633238272:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119487.586063:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119487.586088:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a511474a00/0xcaba3de8463e2579 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471590f expref: 40 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.586107:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119487.586112:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119487.586319:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e25f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.586337:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e25f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.586346:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e25f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119487.586396:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976184 00000004:00010000:1.0:1787119487.586420:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4bd7593 reply state 00000000ee63e2ab transno 4294976185 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e25f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119487.586429:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119487.586565:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:32728:x1873929633238272:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 545us (9421us total) trans 4294976185 rc 0/0 00000100:00100000:1.0:1787119487.586571:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19370 00000020:00080000:1.0:1787119487.586576:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119487.587207:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19371 00000100:00100000:1.0:1787119487.587215:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:32724:x1873929633237888:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119487.587241:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119487.587259:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a511474400/0xcaba3de8463e25f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715939 expref: 41 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.587272:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119487.587276:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119487.587381:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e25fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.587392:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e25fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.587405:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e25fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119487.587556:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976186 00000004:00010000:1.0:1787119487.587579:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023fbb20f reply state 000000007c884b81 transno 4294976187 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e25fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119487.587660:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119487.587761:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:32724:x1873929633237888:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 545us (19356us total) trans 4294976187 rc 0/0 00000100:00100000:1.0:1787119487.587769:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19371 00000020:00080000:1.0:1787119487.587773:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119487.600490:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633238656 00000100:00100000:1.0:1787119487.600500:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633238656 00002000:00100000:1.0:1787119487.600555:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (51449856->51515391) req@ffff92a63403b480 x1873929633238656/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.600567:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b480 with x1873929633238656 ext(51449856->51515391) 00002000:00010000:1.0:1787119487.600572:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b480 00000100:00100000:1.0:1787119487.600609:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633238784 00000100:00100000:1.0:1787119487.600613:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633238784 00002000:00100000:1.0:1787119487.600627:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (61009920->61014015) req@ffff92a63403aa00 x1873929633238784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.600634:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403aa00 with x1873929633238784 ext(61009920->61014015) 00002000:00010000:1.0:1787119487.600637:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403aa00 00000100:00100000:1.0:1787119487.600650:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633238912 00000100:00100000:1.0:1787119487.600653:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633238912 00002000:00010000:1.0:1787119487.600663:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (15923287->18446744073709551615) 00002000:00100000:1.0:1787119487.600666:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039f80 with x1873929633238912 ext(15923287->18446744073709551615) 00002000:00010000:1.0:1787119487.600677:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039f80. 00000100:00100000:1.0:1787119487.600688:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633239040 00000100:00100000:1.0:1787119487.600690:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633239040 00002000:00010000:1.0:1787119487.600700:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (42456425->18446744073709551615) 00002000:00100000:1.0:1787119487.600703:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633239040 ext(42456425->18446744073709551615) 00002000:00010000:1.0:1787119487.600708:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634038000. 00000100:00100000:1.0:1787119487.600726:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9050 00000100:00100000:1.0:1787119487.600735:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633238656:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119487.600887:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9051 00000100:00100000:1.0:1787119487.600894:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633238784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.601091:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633238784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 196us (811us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.601099:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9051 00002000:00100000:1.0:1787119487.601105:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (61009920->61014015) req@ffff92a63403aa00 x1873929633238784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.601113:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403aa00 with x1873929633238784 ext(61009920->61014015) 00002000:00010000:1.0:1787119487.601116:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403aa00 00000100:00100000:1.0:1787119487.601133:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9052 00000100:00100000:1.0:1787119487.601140:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633238912:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119487.601487:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 61901891 -> 15923287 00002000:00010000:1.0:1787119487.601491:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119484 -> 1787119486 00002000:00010000:1.0:1787119487.601493:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119484 -> 1787119484 00002000:00010000:1.0:1787119487.601495:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119484 -> 1787119486 00002000:00010000:1.0:1787119487.601498:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1035 -> 2189 00000100:00100000:1.0:1787119487.601523:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633238912:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 383us (1229us total) trans 4294969017 rc 0/0 00000100:00100000:1.0:1787119487.601529:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9052 00002000:00010000:1.0:1787119487.601533:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (15923287->18446744073709551615) 00002000:00100000:1.0:1787119487.601535:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039f80 with x1873929633238912 ext(15923287->18446744073709551615) 00002000:00010000:1.0:1787119487.601540:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039f80. 00000100:00100000:1.0:1787119487.601555:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9053 00000100:00100000:1.0:1787119487.601563:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633239040:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119487.601688:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1130685 -> 42456425 00002000:00010000:1.0:1787119487.601692:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119487.601694:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119485 -> 1787119485 00002000:00010000:1.0:1787119487.601696:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119487.601698:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1293 -> 1293 00000100:00100000:1.0:1787119487.601722:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633239040:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 160us (1395us total) trans 4294968800 rc 0/0 00000100:00100000:1.0:1787119487.601729:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9053 00002000:00010000:1.0:1787119487.601732:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (42456425->18446744073709551615) 00002000:00100000:1.0:1787119487.601735:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633239040 ext(42456425->18446744073709551615) 00002000:00010000:1.0:1787119487.601739:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634038000. 00000100:00100000:1.0:1787119487.611003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.611025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.611055:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633239296 00000100:00100000:1.0:1787119487.611059:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633239296 00000100:00100000:1.0:1787119487.611093:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633239424 00000100:00100000:1.0:1787119487.611095:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633239424 00000100:00100000:1.0:1787119487.611113:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19372 00000100:00100000:1.0:1787119487.611120:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:32728:x1873929633239296:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119487.611140:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119487.611160:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2605 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715940 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611236:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e260c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611249:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e260c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611260:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e260c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119487.611282:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 15923287 00000004:00200000:1.0:1787119487.611286:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119487.611302:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e260c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611323:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2605 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715940 expref: 44 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611340:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e260c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715940 expref: 43 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611349:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119487.611352:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119487.611355:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119487.611399:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:32728:x1873929633239296:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 279us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119487.611407:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19372 00000100:00100000:1.0:1787119487.611423:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19373 00000100:00100000:1.0:1787119487.611429:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:32724:x1873929633239424:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119487.611436:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119487.611465:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2613 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715947 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611494:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e261a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611503:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e261a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611510:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e261a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119487.611522:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 42456425 00000004:00200000:1.0:1787119487.611525:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119487.611532:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e261a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611814:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2613 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715947 expref: 44 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611828:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e261a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715947 expref: 43 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.611835:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119487.611838:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119487.611841:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431e00, rc 0) 00000100:00100000:1.0:1787119487.611982:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:32724:x1873929633239424:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 552us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119487.611988:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19373 00000100:00100000:1.0:1787119487.612010:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9054 00000100:00100000:1.0:1787119487.612017:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633239168:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.638244:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633240192 00000100:00100000:1.0:1787119487.638254:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633240192 00002000:00100000:1.0:1787119487.638302:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (61050880->61087743) req@ffff92a634979880 x1873929633240192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.638313:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979880 with x1873929633240192 ext(61050880->61087743) 00002000:00010000:1.0:1787119487.638318:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979880 00000100:00100000:1.0:1787119487.638344:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633240320 00000100:00100000:1.0:1787119487.638347:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633240320 00002000:00100000:1.0:1787119487.638360:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (4104192->4169727) req@ffff92a63497a300 x1873929633240320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.638367:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633240320 ext(4104192->4169727) 00002000:00010000:1.0:1787119487.638371:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497a300 00000100:00100000:1.0:1787119487.638388:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9058 00000100:00100000:1.0:1787119487.638397:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633240192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.638721:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9059 00000100:00100000:1.0:1787119487.638728:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633240320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.648260:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633240192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9863us (10494us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119487.648266:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9058 00002000:00100000:1.0:1787119487.648270:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (61050880->61087743) req@ffff92a634979880 x1873929633240192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.648276:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979880 with x1873929633240192 ext(61050880->61087743) 00002000:00010000:1.0:1787119487.648279:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979880 00000100:00100000:1.0:1787119487.648319:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633240320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9592us (10283us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119487.648323:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9059 00002000:00100000:1.0:1787119487.648326:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (4104192->4169727) req@ffff92a63497a300 x1873929633240320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.648331:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633240320 ext(4104192->4169727) 00002000:00010000:1.0:1787119487.648333:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497a300 00000100:00100000:1.0:1787119487.674169:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633241216 00000100:00100000:1.0:1787119487.674172:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633241216 00000100:00100000:1.0:1787119487.674202:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19376 00000100:00100000:1.0:1787119487.674210:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:32720:x1873929633241216:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119487.674223:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119487.674238:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e262f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471594e expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.674310:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.674320:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.674335:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119487.674357:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 41245778 00000004:00200000:1.0:1787119487.674362:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119487.674378:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.674403:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e262f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471594e expref: 47 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.674415:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471594e expref: 46 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.674423:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119487.674426:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119487.674428:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119487.674494:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:32720:x1873929633241216:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 285us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119487.674501:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19376 00000100:00100000:1.0:1787119487.675121:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9063 00000100:00100000:1.0:1787119487.675129:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633241472:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119487.675488:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 61901891 -> 15923287 00002000:00010000:1.0:1787119487.675492:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119484 -> 1787119486 00002000:00010000:1.0:1787119487.675495:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119484 -> 1787119484 00002000:00010000:1.0:1787119487.675497:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119484 -> 1787119486 00002000:00010000:1.0:1787119487.675500:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1035 -> 2189 00000100:00100000:1.0:1787119487.675530:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633241472:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 401us (2095us total) trans 4294969019 rc 0/0 00000100:00100000:1.0:1787119487.675536:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9063 00002000:00010000:1.0:1787119487.675540:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (15923287->18446744073709551615) 00002000:00100000:1.0:1787119487.675542:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634978e00 with x1873929633241472 ext(15923287->18446744073709551615) 00002000:00010000:1.0:1787119487.675548:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634978e00. 00000100:00100000:1.0:1787119487.675564:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9064 00000100:00100000:1.0:1787119487.675571:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633241600:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119487.675681:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 15923287 -> 41245778 00002000:00010000:1.0:1787119487.675684:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119487.675686:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119484 -> 1787119484 00002000:00010000:1.0:1787119487.675688:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119487.675690:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2189 -> 1035 00000100:00100000:1.0:1787119487.675712:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633241600:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 141us (2240us total) trans 4294969020 rc 0/0 00000100:00100000:1.0:1787119487.675718:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9064 00002000:00010000:1.0:1787119487.675721:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (41245778->18446744073709551615) 00002000:00100000:1.0:1787119487.675724:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979f80 with x1873929633241600 ext(41245778->18446744073709551615) 00002000:00010000:1.0:1787119487.675728:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979f80. 00000100:00100000:1.0:1787119487.696743:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9068 00000100:00100000:1.0:1787119487.696757:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633242368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.697024:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633242368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 270us (1209us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.697035:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9068 00002000:00100000:1.0:1787119487.697042:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (4124672->4128767) req@ffff92a633e3ed80 x1873929633242368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.697050:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3ed80 with x1873929633242368 ext(4124672->4128767) 00002000:00010000:1.0:1787119487.697054:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3ed80 00000100:00100000:1.0:1787119487.697071:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9069 00000100:00100000:1.0:1787119487.697078:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633242240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.697156:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633242240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 79us (904us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.697162:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9069 00002000:00100000:1.0:1787119487.697168:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (41189376->41193471) req@ffff92a633e3d500 x1873929633242240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.697176:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3d500 with x1873929633242240 ext(41189376->41193471) 00002000:00010000:1.0:1787119487.697180:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3d500 00000100:00100000:1.0:1787119487.708549:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633243136 00000100:00100000:1.0:1787119487.708555:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633243136 00000100:00100000:1.0:1787119487.708608:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4973 00000100:00100000:1.0:1787119487.708615:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633243136:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119487.709533:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633243008:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1792us (2309us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119487.709539:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9073 00002000:00100000:1.0:1787119487.709546:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (41164800->41230335) req@ffff92a508ffd880 x1873929633243008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.709563:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd880 with x1873929633243008 ext(41164800->41230335) 00002000:00010000:1.0:1787119487.709567:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd880 00000100:00100000:1.0:1787119487.721576:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633243520 00000100:00100000:1.0:1787119487.721589:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633243520 00002000:00100000:1.0:1787119487.721644:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (41230336->41246719) req@ffff92a508fff100 x1873929633243520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.721656:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff100 with x1873929633243520 ext(41230336->41246719) 00002000:00010000:1.0:1787119487.721661:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508fff100 00000100:00100000:1.0:1787119487.721698:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9077 00000100:00100000:1.0:1787119487.721707:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633243520:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.721952:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633243520:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 245us (1666us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1787119487.721960:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9077 00002000:00100000:1.0:1787119487.721966:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (41230336->41246719) req@ffff92a508fff100 x1873929633243520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/16824 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.721975:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff100 with x1873929633243520 ext(41230336->41246719) 00002000:00010000:1.0:1787119487.721978:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508fff100 00000100:00100000:1.0:1787119487.725516:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633243648 00000100:00100000:1.0:1787119487.725529:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633243648 00002000:00100000:1.0:1787119487.726032:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (7168000->7172095) req@ffff92a633e3f480 x1873929633243648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.726045:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f480 with x1873929633243648 ext(7168000->7172095) 00002000:00010000:1.0:1787119487.726051:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3f480 00000100:00100000:1.0:1787119487.726127:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9078 00000100:00100000:1.0:1787119487.726137:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633243648:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.726355:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633243648:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 219us (1799us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.726363:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9078 00002000:00100000:1.0:1787119487.726370:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (7168000->7172095) req@ffff92a633e3f480 x1873929633243648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.726379:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f480 with x1873929633243648 ext(7168000->7172095) 00002000:00010000:1.0:1787119487.726382:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3f480 00000100:00100000:1.0:1787119487.731301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.731330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.732194:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9079 00000100:00100000:1.0:1787119487.732205:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633243776:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.732413:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633243776:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 209us (1119us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.732420:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9079 00002000:00100000:1.0:1787119487.732426:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (61005824->61009919) req@ffff92a5068b7100 x1873929633243776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.732434:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b7100 with x1873929633243776 ext(61005824->61009919) 00002000:00010000:1.0:1787119487.732455:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b7100 00000100:00100000:1.0:1787119487.747689:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633244416 00000100:00100000:1.0:1787119487.747694:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633244416 00002000:00100000:1.0:1787119487.747724:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (7147520->7213055) req@ffff92a508ffc000 x1873929633244416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.747741:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc000 with x1873929633244416 ext(7147520->7213055) 00002000:00010000:1.0:1787119487.747747:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffc000 00000100:00100000:1.0:1787119487.747763:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9083 00000100:00100000:1.0:1787119487.747769:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633244416:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.759471:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633244928 00000100:00100000:1.0:1787119487.759478:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633244928 00000100:00100000:1.0:1787119487.759520:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4974 00000100:00100000:1.0:1787119487.759529:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633244928:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119487.759757:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633244416:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11986us (12245us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119487.759765:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9083 00002000:00100000:1.0:1787119487.759773:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (7147520->7213055) req@ffff92a508ffc000 x1873929633244416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.759782:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc000 with x1873929633244416 ext(7147520->7213055) 00002000:00010000:1.0:1787119487.759786:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffc000 00000100:00100000:1.0:1787119487.762886:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633245184 00000100:00100000:1.0:1787119487.762896:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633245184 00002000:00100000:1.0:1787119487.762939:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (41185280->41189375) req@ffff92a633e3f100 x1873929633245184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.762949:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f100 with x1873929633245184 ext(41185280->41189375) 00002000:00010000:1.0:1787119487.762954:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3f100 00000100:00100000:1.0:1787119487.763222:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9087 00000100:00100000:1.0:1787119487.763232:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633245184:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.763808:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633245184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 574us (1062us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.763816:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9087 00002000:00100000:1.0:1787119487.763823:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (41185280->41189375) req@ffff92a633e3f100 x1873929633245184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.763832:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f100 with x1873929633245184 ext(41185280->41189375) 00002000:00010000:1.0:1787119487.763836:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3f100 00000100:00100000:1.0:1787119487.765548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.765651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.765674:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633245440 00000100:00100000:1.0:1787119487.765681:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633245440 00000100:00100000:1.0:1787119487.765723:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19379 00000100:00100000:1.0:1787119487.765730:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:32720:x1873929633245440:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119487.765782:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119487.765808:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471594e expref: 48 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.765827:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119487.765833:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119487.766220:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.766233:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.766243:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119487.766295:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976194 00000004:00010000:1.0:1787119487.766316:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062f22b73 reply state 00000000af59fb67 transno 4294976195 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119487.766324:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119487.766394:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:32720:x1873929633245440:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 663us (852us total) trans 4294976195 rc 0/0 00000100:00100000:1.0:1787119487.766401:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19379 00000020:00080000:1.0:1787119487.766405:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119487.768329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119487.772247:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.772261:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.772268:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.772275:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119487.772280:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.772287:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.772303:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119487.772306:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119487.772310:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.772320:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2652 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119487.772503:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633245824 00000100:00100000:1.0:1787119487.772512:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633245824 00002000:00010000:1.0:1787119487.772550:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (1130685->18446744073709551615) 00002000:00100000:1.0:1787119487.772554:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3d880 with x1873929633245824 ext(1130685->18446744073709551615) 00002000:00010000:1.0:1787119487.772564:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3d880. 00000100:00100000:1.0:1787119487.772603:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9090 00000100:00100000:1.0:1787119487.772613:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633245824:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119487.772966:0:19246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 41245778 -> 1130685 00002000:00010000:1.0:1787119487.772971:0:19246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119487.772973:0:19246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119484 -> 1787119485 00002000:00010000:1.0:1787119487.772975:0:19246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119487.772977:0:19246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 2189 -> 1293 00000100:00100000:1.0:1787119487.773291:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633245824:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 679us (1713us total) trans 4294968803 rc 0/0 00000100:00100000:1.0:1787119487.773299:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9090 00002000:00010000:1.0:1787119487.773303:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (1130685->18446744073709551615) 00002000:00100000:1.0:1787119487.773306:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3d880 with x1873929633245824 ext(1130685->18446744073709551615) 00002000:00010000:1.0:1787119487.773310:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3d880. 00000100:00100000:1.0:1787119487.789908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.789988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.811958:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633246592 00000100:00100000:1.0:1787119487.811968:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633246592 00000100:00100000:1.0:1787119487.812050:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19381 00000100:00100000:1.0:1787119487.812059:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:32727:x1873929633246592:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119487.812252:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119487.812284:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a511475c00/0xcaba3de8463e2595 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471591d expref: 50 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.812305:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119487.812310:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119487.812611:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2667 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.812626:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119487.812636:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119487.812691:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976196 00000004:00010000:1.0:1787119487.812719:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7fce794 reply state 0000000012e5ec11 transno 4294976197 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119487.812728:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119487.812839:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:32727:x1873929633246592:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 779us (960us total) trans 4294976197 rc 0/0 00000100:00100000:1.0:1787119487.812847:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19381 00000020:00080000:1.0:1787119487.812852:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119487.813855:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9095 00000100:00100000:1.0:1787119487.813867:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633246848:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.821211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.832542:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633246208:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 35434us (42641us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119487.832551:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9093 00002000:00100000:1.0:1787119487.832558:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (12148736->12214271) req@ffff92a5068b6d80 x1873929633246208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.832566:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6d80 with x1873929633246208 ext(12148736->12214271) 00002000:00010000:1.0:1787119487.832570:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5068b6d80 00000100:00100000:1.0:1787119487.832996:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633244928:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 73466us (74928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119487.833004:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4974 00000100:00100000:1.0:1787119487.839873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.843115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.843197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.843233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.843966:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9099 00000100:00100000:1.0:1787119487.843976:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633247616:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119487.861569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.875901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119487.879473:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633247616:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 35464us (36205us total) trans 4294969024 rc 0/0 00000100:00100000:1.0:1787119487.879488:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9099 00002000:00100000:1.0:1787119487.879510:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (41185280->41245777) req@ffff92a5068b6300 x1873929633247616/t4294969024(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/448 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.879521:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6300 with x1873929633247616 ext(41185280->41245777) 00002000:00010000:1.0:1787119487.879528:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b6300 00000100:00100000:1.0:1787119487.894382:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633248512 00000100:00100000:1.0:1787119487.894395:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633248512 00000100:00100000:1.0:1787119487.895603:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4975 00000100:00100000:1.0:1787119487.895614:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633248512:12345-192.168.201.59@tcp:16:fsx.0 00002000:00010000:1.0:1787119487.897205:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 1130685 -> 42456425 00002000:00010000:1.0:1787119487.897212:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119487.897213:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119485 -> 1787119485 00002000:00010000:1.0:1787119487.897215:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119487.897216:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1293 -> 1293 00000100:00100000:1.0:1787119487.897280:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633248640:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1902us (2400us total) trans 4294968804 rc 0/0 00000100:00100000:1.0:1787119487.897288:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9104 00002000:00010000:1.0:1787119487.897292:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (42456425->18446744073709551615) 00002000:00100000:1.0:1787119487.897294:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffea00 with x1873929633248640 ext(42456425->18446744073709551615) 00002000:00010000:1.0:1787119487.897300:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffea00. 00000100:00100000:1.0:1787119487.908372:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633249280 00000100:00100000:1.0:1787119487.908383:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633249280 00002000:00100000:1.0:1787119487.908435:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (3424256->3489791) req@ffff92a62a123800 x1873929633249280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.908467:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123800 with x1873929633249280 ext(3424256->3489791) 00002000:00010000:1.0:1787119487.908474:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a123800 00000100:00100000:1.0:1787119487.908763:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9108 00000100:00100000:1.0:1787119487.908778:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633249280:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.916415:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633249280:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7629us (8481us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119487.916429:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9108 00002000:00100000:1.0:1787119487.916461:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (3424256->3489791) req@ffff92a62a123800 x1873929633249280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.916471:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123800 with x1873929633249280 ext(3424256->3489791) 00002000:00010000:1.0:1787119487.916477:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a123800 00000100:00100000:1.0:1787119487.961625:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633248512:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 66012us (67366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119487.961633:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4975 00000001:00080000:1.0:1787119487.961658:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969024 is committed 00000100:00100000:1.0:1787119487.965728:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633250560 00000100:00100000:1.0:1787119487.965738:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633250560 00002000:00100000:1.0:1787119487.965798:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (7147520->7213055) req@ffff92a508ffed80 x1873929633250560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.965810:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffed80 with x1873929633250560 ext(7147520->7213055) 00002000:00010000:1.0:1787119487.965815:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffed80 00000100:00100000:1.0:1787119487.966112:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633250688 00000100:00100000:1.0:1787119487.966117:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633250688 00002000:00100000:1.0:1787119487.966139:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (22147072->22204415) req@ffff92a508ffd180 x1873929633250688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.966148:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd180 with x1873929633250688 ext(22147072->22204415) 00002000:00010000:1.0:1787119487.966151:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffd180 00000100:00100000:1.0:1787119487.966180:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9116 00000100:00100000:1.0:1787119487.966191:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633250560:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.972954:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633250560:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6764us (7576us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119487.972960:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9116 00002000:00100000:1.0:1787119487.972965:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (7147520->7213055) req@ffff92a508ffed80 x1873929633250560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.972974:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffed80 with x1873929633250560 ext(7147520->7213055) 00002000:00010000:1.0:1787119487.972978:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffed80 00000100:00100000:1.0:1787119487.972993:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9118 00000100:00100000:1.0:1787119487.973000:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633250816:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.973183:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633250816:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 184us (1160us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.973187:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9118 00002000:00100000:1.0:1787119487.973191:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (41185280->41189375) req@ffff92a508ffd880 x1873929633250816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.973196:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd880 with x1873929633250816 ext(41185280->41189375) 00002000:00010000:1.0:1787119487.973198:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd880 00000100:00100000:1.0:1787119487.989480:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633251584 00000100:00100000:1.0:1787119487.989490:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633251584 00002000:00100000:1.0:1787119487.989534:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (9199616->9203711) req@ffff92a508fff100 x1873929633251584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.989544:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff100 with x1873929633251584 ext(9199616->9203711) 00002000:00010000:1.0:1787119487.989549:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508fff100 00000100:00100000:1.0:1787119487.989574:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9123 00000100:00100000:1.0:1787119487.989583:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633251584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119487.989839:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633251584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 256us (811us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119487.989848:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9123 00002000:00100000:1.0:1787119487.989855:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (9199616->9203711) req@ffff92a508fff100 x1873929633251584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.989863:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff100 with x1873929633251584 ext(9199616->9203711) 00002000:00010000:1.0:1787119487.989867:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508fff100 00000100:00100000:1.0:1787119487.994842:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633251840:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8872us (9296us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119487.994849:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9122 00002000:00100000:1.0:1787119487.994854:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (41164800->41230335) req@ffff92a512846a00 x1873929633251840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.994861:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633251840 ext(41164800->41230335) 00002000:00010000:1.0:1787119487.994864:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846a00 00000100:00100000:1.0:1787119487.999288:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633252352 00000100:00100000:1.0:1787119487.999297:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633252352 00002000:00100000:1.0:1787119487.999347:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (9179136->9248767) req@ffff92a508ffc000 x1873929633252352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/0 e 0 to 0 dl 1787119498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119487.999359:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc000 with x1873929633252352 ext(9179136->9248767) 00002000:00010000:1.0:1787119487.999365:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffc000 00000100:00100000:1.0:1787119487.999489:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9127 00000100:00100000:1.0:1787119487.999511:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633252352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.008368:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633252352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8863us (9181us total) trans 0 rc 61440/61440 00000100:00100000:1.0:1787119488.008382:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9127 00002000:00100000:1.0:1787119488.008393:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (9179136->9248767) req@ffff92a508ffc000 x1873929633252352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:523/0 lens 504/440 e 0 to 0 dl 1787119498 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.008403:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc000 with x1873929633252352 ext(9179136->9248767) 00002000:00010000:1.0:1787119488.008408:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffc000 00000100:00100000:1.0:1787119488.019329:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633253248 00000100:00100000:1.0:1787119488.019336:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633253248 00002000:00100000:1.0:1787119488.019366:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (28450816->28454911) req@ffff92a519cd6a00 x1873929633253248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.019375:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633253248 ext(28450816->28454911) 00002000:00010000:1.0:1787119488.019379:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cd6a00 00000100:00100000:1.0:1787119488.019407:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9133 00000100:00100000:1.0:1787119488.019414:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633253248:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.019636:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633253248:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 220us (1585us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.019644:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9133 00002000:00100000:1.0:1787119488.019650:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (28450816->28454911) req@ffff92a519cd6a00 x1873929633253248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.019659:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633253248 ext(28450816->28454911) 00002000:00010000:1.0:1787119488.019662:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cd6a00 00000100:00100000:1.0:1787119488.023315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.034901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.050371:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633254016 00000100:00100000:1.0:1787119488.050382:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633254016 00002000:00100000:1.0:1787119488.050429:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (28430336->28495871) req@ffff92a633e3c700 x1873929633254016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.050613:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3c700 with x1873929633254016 ext(28430336->28495871) 00002000:00010000:1.0:1787119488.050619:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3c700 00000100:00100000:1.0:1787119488.050696:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9137 00000100:00100000:1.0:1787119488.050706:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633254016:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.059806:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633254016:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9099us (10625us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119488.059820:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9137 00002000:00100000:1.0:1787119488.059833:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (28430336->28495871) req@ffff92a633e3c700 x1873929633254016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.059844:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3c700 with x1873929633254016 ext(28430336->28495871) 00002000:00010000:1.0:1787119488.059850:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3c700 00000100:00100000:1.0:1787119488.059878:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633254272 00000100:00100000:1.0:1787119488.059886:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633254272 00002000:00100000:1.0:1787119488.059921:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (7172096->7176191) req@ffff92a519cd5180 x1873929633254272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.059930:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5180 with x1873929633254272 ext(7172096->7176191) 00002000:00010000:1.0:1787119488.059933:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5180 00000100:00100000:1.0:1787119488.059956:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9139 00000100:00100000:1.0:1787119488.059965:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633254272:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.060124:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633254272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 160us (423us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.060134:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9139 00002000:00100000:1.0:1787119488.060140:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (7172096->7176191) req@ffff92a519cd5180 x1873929633254272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.060148:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5180 with x1873929633254272 ext(7172096->7176191) 00002000:00010000:1.0:1787119488.060151:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5180 00000001:00080000:1.0:1787119488.099028:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968805 is committed 00000100:00100000:1.0:1787119488.102960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.103645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.103723:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633255680 00000100:00100000:1.0:1787119488.103732:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633255680 00002000:00100000:1.0:1787119488.104610:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (7462912->7467007) req@ffff92a5068b6680 x1873929633255680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.104623:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6680 with x1873929633255680 ext(7462912->7467007) 00002000:00010000:1.0:1787119488.104629:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5068b6680 00000100:00100000:1.0:1787119488.104662:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9143 00000100:00100000:1.0:1787119488.104674:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633255680:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.105256:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633255680:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 584us (1611us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.105265:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9143 00002000:00100000:1.0:1787119488.105272:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (7462912->7467007) req@ffff92a5068b6680 x1873929633255680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.105280:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6680 with x1873929633255680 ext(7462912->7467007) 00002000:00010000:1.0:1787119488.105284:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5068b6680 00000100:00100000:1.0:1787119488.110000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.110034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.110065:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633255936 00000100:00100000:1.0:1787119488.110075:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633255936 00002000:00100000:1.0:1787119488.110119:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (12169216->12173311) req@ffff92a6072fb100 x1873929633255936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.110130:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb100 with x1873929633255936 ext(12169216->12173311) 00002000:00010000:1.0:1787119488.110136:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072fb100 00000100:00100000:1.0:1787119488.110160:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9144 00000100:00100000:1.0:1787119488.110168:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633255936:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.110402:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633255936:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 234us (367us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.110410:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9144 00002000:00100000:1.0:1787119488.110417:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (12169216->12173311) req@ffff92a6072fb100 x1873929633255936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.110425:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb100 with x1873929633255936 ext(12169216->12173311) 00002000:00010000:1.0:1787119488.110429:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072fb100 00000100:00100000:1.0:1787119488.118318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.118355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.118377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.118404:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633256192 00000100:00100000:1.0:1787119488.118414:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633256192 00002000:00100000:1.0:1787119488.118491:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (12173312->12177407) req@ffff92a6072f9c00 x1873929633256192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.119372:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9c00 with x1873929633256192 ext(12173312->12177407) 00002000:00010000:1.0:1787119488.119377:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072f9c00 00000100:00100000:1.0:1787119488.119405:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9147 00000100:00100000:1.0:1787119488.119413:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633256192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.119623:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633256192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 210us (1315us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.119629:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9147 00002000:00100000:1.0:1787119488.119634:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (12173312->12177407) req@ffff92a6072f9c00 x1873929633256192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.119641:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9c00 with x1873929633256192 ext(12173312->12177407) 00002000:00010000:1.0:1787119488.119644:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072f9c00 00000001:00080000:1.0:1787119488.130488:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969027 is committed 00000100:00100000:1.0:1787119488.147658:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633257088 00000100:00100000:1.0:1787119488.147667:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633257088 00002000:00100000:1.0:1787119488.147715:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (58482688->58486783) req@ffff92a519cd5880 x1873929633257088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.147727:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5880 with x1873929633257088 ext(58482688->58486783) 00002000:00010000:1.0:1787119488.147733:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cd5880 00000100:00100000:1.0:1787119488.147769:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9151 00000100:00100000:1.0:1787119488.147784:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633257088:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.148017:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633257088:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 233us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.148024:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9151 00002000:00100000:1.0:1787119488.148031:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (58482688->58486783) req@ffff92a519cd5880 x1873929633257088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.148046:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5880 with x1873929633257088 ext(58482688->58486783) 00002000:00010000:1.0:1787119488.148049:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cd5880 00000100:00100000:1.0:1787119488.153058:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633256704:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17628us (18059us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119488.153065:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9150 00002000:00100000:1.0:1787119488.153072:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (12148736->12214271) req@ffff92a519cd6300 x1873929633256704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.153080:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6300 with x1873929633256704 ext(12148736->12214271) 00002000:00010000:1.0:1787119488.153083:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cd6300 00000100:00100000:1.0:1787119488.154270:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633257216 00000100:00100000:1.0:1787119488.154280:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633257216 00002000:00100000:1.0:1787119488.154320:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (12730368->12767231) req@ffff92a519cd5500 x1873929633257216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.154330:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5500 with x1873929633257216 ext(12730368->12767231) 00002000:00010000:1.0:1787119488.154334:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5500 00000100:00100000:1.0:1787119488.154400:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9152 00000100:00100000:1.0:1787119488.154411:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633257216:12345-192.168.201.59@tcp:3:fsx.0 00000100:00080000:1.0:1787119488.164720:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119488.164841:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653565696:0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.164905:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119488.164953:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653566208:0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.164985:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119488.165011:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787119488.165019:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653566080:0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.165050:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119488.165085:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653565824:0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.165121:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119488.165146:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787119488.165155:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653565952:0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.165195:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119488.165233:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653566208 00000100:00100000:1.0:1787119488.165237:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653566208 00000100:00100000:1.0:1787119488.165276:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1787119488.165284:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653566208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.165323:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653566208:12345-0@lo:400:kworker.0 Request processed in 39us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.165331:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1787119488.165361:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653565952 00000100:00100000:1.0:1787119488.165367:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653565952 00000100:00100000:1.0:1787119488.165410:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1787119488.165417:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653565824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.165563:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653565824:12345-0@lo:400:kworker.0 Request processed in 146us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.165570:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1787119488.165593:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1787119488.165600:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653565952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.165629:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653565952:12345-0@lo:400:kworker.0 Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.165636:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1787119488.165671:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653565696:0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.165684:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653566208:0@lo:400:kworker.0 00000100:00080000:1.0:1787119488.165703:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787119488.165705:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787119488.165719:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653565952:0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.165728:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653565824:0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.165829:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633257216:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11420us (12030us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119488.165835:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9152 00002000:00100000:1.0:1787119488.165842:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (12730368->12767231) req@ffff92a519cd5500 x1873929633257216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.165849:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5500 with x1873929633257216 ext(12730368->12767231) 00002000:00010000:1.0:1787119488.165852:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5500 00000100:00100000:1.0:1787119488.165888:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653566336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119488.165920:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119488.165957:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653566336 00000100:00100000:1.0:1787119488.165960:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653566336 00000100:00100000:1.0:1787119488.165982:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787119488.165988:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653566336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787119488.166000:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 823984128 pending 0 free 3827302400 avail 3812622336 00000100:00100000:1.0:1787119488.166027:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653566336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.166032:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787119488.166053:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653566336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119488.169224:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653566080:0@lo:400:kworker.0 00000100:00100000:1.0:1787119488.171184:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633257856 00000100:00100000:1.0:1787119488.171193:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633257856 00000100:00100000:1.0:1787119488.171286:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19397 00000100:00100000:1.0:1787119488.171294:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+66:32729:x1873929633257856:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119488.171341:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119488.171366:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e26f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471598d expref: 66 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.171381:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119488.171385:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119488.171665:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.171680:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.171690:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119488.171736:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976210 00000004:00010000:1.0:1787119488.171762:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014a3e0aa reply state 00000000cd819901 transno 4294976211 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119488.171771:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119488.171843:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+68:32729:x1873929633257856:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 549us (726us total) trans 4294976211 rc 0/0 00000100:00100000:1.0:1787119488.171852:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19397 00000020:00080000:1.0:1787119488.171857:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119488.172127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.172244:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119488.175368:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.175376:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.175381:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.175385:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119488.175388:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.175393:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.175406:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119488.175408:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119488.175411:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.175414:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2716 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119488.176660:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633258496 00000100:00100000:1.0:1787119488.176668:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633258496 00002000:00100000:1.0:1787119488.176701:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (10244096->10289151) req@ffff92a62041f800 x1873929633258496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.176712:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f800 with x1873929633258496 ext(10244096->10289151) 00002000:00010000:1.0:1787119488.176717:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041f800 00000100:00100000:1.0:1787119488.176747:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9160 00000100:00100000:1.0:1787119488.176754:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633258496:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.181164:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633258496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4399us (4727us total) trans 0 rc 45056/45056 00000100:00100000:1.0:1787119488.181173:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9160 00002000:00100000:1.0:1787119488.181183:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (10244096->10289151) req@ffff92a62041f800 x1873929633258496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.181191:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f800 with x1873929633258496 ext(10244096->10289151) 00002000:00010000:1.0:1787119488.181196:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041f800 00000100:00100000:1.0:1787119488.182110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.182142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.186856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.186888:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.188293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.195297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.195320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.195341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.195478:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633259264:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6988us (7190us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119488.195485:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9165 00002000:00100000:1.0:1787119488.195492:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (1941504->2007039) req@ffff92a5098a5880 x1873929633259264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.195942:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5880 with x1873929633259264 ext(1941504->2007039) 00002000:00010000:1.0:1787119488.195947:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5880 00000100:00100000:1.0:1787119488.202893:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633259904 00000100:00100000:1.0:1787119488.202904:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633259904 00002000:00100000:1.0:1787119488.202950:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (7172096->7176191) req@ffff92a511631500 x1873929633259904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.202962:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633259904 ext(7172096->7176191) 00002000:00010000:1.0:1787119488.202968:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511631500 00000100:00100000:1.0:1787119488.207209:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9171 00000100:00100000:1.0:1787119488.207232:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633259904:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.207511:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633259904:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 289us (4782us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.207521:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9171 00002000:00100000:1.0:1787119488.207531:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (7172096->7176191) req@ffff92a511631500 x1873929633259904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.207543:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633259904 ext(7172096->7176191) 00002000:00010000:1.0:1787119488.207550:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511631500 00000100:00100000:1.0:1787119488.207576:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9172 00000100:00100000:1.0:1787119488.207596:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633260160:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119488.208553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.213908:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633260288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4057us (5417us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119488.213928:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9174 00002000:00100000:1.0:1787119488.213941:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (3489792->3526655) req@ffff92a5098a7480 x1873929633260288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.213956:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7480 with x1873929633260288 ext(3489792->3526655) 00002000:00010000:1.0:1787119488.213963:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a7480 00000100:00100000:1.0:1787119488.217317:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633260800:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 3530us (3685us total) trans 4294968807 rc 0/0 00000100:00100000:1.0:1787119488.217330:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9177 00002000:00100000:1.0:1787119488.217343:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (3309568->58588948) req@ffff92a5098a2300 x1873929633260800/t4294968807(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 520/456 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.217353:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2300 with x1873929633260800 ext(3309568->58588948) 00002000:00010000:1.0:1787119488.217359:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a2300 00000001:00080000:1.0:1787119488.246345:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969029 is committed 00000001:00080000:1.0:1787119488.246355:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969030 is committed 00000001:00080000:1.0:1787119488.246361:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969031 is committed 00000001:00080000:1.0:1787119488.253361:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968807 is committed 00000100:00100000:1.0:1787119488.254170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.254222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.258999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.259137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.259163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.259734:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633262080:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 10352us (10572us total) trans 4294969033 rc 0/0 00000100:00100000:1.0:1787119488.259747:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9182 00002000:00100000:1.0:1787119488.259760:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (1961984->2002943) req@ffff92a62041ed80 x1873929633262080/t4294969033(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/448 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.259771:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ed80 with x1873929633262080 ext(1961984->2002943) 00002000:00010000:1.0:1787119488.259778:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ed80 00000100:00100000:1.0:1787119488.259804:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633262464 00000100:00100000:1.0:1787119488.259811:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633262464 00002000:00100000:1.0:1787119488.259840:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (0->1048575) req@ffff92a5098a5180 x1873929633262464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.259848:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5180 with x1873929633262464 ext(0->1048575) 00002000:00010000:1.0:1787119488.259851:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5180 00000100:00100000:1.0:1787119488.259866:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633262592 00000100:00100000:1.0:1787119488.259869:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633262592 00002000:00100000:1.0:1787119488.259883:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (1048576->1134591) req@ffff92a5098a4000 x1873929633262592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.259892:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4000 with x1873929633262592 ext(1048576->1134591) 00002000:00010000:1.0:1787119488.259894:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4000 00000100:00100000:1.0:1787119488.259907:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633262720 00000100:00100000:1.0:1787119488.259910:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633262720 00002000:00100000:1.0:1787119488.259924:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (12173312->12177407) req@ffff92a5098a4a80 x1873929633262720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.259931:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633262720 ext(12173312->12177407) 00002000:00010000:1.0:1787119488.259934:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4a80 00000100:00100000:1.0:1787119488.259949:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9185 00000100:00100000:1.0:1787119488.259958:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633262464:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.260669:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9186 00000100:00100000:1.0:1787119488.260680:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633262592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.260826:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9187 00000100:00100000:1.0:1787119488.260833:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633262720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.260953:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633262720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 120us (1788us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.260961:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9187 00002000:00100000:1.0:1787119488.260967:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (12173312->12177407) req@ffff92a5098a4a80 x1873929633262720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.260974:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633262720 ext(12173312->12177407) 00002000:00010000:1.0:1787119488.260979:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4a80 00000100:00100000:1.0:1787119488.263777:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.263817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.263903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.269923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.284429:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633263616 00000100:00100000:1.0:1787119488.286072:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633263616 00000100:00100000:1.0:1787119488.286113:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19402 00000100:00100000:1.0:1787119488.286119:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+71:32724:x1873929633263616:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119488.286133:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119488.286152:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2747 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159b0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.286247:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e274e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.286261:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e274e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.286272:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e274e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119488.286295:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 6431679 00000004:00200000:1.0:1787119488.286300:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119488.286315:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e274e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.286341:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2747 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159b0 expref: 73 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.286358:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e274e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159b0 expref: 72 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.286366:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119488.286369:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119488.286372:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600031c00, rc 0) 00000100:00100000:1.0:1787119488.286393:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+72:32724:x1873929633263616:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 274us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.286399:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19402 00000100:00100000:1.0:1787119488.297891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.297957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.297987:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633263872 00000100:00100000:1.0:1787119488.297996:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633263872 00002000:00100000:1.0:1787119488.298045:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (12214272->12251135) req@ffff92a5098a6a00 x1873929633263872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.298057:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6a00 with x1873929633263872 ext(12214272->12251135) 00002000:00010000:1.0:1787119488.298063:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6a00 00000100:00100000:1.0:1787119488.298092:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633264000 00000100:00100000:1.0:1787119488.298095:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633264000 00002000:00100000:1.0:1787119488.298114:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (28454912->28459007) req@ffff92a5098a5c00 x1873929633264000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.298129:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5c00 with x1873929633264000 ext(28454912->28459007) 00002000:00010000:1.0:1787119488.298132:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a5c00 00000100:00100000:1.0:1787119488.298153:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9192 00000100:00100000:1.0:1787119488.298163:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633263872:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.298402:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9193 00000100:00100000:1.0:1787119488.298411:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633264000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.298900:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633264000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 245us (698us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.298912:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9193 00002000:00100000:1.0:1787119488.298922:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (28454912->28459007) req@ffff92a5098a5c00 x1873929633264000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.298931:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5c00 with x1873929633264000 ext(28454912->28459007) 00002000:00010000:1.0:1787119488.298935:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a5c00 00000100:00100000:1.0:1787119488.313994:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633263872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15820us (16100us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119488.314009:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9192 00002000:00100000:1.0:1787119488.314023:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (12214272->12251135) req@ffff92a5098a6a00 x1873929633263872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.314034:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6a00 with x1873929633263872 ext(12214272->12251135) 00002000:00010000:1.0:1787119488.314041:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6a00 00000100:00100000:1.0:1787119488.327231:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633264384 00000100:00100000:1.0:1787119488.327241:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633264384 00000100:00100000:1.0:1787119488.327295:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633264640 00000100:00100000:1.0:1787119488.327298:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633264640 00000100:00100000:1.0:1787119488.327324:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19403 00000100:00100000:1.0:1787119488.327334:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+73:32724:x1873929633264384:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119488.327388:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119488.327418:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e274e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159b0 expref: 73 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.327646:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119488.327651:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119488.327796:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e275c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.327805:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e275c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.327812:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e275c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119488.327843:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976217 00000004:00010000:1.0:1787119488.327861:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c47c971 reply state 00000000329b1675 transno 4294976219 ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e275c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119488.327867:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119488.327899:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+77:32724:x1873929633264384:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 568us (753us total) trans 4294976219 rc 0/0 00000100:00100000:1.0:1787119488.327905:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19403 00000020:00080000:1.0:1787119488.327908:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119488.345008:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633264128:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16909us (17904us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119488.345028:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9194 00002000:00100000:1.0:1787119488.345041:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (28430336->28495871) req@ffff92a62041ce00 x1873929633264128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.345051:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ce00 with x1873929633264128 ext(28430336->28495871) 00002000:00010000:1.0:1787119488.345057:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041ce00 00000100:00100000:1.0:1787119488.348982:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633265024 00000100:00100000:1.0:1787119488.348993:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633265024 00002000:00010000:1.0:1787119488.349033:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (42456425->18446744073709551615) 00002000:00100000:1.0:1787119488.349038:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631f80 with x1873929633265024 ext(42456425->18446744073709551615) 00002000:00010000:1.0:1787119488.349049:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511631f80. 00000100:00100000:1.0:1787119488.349077:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633265152 00000100:00100000:1.0:1787119488.349080:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633265152 00002000:00100000:1.0:1787119488.349101:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (3448832->3452927) req@ffff92a62041f480 x1873929633265152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.349112:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f480 with x1873929633265152 ext(3448832->3452927) 00002000:00010000:1.0:1787119488.349117:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041f480 00000100:00100000:1.0:1787119488.349136:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9197 00000100:00100000:1.0:1787119488.349145:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633265024:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119488.349415:0:20838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 1130685 -> 42456425 00002000:00010000:1.0:1787119488.349418:0:20838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119488.349420:0:20838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119488.349423:0:20838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119488.349425:0:20838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1293 -> 651 00000100:00100000:1.0:1787119488.349521:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633265024:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 377us (2396us total) trans 4294969034 rc 0/0 00000100:00100000:1.0:1787119488.349530:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9197 00002000:00010000:1.0:1787119488.349533:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (42456425->18446744073709551615) 00002000:00100000:1.0:1787119488.349536:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631f80 with x1873929633265024 ext(42456425->18446744073709551615) 00002000:00010000:1.0:1787119488.349541:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511631f80. 00000100:00100000:1.0:1787119488.349559:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9198 00000100:00100000:1.0:1787119488.349565:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633265152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.349922:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633265152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 356us (1574us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.349929:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9198 00002000:00100000:1.0:1787119488.349937:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (3448832->3452927) req@ffff92a62041f480 x1873929633265152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.349945:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f480 with x1873929633265152 ext(3448832->3452927) 00002000:00010000:1.0:1787119488.349948:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041f480 00000100:00100000:1.0:1787119488.349969:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633265280 00000100:00100000:1.0:1787119488.349973:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633265280 00000100:00100000:1.0:1787119488.350002:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19405 00000100:00100000:1.0:1787119488.350009:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+74:32724:x1873929633265280:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119488.350023:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119488.350039:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2763 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159b7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.350121:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e276a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.350134:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e276a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.350146:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e276a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119488.350168:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 26311337 00000004:00200000:1.0:1787119488.350172:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119488.350186:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e276a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.350209:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2763 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159b7 expref: 76 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.350226:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e276a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159b7 expref: 75 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.350233:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119488.350236:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119488.350239:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600030000, rc 0) 00000100:00100000:1.0:1787119488.350258:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+75:32724:x1873929633265280:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 251us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.350263:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19405 00000100:00100000:1.0:1787119488.352351:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633265536 00000100:00100000:1.0:1787119488.352359:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633265536 00000100:00100000:1.0:1787119488.352399:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19406 00000100:00100000:1.0:1787119488.352407:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+75:32720:x1873929633265536:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119488.352481:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119488.352791:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e000/0xcaba3de8463e2698 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715971 expref: 75 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.352817:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119488.352821:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119488.352998:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.353010:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.353019:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119488.353060:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976220 00000004:00010000:1.0:1787119488.353079:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009465d41c reply state 0000000075cc6728 transno 4294976221 ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119488.353087:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119488.353165:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+77:32720:x1873929633265536:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 758us (1021us total) trans 4294976221 rc 0/0 00000100:00100000:1.0:1787119488.353172:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19406 00000020:00080000:1.0:1787119488.353176:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787119488.356788:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.356809:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.356817:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.356825:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a600031a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119488.356831:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.356839:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.356856:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119488.356859:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119488.356862:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.356868:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2771 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119488.360719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.360757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.360817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.360852:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633265920 00000100:00100000:1.0:1787119488.360861:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633265920 00000100:00100000:1.0:1787119488.360912:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19407 00000100:00100000:1.0:1787119488.360922:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+76:32727:x1873929633265920:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119488.360946:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119488.360968:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030200/0xcaba3de8463e2778 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159be expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.361051:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e277f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.361065:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e277f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.361079:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e277f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119488.361102:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 42456425 00000004:00200000:1.0:1787119488.361106:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119488.361125:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e277f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.361151:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030200/0xcaba3de8463e2778 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159be expref: 78 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.361170:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e277f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159be expref: 77 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.361178:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119488.361181:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119488.361184:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600031000, rc 0) 00000100:00100000:1.0:1787119488.361234:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+77:32727:x1873929633265920:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 315us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.361241:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19407 00000100:00100000:1.0:1787119488.384175:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633266304 00000100:00100000:1.0:1787119488.384185:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633266304 00000100:00100000:1.0:1787119488.384297:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19408 00000100:00100000:1.0:1787119488.384307:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+77:32720:x1873929633266304:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119488.384326:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119488.384348:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030200/0xcaba3de8463e2786 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159c5 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.384434:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e278d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.384741:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e278d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.384753:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e278d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119488.384783:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 39334240 00000004:00200000:1.0:1787119488.384788:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119488.384807:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e278d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.384833:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030200/0xcaba3de8463e2786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159c5 expref: 79 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.384851:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e278d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159c5 expref: 78 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.384861:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119488.384864:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119488.384867:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600031a00, rc 0) 00000100:00100000:1.0:1787119488.384917:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+78:32720:x1873929633266304:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 612us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.384925:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19408 00000100:00100000:1.0:1787119488.387357:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633266176 00000100:00100000:1.0:1787119488.387367:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633266176 00002000:00100000:1.0:1787119488.387414:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (12730368->12767231) req@ffff92a511630a80 x1873929633266176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.387424:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630a80 with x1873929633266176 ext(12730368->12767231) 00002000:00010000:1.0:1787119488.387430:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511630a80 00000100:00100000:1.0:1787119488.387769:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9201 00000100:00100000:1.0:1787119488.387780:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633266176:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.389264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.390081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.399621:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633266688 00000100:00100000:1.0:1787119488.403228:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633266688 00000100:00100000:1.0:1787119488.427324:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633267328:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13641us (14736us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119488.427336:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9210 00002000:00100000:1.0:1787119488.427345:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (3489792->3526655) req@ffff92a606154a80 x1873929633267328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.427355:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154a80 with x1873929633267328 ext(3489792->3526655) 00002000:00010000:1.0:1787119488.427359:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606154a80 00000100:00100000:1.0:1787119488.435790:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633267712:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9480us (11833us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119488.435799:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9213 00002000:00100000:1.0:1787119488.435806:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (12214272->12251135) req@ffff92a62a127480 x1873929633267712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.435816:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127480 with x1873929633267712 ext(12214272->12251135) 00002000:00010000:1.0:1787119488.435820:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127480 00000100:00100000:1.0:1787119488.436098:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9215 00000100:00100000:1.0:1787119488.436108:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633267968:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.446087:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633267968:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9968us (10462us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119488.446102:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9215 00002000:00100000:1.0:1787119488.446115:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (1941504->2007039) req@ffff92a62a125180 x1873929633267968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.446127:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125180 with x1873929633267968 ext(1941504->2007039) 00002000:00010000:1.0:1787119488.446134:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a125180 00000100:00100000:1.0:1787119488.460315:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9216 00000100:00100000:1.0:1787119488.460327:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633268224:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.460782:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633268224:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 456us (12589us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.460789:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9216 00002000:00100000:1.0:1787119488.460796:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (3444736->3448831) req@ffff92a62a126d80 x1873929633268224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.460805:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126d80 with x1873929633268224 ext(3444736->3448831) 00002000:00010000:1.0:1787119488.460809:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126d80 00000100:00100000:1.0:1787119488.474337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.502889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.539226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.539710:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633269120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16941us (17702us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119488.539722:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9225 00002000:00100000:1.0:1787119488.539738:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (3424256->3489791) req@ffff92a62a124a80 x1873929633269120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.539750:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124a80 with x1873929633269120 ext(3424256->3489791) 00002000:00010000:1.0:1787119488.539756:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a124a80 00000100:00100000:1.0:1787119488.539779:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633269632 00000100:00100000:1.0:1787119488.539785:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633269632 00002000:00100000:1.0:1787119488.539815:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (23564288->23568383) req@ffff92a509136680 x1873929633269632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.539823:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136680 with x1873929633269632 ext(23564288->23568383) 00002000:00010000:1.0:1787119488.539826:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509136680 00000100:00100000:1.0:1787119488.539847:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9227 00000100:00100000:1.0:1787119488.539856:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633269632:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.540126:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633269632:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 271us (978us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.540133:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9227 00002000:00100000:1.0:1787119488.540139:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (23564288->23568383) req@ffff92a509136680 x1873929633269632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.540147:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136680 with x1873929633269632 ext(23564288->23568383) 00002000:00010000:1.0:1787119488.540150:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509136680 00000100:00100000:1.0:1787119488.540161:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633269760 00000100:00100000:1.0:1787119488.540165:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633269760 00002000:00100000:1.0:1787119488.540180:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (9179136->9248767) req@ffff92a62a126680 x1873929633269760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.540187:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126680 with x1873929633269760 ext(9179136->9248767) 00002000:00010000:1.0:1787119488.540191:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126680 00000100:00100000:1.0:1787119488.540208:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9228 00000100:00100000:1.0:1787119488.540215:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633269760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.568056:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633270656 00000100:00100000:1.0:1787119488.568069:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633270656 00002000:00100000:1.0:1787119488.568116:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (3289088->3354623) req@ffff92a5098a0000 x1873929633270656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.568129:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0000 with x1873929633270656 ext(3289088->3354623) 00002000:00010000:1.0:1787119488.568135:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a0000 00000100:00100000:1.0:1787119488.568171:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9235 00000100:00100000:1.0:1787119488.568181:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633270656:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.572589:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9236 00000100:00100000:1.0:1787119488.572599:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633270784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.572836:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633270784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 238us (580us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.572844:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9236 00002000:00100000:1.0:1787119488.572850:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (28454912->28459007) req@ffff92a606154380 x1873929633270784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.572859:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154380 with x1873929633270784 ext(28454912->28459007) 00002000:00010000:1.0:1787119488.572861:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606154380 00000100:00100000:1.0:1787119488.575936:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633270656:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7747us (7956us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119488.575951:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9235 00002000:00100000:1.0:1787119488.575963:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (3289088->3354623) req@ffff92a5098a0000 x1873929633270656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.575974:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0000 with x1873929633270656 ext(3289088->3354623) 00002000:00010000:1.0:1787119488.575980:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a0000 00000001:00080000:1.0:1787119488.576784:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969035 is committed 00000100:00100000:1.0:1787119488.581304:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633271040 00000100:00100000:1.0:1787119488.581322:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633271040 00002000:00100000:1.0:1787119488.581381:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (28430336->28495871) req@ffff92a50512ea00 x1873929633271040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.581392:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ea00 with x1873929633271040 ext(28430336->28495871) 00002000:00010000:1.0:1787119488.581398:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ea00 00000100:00100000:1.0:1787119488.581527:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9238 00000100:00100000:1.0:1787119488.581538:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633271040:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.596708:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633271040:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15169us (18941us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119488.596721:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9238 00002000:00100000:1.0:1787119488.596736:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (28430336->28495871) req@ffff92a50512ea00 x1873929633271040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.596745:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ea00 with x1873929633271040 ext(28430336->28495871) 00002000:00010000:1.0:1787119488.596751:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ea00 00000100:00100000:1.0:1787119488.596776:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633271680 00000100:00100000:1.0:1787119488.596783:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633271680 00002000:00100000:1.0:1787119488.596818:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (3309568->58588948) req@ffff92a606157480 x1873929633271680/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 520/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.596832:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157480 with x1873929633271680 ext(3309568->58588948) 00002000:00010000:1.0:1787119488.596835:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606157480 00000100:00100000:1.0:1787119488.596859:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9241 00000100:00100000:1.0:1787119488.596868:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633271680:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119488.600834:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633271808 00000100:00100000:1.0:1787119488.600845:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633271808 00002000:00010000:1.0:1787119488.600882:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (11298734->18446744073709551615) 00002000:00100000:1.0:1787119488.600886:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512df80 with x1873929633271808 ext(11298734->18446744073709551615) 00002000:00010000:1.0:1787119488.600898:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512df80. 00000100:00100000:1.0:1787119488.600930:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9242 00000100:00100000:1.0:1787119488.600939:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633271808:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119488.601203:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 26311337 -> 11298734 00002000:00010000:1.0:1787119488.601207:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119486 -> 1787119487 00002000:00010000:1.0:1787119488.601209:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119488.601212:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119486 -> 1787119487 00002000:00010000:1.0:1787119488.601214:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1293 -> 1293 00000100:00100000:1.0:1787119488.601267:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633271808:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 328us (1095us total) trans 4294968811 rc 0/0 00000100:00100000:1.0:1787119488.601275:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9242 00002000:00010000:1.0:1787119488.601279:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (11298734->18446744073709551615) 00002000:00100000:1.0:1787119488.601282:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512df80 with x1873929633271808 ext(11298734->18446744073709551615) 00002000:00010000:1.0:1787119488.601287:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512df80. 00000100:00100000:1.0:1787119488.601309:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633272064 00000100:00100000:1.0:1787119488.601313:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633272064 00000100:00100000:1.0:1787119488.601341:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19410 00000100:00100000:1.0:1787119488.601348:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+79:32728:x1873929633272064:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119488.601389:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119488.601414:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2701 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715994 expref: 79 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.601431:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119488.601465:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119488.602901:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.602921:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.602933:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119488.602979:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976224 00000004:00010000:1.0:1787119488.603007:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000058b4f60 reply state 00000000ac025cd0 transno 4294976225 ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119488.603018:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119488.603120:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+81:32728:x1873929633272064:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1770us (2122us total) trans 4294976225 rc 0/0 00000100:00100000:1.0:1787119488.603129:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19410 00000020:00080000:1.0:1787119488.603134:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787119488.604984:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.604999:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.605007:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.605014:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a600030400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119488.605019:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.605027:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.605044:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119488.605047:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119488.605052:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.605059:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e279b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119488.608536:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633272320 00000100:00100000:1.0:1787119488.608546:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633272320 00000100:00100000:1.0:1787119488.608608:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19411 00000100:00100000:1.0:1787119488.608619:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+80:32724:x1873929633272320:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119488.608653:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119488.608675:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e27a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159cc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.609015:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e27a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.609030:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e27a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.609042:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e27a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119488.609069:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 11298734 00000004:00200000:1.0:1787119488.609073:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119488.609091:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e27a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.609124:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e27a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159cc expref: 82 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.609142:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e27a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159cc expref: 81 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.609150:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119488.609152:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119488.609155:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600031200, rc 0) 00000100:00100000:1.0:1787119488.609216:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+81:32724:x1873929633272320:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 598us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.609222:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19411 00000100:00100000:1.0:1787119488.642947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119488.643074:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e27b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.643088:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e27b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.643095:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e27b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.643217:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e561800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119488.643222:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e27b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.643229:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e27b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.643245:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119488.643248:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119488.643252:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e27b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.643258:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e27b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119488.644007:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 11298734 -> 56586156 00002000:00010000:1.0:1787119488.644012:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119488.644014:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119488.644016:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119488.644018:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1293 -> 1035 00000100:00100000:1.0:1787119488.644070:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633273216:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 3160us (3274us total) trans 4294968813 rc 0/0 00000100:00100000:1.0:1787119488.644080:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9247 00002000:00010000:1.0:1787119488.644085:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (56586156->18446744073709551615) 00002000:00100000:1.0:1787119488.644089:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2d80 with x1873929633273216 ext(56586156->18446744073709551615) 00002000:00010000:1.0:1787119488.644094:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a2d80. 00000100:00100000:1.0:1787119488.644192:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633273344 00000100:00100000:1.0:1787119488.644200:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633273344 00000100:00100000:1.0:1787119488.644234:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19413 00000100:00100000:1.0:1787119488.644243:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+82:32728:x1873929633273344:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119488.645018:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119488.645041:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e27b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.645126:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e27be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.645141:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e27be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.645153:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e27be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119488.645178:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 39334240 00000004:00200000:1.0:1787119488.645183:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119488.645202:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e27be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.645230:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e27b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159d3 expref: 84 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.645248:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e27be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159d3 expref: 83 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.645257:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119488.645260:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119488.645263:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e573600, rc 0) 00000100:00100000:1.0:1787119488.645314:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+83:32728:x1873929633273344:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1072us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.645322:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19413 00000100:00100000:1.0:1787119488.656401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.657651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.657748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.657791:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633273472 00000100:00100000:1.0:1787119488.657800:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633273472 00002000:00100000:1.0:1787119488.657847:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (12148736->12214271) req@ffff92a509135c00 x1873929633273472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.657859:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135c00 with x1873929633273472 ext(12148736->12214271) 00002000:00010000:1.0:1787119488.657865:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135c00 00000100:00100000:1.0:1787119488.657884:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633273600 00000100:00100000:1.0:1787119488.657887:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633273600 00002000:00100000:1.0:1787119488.657902:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (7462912->7467007) req@ffff92a509136a00 x1873929633273600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.657909:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136a00 with x1873929633273600 ext(7462912->7467007) 00002000:00010000:1.0:1787119488.657913:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136a00 00000100:00100000:1.0:1787119488.659999:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9249 00000100:00100000:1.0:1787119488.660019:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633273600:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.660236:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633273600:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 224us (2590us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.660244:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9249 00002000:00100000:1.0:1787119488.660253:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (7462912->7467007) req@ffff92a509136a00 x1873929633273600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.660271:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136a00 with x1873929633273600 ext(7462912->7467007) 00002000:00010000:1.0:1787119488.660277:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136a00 00000100:00100000:1.0:1787119488.660308:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633273728 00000100:00100000:1.0:1787119488.660314:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633273728 00000100:00100000:1.0:1787119488.660352:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19414 00000100:00100000:1.0:1787119488.660359:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+83:32724:x1873929633273728:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119488.660372:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119488.660393:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e27c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159da expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.660516:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e27cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.660530:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e27cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.660542:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e27cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119488.660567:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 56586156 00000004:00200000:1.0:1787119488.660572:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119488.660601:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e27cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.660627:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e27c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159da expref: 85 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.660643:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e27cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159da expref: 84 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.660652:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119488.660655:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119488.660658:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e573200, rc 0) 00000100:00100000:1.0:1787119488.660691:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+84:32724:x1873929633273728:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 332us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.660697:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19414 00000100:00100000:1.0:1787119488.682727:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633273984 00000100:00100000:1.0:1787119488.682736:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633273984 00002000:00100000:1.0:1787119488.682780:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (7467008->7471103) req@ffff92a5098a3480 x1873929633273984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.682791:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3480 with x1873929633273984 ext(7467008->7471103) 00002000:00010000:1.0:1787119488.682796:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a3480 00000100:00100000:1.0:1787119488.682814:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633274112 00000100:00100000:1.0:1787119488.682816:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633274112 00002000:00100000:1.0:1787119488.682829:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (52514816->52518911) req@ffff92a5098a3b80 x1873929633274112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.682837:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3b80 with x1873929633274112 ext(52514816->52518911) 00002000:00010000:1.0:1787119488.682840:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a3b80 00000100:00100000:1.0:1787119488.682855:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9251 00000100:00100000:1.0:1787119488.682862:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633273984:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.683084:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633273984:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 221us (532us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.683091:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9251 00002000:00100000:1.0:1787119488.683097:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (7467008->7471103) req@ffff92a5098a3480 x1873929633273984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.683106:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3480 with x1873929633273984 ext(7467008->7471103) 00002000:00010000:1.0:1787119488.683109:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a3480 00000100:00100000:1.0:1787119488.683124:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9252 00000100:00100000:1.0:1787119488.683129:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633274112:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.683208:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633274112:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 79us (602us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.683215:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9252 00002000:00100000:1.0:1787119488.683220:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (52514816->52518911) req@ffff92a5098a3b80 x1873929633274112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.683228:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3b80 with x1873929633274112 ext(52514816->52518911) 00002000:00010000:1.0:1787119488.683231:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a3b80 00000100:00100000:1.0:1787119488.687137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.687170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.722340:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633275008 00000100:00100000:1.0:1787119488.722351:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633275008 00002000:00100000:1.0:1787119488.722394:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (28430336->28495871) req@ffff92a606156300 x1873929633275008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.722405:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156300 with x1873929633275008 ext(28430336->28495871) 00002000:00010000:1.0:1787119488.722410:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156300 00000100:00100000:1.0:1787119488.722432:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9259 00000100:00100000:1.0:1787119488.722466:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633275008:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.724768:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633272448:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 115780us (116334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.724781:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4982 00000100:00100000:1.0:1787119488.730344:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633275008:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7889us (8060us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119488.730359:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9259 00002000:00100000:1.0:1787119488.730372:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (28430336->28495871) req@ffff92a606156300 x1873929633275008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.730382:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156300 with x1873929633275008 ext(28430336->28495871) 00002000:00010000:1.0:1787119488.730389:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156300 00000100:00100000:1.0:1787119488.736403:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633275648 00000100:00100000:1.0:1787119488.736408:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633275648 00002000:00100000:1.0:1787119488.736431:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (29077504->29081599) req@ffff92a634965180 x1873929633275648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.736478:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965180 with x1873929633275648 ext(29077504->29081599) 00002000:00010000:1.0:1787119488.736482:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634965180 00000100:00100000:1.0:1787119488.736514:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9261 00000100:00100000:1.0:1787119488.736522:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633275648:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.736671:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633275648:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 149us (332us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.736678:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9261 00002000:00100000:1.0:1787119488.736684:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (29077504->29081599) req@ffff92a634965180 x1873929633275648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.736692:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965180 with x1873929633275648 ext(29077504->29081599) 00002000:00010000:1.0:1787119488.736695:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634965180 00000100:00100000:1.0:1787119488.748178:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9263 00000100:00100000:1.0:1787119488.748187:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633275776:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.753866:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633275776:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5667us (6056us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.753881:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9263 00002000:00100000:1.0:1787119488.753896:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (29081600->29085695) req@ffff92a5098a1c00 x1873929633275776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.753905:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1c00 with x1873929633275776 ext(29081600->29085695) 00002000:00010000:1.0:1787119488.753911:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a1c00 00000100:00100000:2.0:1787119488.757837:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+87:32729:x1873929633276032:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 8052us (9993us total) trans 4294976231 rc 0/0 00000100:00100000:2.0:1787119488.757851:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19416 00000020:00080000:2.0:1787119488.757858:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119488.759139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119488.759267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119488.762193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.762624:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633276288 00000100:00100000:1.0:1787119488.762629:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633276288 00002000:00100000:1.0:1787119488.762650:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (3424256->3489791) req@ffff92a519d27800 x1873929633276288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.762658:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27800 with x1873929633276288 ext(3424256->3489791) 00002000:00010000:1.0:1787119488.762662:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27800 00000100:00100000:1.0:1787119488.762687:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9264 00000100:00100000:1.0:1787119488.762696:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633276160:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.762962:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9265 00000100:00100000:1.0:1787119488.762970:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633276288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119488.763236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119488.766287:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e27da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.766300:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e27da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.766311:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e27da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.766317:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119488.766322:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e27da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.766328:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e27da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.766343:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119488.766346:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119488.766351:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e27da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119488.766357:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e27da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119488.766407:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (6431679->18446744073709551615) 00002000:00100000:1.0:1787119488.766411:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25180 with x1873929633276416 ext(6431679->18446744073709551615) 00002000:00010000:1.0:1787119488.766419:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d25180. 00000100:00100000:1.0:1787119488.766461:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633276544 00000100:00100000:1.0:1787119488.766465:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633276544 00002000:00100000:1.0:1787119488.766484:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (29057024->29122559) req@ffff92a519d24380 x1873929633276544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.766502:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24380 with x1873929633276544 ext(29057024->29122559) 00002000:00010000:1.0:1787119488.766506:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d24380 00000100:00100000:1.0:1787119488.766518:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633276672 00000100:00100000:1.0:1787119488.766521:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633276672 00002000:00010000:1.0:1787119488.766532:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (39334240->18446744073709551615) 00002000:00100000:1.0:1787119488.766535:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965c00 with x1873929633276672 ext(39334240->18446744073709551615) 00002000:00010000:1.0:1787119488.766540:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634965c00. 00000100:00100000:1.0:1787119488.766553:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9267 00000100:00100000:1.0:1787119488.766558:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633276544:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.767007:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9268 00000100:00100000:1.0:1787119488.767016:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633276672:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119488.767223:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 42456425 -> 39334240 00002000:00010000:1.0:1787119488.767227:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119486 -> 1787119487 00002000:00010000:1.0:1787119488.767231:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119486 -> 1787119486 00002000:00010000:1.0:1787119488.767233:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119486 -> 1787119487 00002000:00010000:1.0:1787119488.767236:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1293 -> 907 00000100:00100000:1.0:1787119488.768405:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633276672:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1385us (2118us total) trans 4294969037 rc 0/0 00000100:00100000:1.0:1787119488.768416:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9268 00002000:00010000:1.0:1787119488.768420:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (39334240->18446744073709551615) 00002000:00100000:1.0:1787119488.768423:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965c00 with x1873929633276672 ext(39334240->18446744073709551615) 00002000:00010000:1.0:1787119488.768429:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634965c00. 00000100:00100000:1.0:1787119488.780738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.780891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.787704:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633277056 00000100:00100000:1.0:1787119488.787719:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633277056 00002000:00100000:1.0:1787119488.787793:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (3489792->3526655) req@ffff92a634966680 x1873929633277056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.787813:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966680 with x1873929633277056 ext(3489792->3526655) 00002000:00010000:1.0:1787119488.787819:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966680 00000100:00100000:1.0:1787119488.787857:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9269 00000100:00100000:1.0:1787119488.787866:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633277056:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119488.788591:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633276800 00000100:00100000:2.0:1787119488.788597:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633276800 00000100:00100000:2.0:1787119488.788642:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633276928 00000100:00100000:2.0:1787119488.788645:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633276928 00000100:00100000:2.0:1787119488.788668:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19417 00000100:00100000:2.0:1787119488.788676:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+87:32720:x1873929633276800:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119488.788694:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119488.788713:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e27e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159e1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119488.789712:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e27ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119488.789740:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e27ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119488.789877:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e27ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119488.790061:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 6431679 00000004:00200000:2.0:1787119488.790066:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119488.790111:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e27ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119488.790500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.790534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119488.797896:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e27e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159e1 expref: 89 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119488.798075:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e27ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159e1 expref: 88 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119488.798086:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119488.798089:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119488.798092:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e561000, rc 0) 00000100:00100000:2.0:1787119488.798146:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+88:32720:x1873929633276800:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 9469us (17418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119488.798154:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19417 00000100:00100000:1.0:1787119488.798296:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633277056:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10430us (13093us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119488.798308:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9269 00002000:00100000:1.0:1787119488.798317:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (3489792->3526655) req@ffff92a634966680 x1873929633277056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.798326:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966680 with x1873929633277056 ext(3489792->3526655) 00002000:00010000:1.0:1787119488.798331:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966680 00000100:00100000:1.0:1787119488.806012:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633277440 00000100:00100000:1.0:1787119488.806023:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633277440 00002000:00100000:1.0:1787119488.806072:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (7462912->7467007) req@ffff92a634966a00 x1873929633277440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.806082:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966a00 with x1873929633277440 ext(7462912->7467007) 00002000:00010000:1.0:1787119488.806088:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966a00 00000100:00100000:1.0:1787119488.806123:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9272 00000100:00100000:1.0:1787119488.806133:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633277440:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.806375:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633277440:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 242us (449us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.806385:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9272 00002000:00100000:1.0:1787119488.806392:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (7462912->7467007) req@ffff92a634966a00 x1873929633277440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.806400:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966a00 with x1873929633277440 ext(7462912->7467007) 00002000:00010000:1.0:1787119488.806403:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966a00 00000100:00100000:2.0:1787119488.811206:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633277568 00000100:00100000:2.0:1787119488.811225:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633277568 00002000:00100000:2.0:1787119488.811288:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (41295872->41299967) req@ffff92a50512ed80 x1873929633277568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.811298:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ed80 with x1873929633277568 ext(41295872->41299967) 00002000:00010000:2.0:1787119488.811303:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512ed80 00000100:00100000:2.0:1787119488.811332:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9273 00000100:00100000:2.0:1787119488.811341:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633277568:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119488.811652:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633277568:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 310us (3628us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119488.811660:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9273 00002000:00100000:2.0:1787119488.811667:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (41295872->41299967) req@ffff92a50512ed80 x1873929633277568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.811681:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ed80 with x1873929633277568 ext(41295872->41299967) 00002000:00010000:2.0:1787119488.811684:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512ed80 00000100:00100000:1.0:1787119488.812111:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633277696 00000100:00100000:1.0:1787119488.812116:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633277696 00002000:00100000:1.0:1787119488.812142:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (3313664->3317759) req@ffff92a50512d500 x1873929633277696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.812151:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633277696 ext(3313664->3317759) 00002000:00010000:1.0:1787119488.812154:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d500 00000100:00100000:1.0:1787119488.812182:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9274 00000100:00100000:1.0:1787119488.812189:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633277696:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.812337:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633277696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 148us (384us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.812344:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9274 00002000:00100000:1.0:1787119488.812349:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (3313664->3317759) req@ffff92a50512d500 x1873929633277696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.812356:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633277696 ext(3313664->3317759) 00002000:00010000:1.0:1787119488.812359:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d500 00000100:00100000:2.0:1787119488.816352:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633278080 00000100:00100000:2.0:1787119488.816363:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633278080 00002000:00100000:2.0:1787119488.816417:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (3289088->3354623) req@ffff92a50512c380 x1873929633278080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.816429:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c380 with x1873929633278080 ext(3289088->3354623) 00002000:00010000:2.0:1787119488.816435:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512c380 00000100:00100000:1.0:1787119488.823312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.823554:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119488.824549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119488.836376:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633277952 00000100:00100000:2.0:1787119488.836396:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633277952 00000100:00100000:2.0:1787119488.845421:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633278592 00000100:00100000:2.0:1787119488.845434:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633278592 00002000:00100000:2.0:1787119488.845530:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (44093440->44146687) req@ffff92a506154380 x1873929633278592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.845549:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154380 with x1873929633278592 ext(44093440->44146687) 00002000:00010000:2.0:1787119488.845556:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506154380 00000100:00100000:2.0:1787119488.845591:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9279 00000100:00100000:2.0:1787119488.845602:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633278592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.850110:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9280 00000100:00100000:1.0:1787119488.850127:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633278720:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119488.868815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119488.874867:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633278848 00000100:00100000:2.0:1787119488.874880:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633278848 00002000:00010000:1.0:1787119488.875102:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (26311337->18446744073709551615) 00002000:00100000:1.0:1787119488.875108:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155500 with x1873929633278848 ext(26311337->18446744073709551615) 00002000:00010000:1.0:1787119488.875120:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155500. 00000100:00100000:1.0:1787119488.875162:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633279104 00000100:00100000:1.0:1787119488.875166:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633279104 00002000:00100000:1.0:1787119488.875193:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (58482688->58486783) req@ffff92a519d19c00 x1873929633279104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.875203:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19c00 with x1873929633279104 ext(58482688->58486783) 00002000:00010000:1.0:1787119488.875207:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19c00 00000100:00100000:1.0:1787119488.875226:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9282 00000100:00100000:1.0:1787119488.875234:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633278848:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119488.875498:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 6431679 -> 26311337 00002000:00010000:1.0:1787119488.875502:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119488.875505:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119488.875507:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119488.875509:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1293 -> 1293 00000100:00100000:1.0:1787119488.875587:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633278848:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 341us (9903us total) trans 4294968815 rc 0/0 00000100:00100000:1.0:1787119488.875595:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9282 00002000:00010000:1.0:1787119488.875599:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (26311337->18446744073709551615) 00002000:00100000:1.0:1787119488.875601:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155500 with x1873929633278848 ext(26311337->18446744073709551615) 00002000:00010000:1.0:1787119488.875606:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155500. 00000100:00100000:1.0:1787119488.875625:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9283 00000100:00100000:1.0:1787119488.875632:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633279104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.876791:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633279104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1151us (7978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119488.876801:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9283 00002000:00100000:1.0:1787119488.876810:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (58482688->58486783) req@ffff92a519d19c00 x1873929633279104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.876819:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19c00 with x1873929633279104 ext(58482688->58486783) 00002000:00010000:1.0:1787119488.876824:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19c00 00000100:00100000:2.0:1787119488.891866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119488.892779:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633279488 00000100:00100000:2.0:1787119488.892784:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633279488 00000100:00100000:1.0:1787119488.906388:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4983 00000100:00100000:1.0:1787119488.906397:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633279744:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119488.923750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119488.923963:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633280000 00000100:00100000:3.0:1787119488.923975:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633280000 00002000:00100000:3.0:1787119488.924017:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (39829504->39833599) req@ffff92a506155880 x1873929633280000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.924027:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155880 with x1873929633280000 ext(39829504->39833599) 00002000:00010000:3.0:1787119488.924032:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155880 00000100:00100000:3.0:1787119488.924057:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9288 00000100:00100000:3.0:1787119488.924065:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633280000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119488.924268:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633280000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 203us (3788us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119488.924276:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9288 00002000:00100000:3.0:1787119488.924283:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (39829504->39833599) req@ffff92a506155880 x1873929633280000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.924292:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155880 with x1873929633280000 ext(39829504->39833599) 00002000:00010000:3.0:1787119488.924295:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155880 00000100:00100000:1.0:1787119488.930107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119488.934282:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633280128 00000100:00100000:3.0:1787119488.934300:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633280128 00002000:00100000:3.0:1787119488.934355:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (7548928->7553023) req@ffff92a519d1aa00 x1873929633280128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.934366:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1aa00 with x1873929633280128 ext(7548928->7553023) 00002000:00010000:3.0:1787119488.934372:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1aa00 00000100:00100000:3.0:1787119488.934402:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9289 00000100:00100000:3.0:1787119488.934415:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633280128:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119488.935004:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633280128:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 590us (4905us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119488.935013:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9289 00002000:00100000:3.0:1787119488.935020:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (7548928->7553023) req@ffff92a519d1aa00 x1873929633280128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.935029:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1aa00 with x1873929633280128 ext(7548928->7553023) 00002000:00010000:3.0:1787119488.935032:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1aa00 00000100:00100000:2.0:1787119488.939088:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633279872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16852us (18724us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1787119488.939107:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9287 00002000:00100000:2.0:1787119488.939121:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (9179136->9248767) req@ffff92a506156a00 x1873929633279872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.939132:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156a00 with x1873929633279872 ext(9179136->9248767) 00002000:00010000:2.0:1787119488.939139:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156a00 00000100:00100000:3.0:1787119488.940337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119488.944589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119488.944800:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633280256 00000100:00100000:2.0:1787119488.944811:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633280256 00002000:00100000:2.0:1787119488.944866:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (39804928->39870463) req@ffff92a506155180 x1873929633280256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.944878:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155180 with x1873929633280256 ext(39804928->39870463) 00002000:00010000:2.0:1787119488.944884:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155180 00000100:00100000:2.0:1787119488.944916:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633280384 00000100:00100000:2.0:1787119488.944919:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633280384 00002000:00100000:2.0:1787119488.944936:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (7553024->7557119) req@ffff92a506157480 x1873929633280384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.944944:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157480 with x1873929633280384 ext(7553024->7557119) 00002000:00010000:2.0:1787119488.944948:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506157480 00000100:00100000:2.0:1787119488.944983:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9290 00000100:00100000:2.0:1787119488.944993:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633280256:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119488.945739:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9291 00000100:00100000:2.0:1787119488.945752:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633280384:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119488.947266:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633280384:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1509us (2688us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119488.947282:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9291 00002000:00100000:2.0:1787119488.947292:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (7553024->7557119) req@ffff92a506157480 x1873929633280384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.947303:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157480 with x1873929633280384 ext(7553024->7557119) 00002000:00010000:2.0:1787119488.947308:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506157480 00000100:00100000:3.0:1787119488.959336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119488.962761:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633280512 00000100:00100000:2.0:1787119488.962779:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633280512 00002000:00100000:2.0:1787119488.962838:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (16646144->16695295) req@ffff92a506154000 x1873929633280512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.962847:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154000 with x1873929633280512 ext(16646144->16695295) 00002000:00010000:2.0:1787119488.962852:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154000 00000100:00100000:2.0:1787119488.962877:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9292 00000100:00100000:2.0:1787119488.962884:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633280512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119488.974228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119488.974338:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633280640 00000100:00100000:3.0:1787119488.974348:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633280640 00002000:00100000:3.0:1787119488.974392:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (28450816->28454911) req@ffff92a506156300 x1873929633280640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.974405:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156300 with x1873929633280640 ext(28450816->28454911) 00002000:00010000:3.0:1787119488.974411:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156300 00000100:00100000:3.0:1787119488.974463:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9293 00000100:00100000:3.0:1787119488.974474:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633280640:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119488.974720:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633280640:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 247us (502us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119488.974728:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9293 00002000:00100000:3.0:1787119488.974735:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (28450816->28454911) req@ffff92a506156300 x1873929633280640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.974744:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156300 with x1873929633280640 ext(28450816->28454911) 00002000:00010000:3.0:1787119488.974963:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156300 00000100:00100000:2.0:1787119488.977098:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633280256:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 32095us (36756us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119488.977114:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9290 00002000:00100000:2.0:1787119488.977126:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (39804928->39870463) req@ffff92a506155180 x1873929633280256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.977138:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155180 with x1873929633280256 ext(39804928->39870463) 00002000:00010000:2.0:1787119488.977144:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155180 00000100:00100000:2.0:1787119488.977217:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633280512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14332us (17893us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1787119488.977224:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9292 00002000:00100000:2.0:1787119488.977230:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (16646144->16695295) req@ffff92a506154000 x1873929633280512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/440 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119488.977238:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154000 with x1873929633280512 ext(16646144->16695295) 00002000:00010000:2.0:1787119488.977241:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154000 00000100:00100000:3.0:1787119488.982382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119488.982483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119488.982544:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633280768 00000100:00100000:3.0:1787119488.982555:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633280768 00002000:00100000:3.0:1787119488.982616:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (11825152->11829247) req@ffff92a506156680 x1873929633280768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.982627:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156680 with x1873929633280768 ext(11825152->11829247) 00002000:00010000:3.0:1787119488.982632:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506156680 00000100:00100000:3.0:1787119488.982661:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633280896 00000100:00100000:3.0:1787119488.982665:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633280896 00002000:00100000:3.0:1787119488.982682:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (28454912->28459007) req@ffff92a506155c00 x1873929633280896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.982690:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155c00 with x1873929633280896 ext(28454912->28459007) 00002000:00010000:3.0:1787119488.982694:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155c00 00000100:00100000:3.0:1787119488.982713:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9294 00000100:00100000:3.0:1787119488.982722:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633280768:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119488.988667:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633280768:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5934us (6286us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119488.988680:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9294 00002000:00100000:3.0:1787119488.988692:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (11825152->11829247) req@ffff92a506156680 x1873929633280768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.988703:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156680 with x1873929633280768 ext(11825152->11829247) 00002000:00010000:3.0:1787119488.988709:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506156680 00000100:00100000:3.0:1787119488.996550:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633281024 00000100:00100000:3.0:1787119488.996561:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633281024 00000100:00100000:1.0:1787119488.996612:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633281152 00000100:00100000:1.0:1787119488.996618:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633281152 00002000:00100000:3.0:1787119488.996623:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (28430336->28495871) req@ffff92a634965500 x1873929633281024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 504/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119488.996635:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965500 with x1873929633281024 ext(28430336->28495871) 00002000:00010000:3.0:1787119488.996642:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634965500 00002000:00100000:1.0:1787119488.996644:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (3309568->3313663) req@ffff92a634966d80 x1873929633281152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/0 e 0 to 0 dl 1787119499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.996656:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966d80 with x1873929633281152 ext(3309568->3313663) 00002000:00010000:1.0:1787119488.996660:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966d80 00000100:00100000:3.0:1787119488.996681:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9296 00000100:00100000:1.0:1787119488.996690:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9297 00000100:00100000:3.0:1787119488.996696:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633281024:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.996715:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633281152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119488.996953:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633281152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 243us (424us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119488.996968:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9297 00002000:00100000:1.0:1787119488.996974:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (3309568->3313663) req@ffff92a634966d80 x1873929633281152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787119499 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119488.996980:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966d80 with x1873929633281152 ext(3309568->3313663) 00002000:00010000:1.0:1787119488.996982:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966d80 00000100:00100000:2.0:1787119489.005512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.005549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.005607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.005636:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633281408 00000100:00100000:2.0:1787119489.005644:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633281408 00002000:00100000:2.0:1787119489.005699:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (7548928->41365503) req@ffff92a519d25500 x1873929633281408/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.005709:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25500 with x1873929633281408 ext(7548928->41365503) 00002000:00010000:2.0:1787119489.005714:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d25500 00000100:00100000:2.0:1787119489.005734:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633281280 00000100:00100000:2.0:1787119489.005738:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633281280 00002000:00100000:2.0:1787119489.005760:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (11829248->11833343) req@ffff92a519d24e00 x1873929633281280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.005768:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24e00 with x1873929633281280 ext(11829248->11833343) 00002000:00010000:2.0:1787119489.005771:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d24e00 00000100:00100000:2.0:1787119489.005785:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633281536 00000100:00100000:2.0:1787119489.005787:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633281536 00002000:00100000:2.0:1787119489.005804:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (3313664->3317759) req@ffff92a519d27480 x1873929633281536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.005812:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27480 with x1873929633281536 ext(3313664->3317759) 00002000:00010000:2.0:1787119489.005815:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27480 00000100:00100000:2.0:1787119489.005832:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9298 00000100:00100000:2.0:1787119489.005842:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633281408:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119489.006059:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9299 00000100:00100000:2.0:1787119489.006067:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633281280:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.006208:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633281280:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 142us (659us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.006213:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9299 00002000:00100000:2.0:1787119489.006217:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (11829248->11833343) req@ffff92a519d24e00 x1873929633281280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.006222:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24e00 with x1873929633281280 ext(11829248->11833343) 00002000:00010000:2.0:1787119489.006225:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d24e00 00000100:00100000:2.0:1787119489.006237:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9300 00000100:00100000:2.0:1787119489.006241:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633281536:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.006309:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633281536:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 67us (703us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.006313:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9300 00002000:00100000:2.0:1787119489.006317:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (3313664->3317759) req@ffff92a519d27480 x1873929633281536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.006323:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27480 with x1873929633281536 ext(3313664->3317759) 00002000:00010000:2.0:1787119489.006325:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27480 00000100:00080000:2.0:1787119489.006338:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787119489.006341:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787119489.024205:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633281664 00000100:00100000:2.0:1787119489.024216:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633281664 00002000:00100000:2.0:1787119489.024265:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (11804672->11870207) req@ffff92a634966300 x1873929633281664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.024278:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966300 with x1873929633281664 ext(11804672->11870207) 00002000:00010000:2.0:1787119489.024284:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634966300 00000100:00100000:2.0:1787119489.024317:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9301 00000100:00100000:2.0:1787119489.024327:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633281664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.025835:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633281408:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 19992us (20331us total) trans 4294968816 rc 0/0 00000100:00100000:2.0:1787119489.025845:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9298 00002000:00100000:2.0:1787119489.025988:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (7548928->41365503) req@ffff92a519d25500 x1873929633281408/t4294968816(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/456 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.025999:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25500 with x1873929633281408 ext(7548928->41365503) 00002000:00010000:2.0:1787119489.026004:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d25500 00000100:00080000:2.0:1787119489.026029:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119489.030088:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633281664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5752us (5939us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119489.030106:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9301 00002000:00100000:2.0:1787119489.030118:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (11804672->11870207) req@ffff92a634966300 x1873929633281664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.030129:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966300 with x1873929633281664 ext(11804672->11870207) 00002000:00010000:2.0:1787119489.030136:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634966300 00010000:00010000:1.0:1787119489.030352:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.030359:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119489.030369:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2812 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.030378:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2812 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.030385:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045f800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119489.030389:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2812 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.030397:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2812 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.030415:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119489.030418:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119489.030423:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2812 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.030429:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2812 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.030547:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633282176 00000100:00100000:3.0:1787119489.030556:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633282176 00000100:00100000:3.0:1787119489.030605:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4984 00000100:00100000:3.0:1787119489.030617:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633282176:12345-192.168.201.59@tcp:16:fsx.0 00000001:00080000:1.0:1787119489.039066:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969036 is committed 00000100:00100000:1.0:1787119489.039396:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633282304 00000100:00100000:1.0:1787119489.039404:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633282304 00002000:00010000:1.0:1787119489.039432:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (39334240->18446744073709551615) 00002000:00100000:1.0:1787119489.039457:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b100 with x1873929633282304 ext(39334240->18446744073709551615) 00002000:00010000:1.0:1787119489.039468:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b100. 00000100:00100000:1.0:1787119489.039499:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633282432 00000100:00100000:1.0:1787119489.039502:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633282432 00002000:00100000:1.0:1787119489.039524:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (3309568->58588948) req@ffff92a606158000 x1873929633282432/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.039535:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158000 with x1873929633282432 ext(3309568->58588948) 00002000:00010000:1.0:1787119489.039540:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158000 00000100:00100000:1.0:1787119489.039558:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633282560 00000100:00100000:1.0:1787119489.039561:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633282560 00002000:00100000:1.0:1787119489.039698:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (23564288->23568383) req@ffff92a606158380 x1873929633282560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.039707:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158380 with x1873929633282560 ext(23564288->23568383) 00002000:00010000:1.0:1787119489.039710:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158380 00000100:00100000:1.0:1787119489.039725:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9304 00000100:00100000:1.0:1787119489.039731:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633282432:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119489.039806:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9305 00000100:00100000:2.0:1787119489.039819:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633282560:12345-192.168.201.59@tcp:3:fsx.0 00000001:00080000:1.0:1787119489.039890:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969037 is committed 00000001:00080000:1.0:1787119489.039899:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969038 is committed 00000100:00100000:1.0:1787119489.039957:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633279744:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 133560us (147214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.039965:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4983 00000100:00100000:2.0:1787119489.040568:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633282560:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 750us (1483us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.040779:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9305 00002000:00100000:2.0:1787119489.040788:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (23564288->23568383) req@ffff92a606158380 x1873929633282560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.040797:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158380 with x1873929633282560 ext(23564288->23568383) 00002000:00010000:2.0:1787119489.040801:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158380 00000100:00100000:2.0:1787119489.046263:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633282688 00000100:00100000:2.0:1787119489.046274:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633282688 00002000:00100000:2.0:1787119489.046322:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (23568384->23572479) req@ffff92a606158700 x1873929633282688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.046334:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158700 with x1873929633282688 ext(23568384->23572479) 00002000:00010000:2.0:1787119489.046340:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158700 00000100:00100000:2.0:1787119489.046372:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9306 00000100:00100000:2.0:1787119489.046384:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633282688:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.046647:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633282688:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 265us (498us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.046656:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9306 00002000:00100000:2.0:1787119489.046664:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (23568384->23572479) req@ffff92a606158700 x1873929633282688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.046673:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158700 with x1873929633282688 ext(23568384->23572479) 00002000:00010000:2.0:1787119489.046677:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158700 00000100:00100000:1.0:1787119489.046942:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633282432:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 7209us (7877us total) trans 4294969040 rc 0/0 00000100:00100000:1.0:1787119489.046955:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9304 00002000:00100000:1.0:1787119489.046962:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (3309568->58588948) req@ffff92a606158000 x1873929633282432/t4294969040(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/456 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.046970:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158000 with x1873929633282432 ext(3309568->58588948) 00002000:00010000:1.0:1787119489.046974:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158000 00000100:00100000:3.0:1787119489.050977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.058408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.058460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.058493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.058748:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633282816 00000100:00100000:1.0:1787119489.058868:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633282816 00000100:00100000:1.0:1787119489.058918:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633283072 00000100:00100000:1.0:1787119489.058921:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633283072 00000100:00100000:1.0:1787119489.058956:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19422 00000100:00100000:3.0:1787119489.058964:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19423 00000100:00100000:1.0:1787119489.058966:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+92:32727:x1873929633282816:12345-192.168.201.59@tcp:101:fsx.0 00000100:00100000:3.0:1787119489.058972:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+92:32728:x1873929633283072:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119489.058992:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119489.059013:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2819 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159f6 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.059023:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119489.059046:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e27be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159d3 expref: 93 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.059063:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119489.059068:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119489.059081:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572a00/0xcaba3de8463e2820 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.059093:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572a00/0xcaba3de8463e2820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.059102:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572a00/0xcaba3de8463e2820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119489.059119:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 39334240 00000004:00200000:1.0:1787119489.059123:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119489.059140:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572a00/0xcaba3de8463e2820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.059165:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159f6 expref: 93 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.059177:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572a00/0xcaba3de8463e2820 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159f6 expref: 92 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.059184:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119489.059186:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119489.059188:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e572a00, rc 0) 00010000:00010000:3.0:1787119489.059250:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.059253:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+93:32727:x1873929633282816:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 288us (8286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.059259:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19422 00010000:00010000:3.0:1787119489.059263:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.059269:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.059285:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633283328 00000100:00100000:1.0:1787119489.059288:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633283328 00002000:00100000:1.0:1787119489.059313:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (23543808->23609343) req@ffff92a63dfbb800 x1873929633283328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000001:00080000:3.0:1787119489.059318:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976236 00002000:00100000:1.0:1787119489.059322:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb800 with x1873929633283328 ext(23543808->23609343) 00002000:00010000:1.0:1787119489.059326:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbb800 00000004:00010000:3.0:1787119489.059341:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca7b7724 reply state 000000005cd173ef transno 4294976237 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.059344:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9307 00000100:00100000:3.0:1787119489.059350:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119489.059350:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633283328:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.059388:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+94:32728:x1873929633283072:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 417us (988us total) trans 4294976237 rc 0/0 00000100:00100000:3.0:1787119489.059394:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19423 00000020:00080000:3.0:1787119489.059397:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119489.060504:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633283200 00000100:00100000:3.0:1787119489.060514:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633283200 00000100:00100000:3.0:1787119489.060564:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4985 00000100:00100000:3.0:1787119489.060584:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633283200:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119489.064290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.064318:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633283456 00000100:00100000:3.0:1787119489.064328:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633283456 00002000:00100000:3.0:1787119489.064371:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (7462912->7467007) req@ffff92a519d19f80 x1873929633283456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.064382:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19f80 with x1873929633283456 ext(7462912->7467007) 00002000:00010000:3.0:1787119489.064387:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19f80 00000100:00100000:3.0:1787119489.064421:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9308 00000100:00100000:3.0:1787119489.064431:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633283456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.064692:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633283456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 262us (411us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.064700:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9308 00002000:00100000:3.0:1787119489.064707:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (7462912->7467007) req@ffff92a519d19f80 x1873929633283456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.064714:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19f80 with x1873929633283456 ext(7462912->7467007) 00002000:00010000:3.0:1787119489.064718:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19f80 00010000:00010000:3.0:1787119489.064743:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.064753:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.064759:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.064766:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.064771:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.064778:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.064793:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119489.064796:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.064800:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.064806:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2827 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.069985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.070187:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633283584 00000100:00100000:3.0:1787119489.070196:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633283584 00002000:00010000:3.0:1787119489.070228:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (6431679->18446744073709551615) 00002000:00100000:3.0:1787119489.070233:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26300 with x1873929633283584 ext(6431679->18446744073709551615) 00002000:00010000:3.0:1787119489.070245:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d26300. 00000100:00100000:1.0:1787119489.070249:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633283328:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10898us (11754us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.070258:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9307 00002000:00100000:1.0:1787119489.070268:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (23543808->23609343) req@ffff92a63dfbb800 x1873929633283328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119489.070271:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9309 00002000:00100000:1.0:1787119489.070279:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb800 with x1873929633283328 ext(23543808->23609343) 00000100:00100000:3.0:1787119489.070280:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633283584:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119489.070283:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbb800 00002000:00010000:3.0:1787119489.071121:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 39334240 -> 6431679 00002000:00010000:3.0:1787119489.071127:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:3.0:1787119489.071130:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119486 -> 1787119487 00002000:00010000:3.0:1787119489.071132:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:3.0:1787119489.071134:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 907 -> 1293 00000100:00100000:3.0:1787119489.071177:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633283584:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 896us (1201us total) trans 4294969041 rc 0/0 00000100:00100000:3.0:1787119489.071184:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9309 00002000:00010000:3.0:1787119489.071188:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (6431679->18446744073709551615) 00002000:00100000:3.0:1787119489.071190:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26300 with x1873929633283584 ext(6431679->18446744073709551615) 00002000:00010000:3.0:1787119489.071196:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d26300. 00000100:00100000:3.0:1787119489.075618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.075658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.089559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.089771:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633284096 00000100:00100000:3.0:1787119489.089781:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633284096 00000100:00100000:3.0:1787119489.089838:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19425 00000100:00100000:3.0:1787119489.089848:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+94:32728:x1873929633284096:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.089870:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.089892:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2835 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047159fd expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.089972:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e283c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.089987:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e283c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.089998:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e283c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119489.090028:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 6431679 00000004:00200000:3.0:1787119489.090034:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.090055:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e283c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.090081:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2835 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159fd expref: 96 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.090101:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e283c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159fd expref: 95 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.090110:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119489.090113:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.090116:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:3.0:1787119489.090174:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+95:32728:x1873929633284096:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 328us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.090181:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19425 00000100:00100000:3.0:1787119489.100943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.103961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.123972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.124019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.124056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.124084:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633284608 00000100:00100000:3.0:1787119489.124093:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633284608 00000100:00100000:3.0:1787119489.124135:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633284864 00000100:00100000:3.0:1787119489.124138:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633284864 00000100:00100000:3.0:1787119489.124157:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19426 00000100:00100000:3.0:1787119489.124163:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+96:32728:x1873929633284608:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.124210:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119489.124328:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e283c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159fd expref: 96 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.124343:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119489.124347:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119489.124533:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2843 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.124547:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.124556:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119489.124673:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976240 00000004:00010000:3.0:1787119489.124694:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd0f3d18 reply state 0000000060cedcdf transno 4294976241 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.124704:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119489.124773:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+98:32728:x1873929633284608:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 609us (810us total) trans 4294976241 rc 0/0 00000100:00100000:3.0:1787119489.124781:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19426 00000020:00080000:3.0:1787119489.124786:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119489.124801:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19427 00000100:00100000:3.0:1787119489.124809:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+97:32720:x1873929633284864:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.124818:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.124828:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e284a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a04 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.124868:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.124874:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.124879:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119489.124890:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 11298734 00000004:00200000:3.0:1787119489.124893:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.124902:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.124915:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e284a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a04 expref: 99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.124923:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a04 expref: 98 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.124928:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119489.124930:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.124933:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119489.124952:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+98:32720:x1873929633284864:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 144us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.124957:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19427 00000100:00100000:2.0:1787119489.125468:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633284736 00000100:00100000:2.0:1787119489.125476:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633284736 00002000:00100000:2.0:1787119489.125512:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (58503168->58507263) req@ffff92a63dfb9f80 x1873929633284736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.125522:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633284736 ext(58503168->58507263) 00002000:00010000:2.0:1787119489.125526:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000100:00100000:2.0:1787119489.125545:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9313 00000100:00100000:2.0:1787119489.125553:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633284736:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.126644:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633284736:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1085us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.126654:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9313 00002000:00100000:2.0:1787119489.126662:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (58503168->58507263) req@ffff92a63dfb9f80 x1873929633284736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.126671:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633284736 ext(58503168->58507263) 00002000:00010000:2.0:1787119489.126675:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000001:00080000:2.0:1787119489.131058:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968814 is committed 00000001:00080000:2.0:1787119489.131077:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968815 is committed 00000001:00080000:2.0:1787119489.131085:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968816 is committed 00000100:00100000:3.0:1787119489.136191:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633282176:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 105561us (105819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.136209:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4984 00000100:00100000:1.0:1787119489.137097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.137133:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633284992 00000100:00100000:1.0:1787119489.137143:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633284992 00002000:00010000:1.0:1787119489.137186:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (26311337->18446744073709551615) 00002000:00100000:1.0:1787119489.137192:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19880 with x1873929633284992 ext(26311337->18446744073709551615) 00002000:00010000:1.0:1787119489.137205:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19880. 00000100:00100000:1.0:1787119489.137511:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9314 00000100:00100000:1.0:1787119489.137522:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633284992:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119489.137834:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6431679 -> 26311337 00002000:00010000:1.0:1787119489.137838:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.137841:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.137844:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.137846:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1293 -> 1293 00000100:00100000:1.0:1787119489.137894:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633284992:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 374us (803us total) trans 4294969042 rc 0/0 00000100:00100000:1.0:1787119489.137901:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9314 00002000:00010000:1.0:1787119489.137905:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (26311337->18446744073709551615) 00002000:00100000:1.0:1787119489.137907:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19880 with x1873929633284992 ext(26311337->18446744073709551615) 00002000:00010000:1.0:1787119489.137912:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19880. 00010000:00010000:0.0:1787119489.138043:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2843 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.138064:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119489.138067:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119489.138072:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2843 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.138079:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2843 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.142094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.142184:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633285120 00000100:00100000:1.0:1787119489.142195:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633285120 00000100:00100000:1.0:1787119489.142303:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19428 00000100:00100000:1.0:1787119489.142315:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+97:32728:x1873929633285120:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119489.142343:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119489.142367:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e2858 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a0b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.142493:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e285f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.142507:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e285f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.142517:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e285f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119489.142542:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 26311337 00000004:00200000:1.0:1787119489.142546:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119489.142564:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e285f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.142602:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e2858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a0b expref: 99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.142799:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e285f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a0b expref: 98 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.142809:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119489.142811:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119489.142815:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e572400, rc 0) 00000100:00100000:1.0:1787119489.142882:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+98:32728:x1873929633285120:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 571us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.142889:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19428 00000001:00080000:2.0:1787119489.143712:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969039 is committed 00000001:00080000:2.0:1787119489.143730:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969040 is committed 00000100:00100000:2.0:1787119489.144293:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633283200:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 83716us (85850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.144303:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4985 00000100:00100000:1.0:1787119489.151321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.151608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.152601:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633285248 00000100:00100000:0.0:1787119489.152615:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633285248 00002000:00100000:1.0:1787119489.152780:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (16646144->16695295) req@ffff92a519d1b480 x1873929633285248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.152792:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b480 with x1873929633285248 ext(16646144->16695295) 00002000:00010000:1.0:1787119489.152799:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b480 00000100:00100000:1.0:1787119489.152828:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633285376 00000100:00100000:1.0:1787119489.152832:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633285376 00002000:00100000:1.0:1787119489.152849:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (28184576->28188671) req@ffff92a519d1b800 x1873929633285376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.152857:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b800 with x1873929633285376 ext(28184576->28188671) 00002000:00010000:1.0:1787119489.152860:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1b800 00000100:00100000:1.0:1787119489.152887:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9315 00000100:00100000:1.0:1787119489.152896:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633285248:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.153323:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9316 00000100:00100000:2.0:1787119489.153332:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633285376:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.153503:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633285376:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 171us (1894us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.153511:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9316 00002000:00100000:2.0:1787119489.153518:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (28184576->28188671) req@ffff92a519d1b800 x1873929633285376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.153528:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b800 with x1873929633285376 ext(28184576->28188671) 00002000:00010000:2.0:1787119489.153531:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1b800 00000100:00100000:2.0:1787119489.159982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.160044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.160128:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.160173:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633285760 00000100:00100000:0.0:1787119489.160183:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633285760 00002000:00100000:0.0:1787119489.160228:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (7548928->7553023) req@ffff92a519d26a00 x1873929633285760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.160239:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26a00 with x1873929633285760 ext(7548928->7553023) 00002000:00010000:0.0:1787119489.160244:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d26a00 00000100:00100000:3.0:1787119489.160300:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633285632 00000100:00100000:3.0:1787119489.160305:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633285632 00000100:00100000:0.0:1787119489.160312:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9317 00000100:00100000:0.0:1787119489.160320:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633285760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.160334:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633286016 00000100:00100000:3.0:1787119489.160336:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633286016 00000100:00100000:3.0:1787119489.160354:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19429 00000100:00100000:3.0:1787119489.160360:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+99:32720:x1873929633285632:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.160401:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119489.160427:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a04 expref: 99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.160467:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119489.160473:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119489.160752:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633285248:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7856us (9443us total) trans 0 rc 49152/49152 00000100:00100000:1.0:1787119489.160760:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9315 00002000:00100000:1.0:1787119489.160767:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (16646144->16695295) req@ffff92a519d1b480 x1873929633285248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.160774:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b480 with x1873929633285248 ext(16646144->16695295) 00002000:00010000:1.0:1787119489.160778:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b480 00000100:00100000:0.0:1787119489.160835:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633285760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 515us (790us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.160842:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9317 00002000:00100000:0.0:1787119489.160848:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (7548928->7553023) req@ffff92a519d26a00 x1873929633285760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.160855:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26a00 with x1873929633285760 ext(7548928->7553023) 00002000:00010000:0.0:1787119489.160859:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d26a00 00010000:00010000:3.0:1787119489.160952:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.160962:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19430 00010000:00010000:3.0:1787119489.160967:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.160971:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+99:32729:x1873929633286016:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.160991:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.160993:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119489.161006:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e600/0xcaba3de8463e27f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159e8 expref: 99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.161018:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119489.161022:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:3.0:1787119489.161043:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976242 00000004:00010000:3.0:1787119489.161071:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d2705a7 reply state 00000000b81159d7 transno 4294976243 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.161080:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787119489.161102:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.161111:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.161117:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.161128:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+101:32720:x1873929633285632:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 768us (1157us total) trans 4294976243 rc 0/0 00000100:00100000:3.0:1787119489.161134:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19429 00000020:00080000:3.0:1787119489.161137:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1787119489.161155:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976244 00000004:00010000:2.0:1787119489.161174:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cec1177 reply state 00000000956c76ee transno 4294976245 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.161181:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119489.161216:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+102:32729:x1873929633286016:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 247us (1088us total) trans 4294976245 rc 0/0 00000100:00100000:2.0:1787119489.161222:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19430 00000020:00080000:2.0:1787119489.161225:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119489.164724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.164892:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633286144 00000100:00100000:2.0:1787119489.164902:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633286144 00002000:00100000:2.0:1787119489.164951:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (28188672->28192767) req@ffff92a606158e00 x1873929633286144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.164962:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158e00 with x1873929633286144 ext(28188672->28192767) 00002000:00010000:2.0:1787119489.164968:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158e00 00000100:00100000:2.0:1787119489.165033:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9318 00000100:00100000:2.0:1787119489.165042:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633286144:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.168764:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633286144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3702us (4029us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.168779:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9318 00002000:00100000:2.0:1787119489.168792:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (28188672->28192767) req@ffff92a606158e00 x1873929633286144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787119489.168795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:2.0:1787119489.168802:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158e00 with x1873929633286144 ext(28188672->28192767) 00002000:00010000:2.0:1787119489.168808:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158e00 00000100:00100000:2.0:1787119489.168835:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633286272 00000100:00100000:2.0:1787119489.168843:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633286272 00002000:00100000:2.0:1787119489.168877:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (7553024->7557119) req@ffff92a519d18a80 x1873929633286272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.168885:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18a80 with x1873929633286272 ext(7553024->7557119) 00002000:00010000:2.0:1787119489.168889:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18a80 00000100:00100000:2.0:1787119489.168909:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9319 00000100:00100000:2.0:1787119489.168918:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633286272:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.169146:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633286272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 228us (350us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.169153:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9319 00002000:00100000:2.0:1787119489.169159:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (7553024->7557119) req@ffff92a519d18a80 x1873929633286272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.169167:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18a80 with x1873929633286272 ext(7553024->7557119) 00002000:00010000:2.0:1787119489.169170:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18a80 00000100:00100000:1.0:1787119489.174560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.174597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.174600:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633286400 00000100:00100000:3.0:1787119489.174609:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633286400 00000100:00100000:1.0:1787119489.174615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.174635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.174656:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633286528 00000100:00100000:1.0:1787119489.174659:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633286528 00002000:00010000:1.0:1787119489.174694:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (6431679->18446744073709551615) 00002000:00100000:1.0:1787119489.174699:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b100 with x1873929633286528 ext(6431679->18446744073709551615) 00002000:00010000:1.0:1787119489.174710:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b100. 00000100:00100000:1.0:1787119489.174732:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633286656 00000100:00100000:1.0:1787119489.174735:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633286656 00002000:00100000:1.0:1787119489.174755:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (3309568->3313663) req@ffff92a519d18000 x1873929633286656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.174765:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18000 with x1873929633286656 ext(3309568->3313663) 00002000:00010000:1.0:1787119489.174770:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18000 00002000:00010000:3.0:1787119489.174772:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (56586156->18446744073709551615) 00002000:00100000:3.0:1787119489.174776:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633286400 ext(56586156->18446744073709551615) 00002000:00010000:3.0:1787119489.174781:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18380. 00000100:00100000:1.0:1787119489.174782:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633286784 00000100:00100000:1.0:1787119489.174784:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633286784 00002000:00100000:1.0:1787119489.174798:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (28164096->28229631) req@ffff92a519d1a300 x1873929633286784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119489.174800:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9320 00002000:00100000:1.0:1787119489.174806:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a300 with x1873929633286784 ext(28164096->28229631) 00000100:00100000:3.0:1787119489.174808:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633286528:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119489.174809:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1a300 00000100:00100000:1.0:1787119489.174822:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9321 00000100:00100000:1.0:1787119489.174827:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633286656:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.175037:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633286656:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 208us (419us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.175043:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9321 00002000:00100000:1.0:1787119489.175050:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (3309568->3313663) req@ffff92a519d18000 x1873929633286656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.175057:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18000 with x1873929633286656 ext(3309568->3313663) 00002000:00010000:1.0:1787119489.175060:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18000 00000100:00100000:1.0:1787119489.175076:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9322 00000100:00100000:1.0:1787119489.175081:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633286400:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119489.175092:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 39334240 -> 6431679 00002000:00010000:3.0:1787119489.175095:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:3.0:1787119489.175097:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119486 -> 1787119487 00002000:00010000:3.0:1787119489.175099:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:3.0:1787119489.175102:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 907 -> 1293 00000100:00100000:3.0:1787119489.175128:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633286528:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 320us (530us total) trans 4294969043 rc 0/0 00000100:00100000:3.0:1787119489.175137:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9320 00002000:00010000:3.0:1787119489.175140:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (6431679->18446744073709551615) 00002000:00100000:3.0:1787119489.175143:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b100 with x1873929633286528 ext(6431679->18446744073709551615) 00002000:00010000:3.0:1787119489.175147:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b100. 00000100:00100000:3.0:1787119489.175159:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9323 00000100:00100000:3.0:1787119489.175165:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633286784:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:1.0:1787119489.175186:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 11298734 -> 56586156 00002000:00010000:1.0:1787119489.175188:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.175191:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.175193:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.175195:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1037 -> 1037 00000100:00100000:1.0:1787119489.175219:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633286400:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 137us (670us total) trans 4294968818 rc 0/0 00010000:00010000:2.0:1787119489.175460:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.175471:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.175607:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9322 00002000:00010000:1.0:1787119489.175610:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (56586156->18446744073709551615) 00002000:00100000:1.0:1787119489.175613:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633286400 ext(56586156->18446744073709551615) 00002000:00010000:1.0:1787119489.175617:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18380. 00010000:00010000:0.0:1787119489.176129:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.176140:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.176148:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.176154:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119489.176159:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.176166:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.176182:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119489.176185:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119489.176189:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.176195:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2866 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.178043:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.178051:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e561400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119489.178056:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.178069:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.178083:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119489.178086:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119489.178089:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.178096:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e286d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.180753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.180795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.180844:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633286912 00000100:00100000:2.0:1787119489.180855:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633286912 00002000:00100000:2.0:1787119489.180901:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (3313664->3317759) req@ffff92a60615ad80 x1873929633286912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.180912:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615ad80 with x1873929633286912 ext(3313664->3317759) 00002000:00010000:2.0:1787119489.180918:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615ad80 00000100:00100000:2.0:1787119489.180957:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9324 00000100:00100000:2.0:1787119489.180967:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633286912:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.181013:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633287040 00000100:00100000:3.0:1787119489.181018:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633287040 00000100:00100000:3.0:1787119489.181047:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19431 00000100:00100000:3.0:1787119489.181053:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+100:32720:x1873929633287040:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.181072:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.181092:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2874 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a12 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.181168:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e287b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.181182:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e287b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.181192:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e287b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.181197:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633286912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 231us (453us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.181203:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9324 00002000:00100000:2.0:1787119489.181210:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (3313664->3317759) req@ffff92a60615ad80 x1873929633286912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00000004:00200000:3.0:1787119489.181215:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 56586156 00002000:00100000:2.0:1787119489.181217:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615ad80 with x1873929633286912 ext(3313664->3317759) 00000004:00200000:3.0:1787119489.181219:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00002000:00010000:2.0:1787119489.181220:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615ad80 00000004:00010000:3.0:1787119489.181248:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e287b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.181277:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2874 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a12 expref: 102 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.181292:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e287b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a12 expref: 101 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.181300:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119489.181303:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.181306:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:3.0:1787119489.181338:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+101:32720:x1873929633287040:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 285us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.181344:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19431 00000100:00100000:0.0:1787119489.183134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.183199:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633287168 00000100:00100000:3.0:1787119489.183207:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633287168 00000100:00100000:3.0:1787119489.183266:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19432 00000100:00100000:3.0:1787119489.183275:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+101:32729:x1873929633287168:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.183292:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.183310:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2882 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a19 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.183379:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2889 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.183393:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.183404:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119489.183428:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 6431679 00000004:00200000:3.0:1787119489.183431:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.183471:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.183498:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2882 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a19 expref: 103 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.183515:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a19 expref: 102 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.183524:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119489.183527:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.183531:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1600, rc 0) 00000100:00100000:3.0:1787119489.183594:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+102:32729:x1873929633287168:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 320us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.183601:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19432 00000100:00100000:2.0:1787119489.187231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.187322:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633287296 00000100:00100000:0.0:1787119489.187331:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633287296 00002000:00100000:0.0:1787119489.187374:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (11825152->11829247) req@ffff92a519d27b80 x1873929633287296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.187391:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27b80 with x1873929633287296 ext(11825152->11829247) 00002000:00010000:0.0:1787119489.187396:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27b80 00000100:00100000:0.0:1787119489.187426:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9325 00000100:00100000:0.0:1787119489.187467:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633287296:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.187735:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633287296:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 270us (516us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.187741:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9325 00002000:00100000:0.0:1787119489.187747:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (11825152->11829247) req@ffff92a519d27b80 x1873929633287296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.187753:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27b80 with x1873929633287296 ext(11825152->11829247) 00002000:00010000:0.0:1787119489.187757:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27b80 00000100:00100000:3.0:1787119489.190323:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633286784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15148us (15677us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.190337:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9323 00002000:00100000:3.0:1787119489.190348:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (28164096->28229631) req@ffff92a519d1a300 x1873929633286784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.190358:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a300 with x1873929633286784 ext(28164096->28229631) 00002000:00010000:3.0:1787119489.190363:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1a300 00000100:00100000:1.0:1787119489.196712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.196824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.199011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.199271:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633287424 00000100:00100000:3.0:1787119489.199283:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633287424 00002000:00100000:3.0:1787119489.199337:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (11829248->11833343) req@ffff92a63dc07480 x1873929633287424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.199350:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07480 with x1873929633287424 ext(11829248->11833343) 00002000:00010000:3.0:1787119489.199356:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07480 00000100:00100000:2.0:1787119489.200870:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633287552 00000100:00100000:2.0:1787119489.200886:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633287552 00002000:00100000:2.0:1787119489.200928:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (52510720->52514815) req@ffff92a63dc06a00 x1873929633287552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119489.200998:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633287680 00000100:00100000:3.0:1787119489.201002:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633287680 00002000:00100000:3.0:1787119489.201025:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (3289088->3354623) req@ffff92a63dc06d80 x1873929633287680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.201034:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc06d80 with x1873929633287680 ext(3289088->3354623) 00002000:00010000:3.0:1787119489.201038:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc06d80 00000100:00100000:3.0:1787119489.201071:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9326 00000100:00100000:3.0:1787119489.201080:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633287424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.201358:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633287424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 277us (4655us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.201365:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9326 00002000:00100000:3.0:1787119489.201371:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (11829248->11833343) req@ffff92a63dc07480 x1873929633287424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.201379:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07480 with x1873929633287424 ext(11829248->11833343) 00002000:00010000:3.0:1787119489.201382:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07480 00000100:00100000:3.0:1787119489.201399:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9327 00000100:00100000:3.0:1787119489.201405:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633287680:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:2.0:1787119489.201801:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc06a00 with x1873929633287552 ext(52510720->52514815) 00002000:00010000:2.0:1787119489.201806:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc06a00 00000100:00100000:2.0:1787119489.201833:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9328 00000100:00100000:2.0:1787119489.201842:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633287552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.201973:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633287552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 132us (5149us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.201980:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9328 00002000:00100000:2.0:1787119489.201986:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (52510720->52514815) req@ffff92a63dc06a00 x1873929633287552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.201995:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc06a00 with x1873929633287552 ext(52510720->52514815) 00002000:00010000:2.0:1787119489.201998:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc06a00 00000100:00100000:0.0:1787119489.202316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.202744:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633287936 00000100:00100000:2.0:1787119489.202751:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633287936 00000100:00100000:2.0:1787119489.202823:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19433 00000100:00100000:2.0:1787119489.202832:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+102:32729:x1873929633287936:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119489.202881:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119489.202911:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2889 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a19 expref: 102 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.202930:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119489.202935:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119489.203144:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.203157:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.203168:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119489.203223:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976246 00000004:00010000:2.0:1787119489.203249:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb9bbd78 reply state 00000000b332bf19 transno 4294976247 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.203258:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119489.203336:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+104:32729:x1873929633287936:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 504us (1020us total) trans 4294976247 rc 0/0 00000100:00100000:2.0:1787119489.203343:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19433 00000020:00080000:2.0:1787119489.203347:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119489.206160:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633287680:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4743us (7148us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.206174:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9327 00002000:00100000:1.0:1787119489.206185:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (3289088->3354623) req@ffff92a63dc06d80 x1873929633287680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.206201:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc06d80 with x1873929633287680 ext(3289088->3354623) 00002000:00010000:1.0:1787119489.206207:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc06d80 00010000:00010000:2.0:1787119489.206759:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.206772:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.206779:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.206785:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e561400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119489.206791:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.206799:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.206815:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119489.206818:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119489.206823:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.206829:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2890 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.208039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.208075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.208143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.208370:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633288320 00000100:00100000:2.0:1787119489.208380:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633288320 00002000:00100000:2.0:1787119489.208430:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (52514816->52518911) req@ffff92a63dfb9500 x1873929633288320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.208730:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9500 with x1873929633288320 ext(52514816->52518911) 00002000:00010000:2.0:1787119489.208736:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb9500 00000100:00100000:2.0:1787119489.208760:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633288192 00000100:00100000:2.0:1787119489.208764:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633288192 00002000:00100000:2.0:1787119489.208781:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (28229632->28266495) req@ffff92a63dfb8700 x1873929633288192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.208790:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633288192 ext(28229632->28266495) 00002000:00010000:2.0:1787119489.208793:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb8700 00000100:00100000:2.0:1787119489.208808:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633288448 00000100:00100000:2.0:1787119489.208811:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633288448 00002000:00010000:2.0:1787119489.208824:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (26311337->18446744073709551615) 00002000:00100000:2.0:1787119489.208827:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb100 with x1873929633288448 ext(26311337->18446744073709551615) 00002000:00010000:2.0:1787119489.208838:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb100. 00000100:00100000:2.0:1787119489.208857:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9329 00000100:00100000:2.0:1787119489.208865:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633288320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.209116:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633288320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 250us (1082us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.209124:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9329 00002000:00100000:2.0:1787119489.209131:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (52514816->52518911) req@ffff92a63dfb9500 x1873929633288320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.209138:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9500 with x1873929633288320 ext(52514816->52518911) 00002000:00010000:2.0:1787119489.209142:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb9500 00000100:00100000:2.0:1787119489.209159:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9330 00000100:00100000:2.0:1787119489.209166:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633288192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.209291:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9331 00000100:00100000:2.0:1787119489.209299:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633288448:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119489.210214:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 6431679 -> 26311337 00002000:00010000:2.0:1787119489.210219:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.210222:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.210224:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.210226:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1293 -> 1293 00000100:00100000:2.0:1787119489.210269:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633288448:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 970us (2125us total) trans 4294969044 rc 0/0 00000100:00100000:2.0:1787119489.210278:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9331 00002000:00010000:2.0:1787119489.210281:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (26311337->18446744073709551615) 00002000:00100000:2.0:1787119489.210284:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb100 with x1873929633288448 ext(26311337->18446744073709551615) 00002000:00010000:2.0:1787119489.210290:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb100. 00000100:00100000:0.0:1787119489.210376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.210735:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633288064 00000100:00100000:1.0:1787119489.210741:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633288064 00002000:00100000:1.0:1787119489.210774:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (11804672->11870207) req@ffff92a606159f80 x1873929633288064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.210782:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159f80 with x1873929633288064 ext(11804672->11870207) 00002000:00010000:1.0:1787119489.210787:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606159f80 00000100:00100000:1.0:1787119489.210814:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9332 00000100:00100000:1.0:1787119489.210823:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633288064:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.214189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.214362:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633288064:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3539us (3985us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.214374:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9332 00002000:00100000:1.0:1787119489.214386:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (11804672->11870207) req@ffff92a606159f80 x1873929633288064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.214397:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159f80 with x1873929633288064 ext(11804672->11870207) 00002000:00010000:1.0:1787119489.214403:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606159f80 00000100:00100000:1.0:1787119489.214427:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633288576 00000100:00100000:1.0:1787119489.214434:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633288576 00000100:00100000:2.0:1787119489.214707:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633288192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5539us (6630us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119489.214715:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9330 00002000:00100000:2.0:1787119489.214722:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (28229632->28266495) req@ffff92a63dfb8700 x1873929633288192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.214730:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633288192 ext(28229632->28266495) 00002000:00010000:2.0:1787119489.214734:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb8700 00002000:00100000:1.0:1787119489.214855:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (3309568->58588948) req@ffff92a63dc04000 x1873929633288576/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.214863:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633288576 ext(3309568->58588948) 00002000:00010000:1.0:1787119489.214868:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04000 00000100:00100000:1.0:1787119489.214898:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9333 00000100:00100000:1.0:1787119489.214908:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633288576:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119489.215378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.215823:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633288704 00000100:00100000:0.0:1787119489.215830:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633288704 00000100:00100000:0.0:1787119489.215909:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19434 00000100:00100000:0.0:1787119489.215917:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+103:32729:x1873929633288704:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119489.215934:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119489.215954:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e400/0xcaba3de8463e2897 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a20 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.216032:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e289e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.216051:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e289e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.216062:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e289e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119489.216086:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 26311337 00000004:00200000:0.0:1787119489.216091:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119489.216107:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e289e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.216133:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e400/0xcaba3de8463e2897 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a20 expref: 105 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.216152:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e289e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a20 expref: 104 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.216160:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119489.216163:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119489.216167:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a62045ee00, rc 0) 00000100:00100000:0.0:1787119489.216221:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+104:32729:x1873929633288704:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 304us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119489.216228:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19434 00000100:00100000:1.0:1787119489.217377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.220171:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633288832 00000100:00100000:2.0:1787119489.220185:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633288832 00002000:00100000:2.0:1787119489.220236:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (52490240->52555775) req@ffff92a63dc05f80 x1873929633288832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.220248:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633288832 ext(52490240->52555775) 00002000:00010000:2.0:1787119489.220254:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05f80 00000100:00100000:2.0:1787119489.220294:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9334 00000100:00100000:2.0:1787119489.220304:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633288832:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.223271:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633288576:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 8355us (9081us total) trans 4294969045 rc 0/0 00000100:00100000:2.0:1787119489.223284:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9333 00002000:00100000:2.0:1787119489.223295:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (3309568->58588948) req@ffff92a63dc04000 x1873929633288576/t4294969045(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/456 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.223306:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633288576 ext(3309568->58588948) 00002000:00010000:2.0:1787119489.223311:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04000 00000100:00100000:3.0:1787119489.224180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.224357:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633288960 00000100:00100000:2.0:1787119489.224365:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633288960 00002000:00100000:2.0:1787119489.224401:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (28184576->28250111) req@ffff92a63eb2df80 x1873929633288960/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.224413:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2df80 with x1873929633288960 ext(28184576->28250111) 00002000:00010000:2.0:1787119489.224417:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2df80 00000100:00100000:2.0:1787119489.224465:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9335 00000100:00100000:2.0:1787119489.224483:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633288960:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119489.227349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.227433:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633289088 00000100:00100000:1.0:1787119489.228055:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633289088 00002000:00100000:1.0:1787119489.228105:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (7548928->7553023) req@ffff92a519d25c00 x1873929633289088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.228117:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25c00 with x1873929633289088 ext(7548928->7553023) 00002000:00010000:1.0:1787119489.228123:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25c00 00000100:00100000:1.0:1787119489.228154:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9336 00000100:00100000:1.0:1787119489.228164:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633289088:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.228391:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633289088:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 228us (1050us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.228399:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9336 00002000:00100000:1.0:1787119489.228406:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (7548928->7553023) req@ffff92a519d25c00 x1873929633289088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.228413:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25c00 with x1873929633289088 ext(7548928->7553023) 00002000:00010000:1.0:1787119489.228417:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25c00 00000100:00100000:2.0:1787119489.231207:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633288960:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 6724us (7020us total) trans 4294968819 rc 0/0 00000100:00100000:2.0:1787119489.231220:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9335 00002000:00100000:2.0:1787119489.231232:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (28184576->28250111) req@ffff92a63eb2df80 x1873929633288960/t4294968819(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/448 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.231242:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2df80 with x1873929633288960 ext(28184576->28250111) 00002000:00010000:2.0:1787119489.231247:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2df80 00000100:00100000:0.0:1787119489.231540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.231684:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633288832:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11380us (14311us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119489.231692:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9334 00002000:00100000:0.0:1787119489.231699:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (52490240->52555775) req@ffff92a63dc05f80 x1873929633288832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.231709:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633288832 ext(52490240->52555775) 00002000:00010000:0.0:1787119489.231713:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05f80 00000100:00100000:0.0:1787119489.231730:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633289216 00000100:00100000:0.0:1787119489.231737:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633289216 00002000:00100000:0.0:1787119489.231770:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (23564288->23568383) req@ffff92a508cfed80 x1873929633289216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.231778:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633289216 ext(23564288->23568383) 00002000:00010000:0.0:1787119489.231782:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfed80 00000100:00100000:0.0:1787119489.231804:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9337 00000100:00100000:0.0:1787119489.231813:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633289216:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.232021:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633289216:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 209us (481us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.232028:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9337 00002000:00100000:0.0:1787119489.232034:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (23564288->23568383) req@ffff92a508cfed80 x1873929633289216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.232042:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633289216 ext(23564288->23568383) 00002000:00010000:0.0:1787119489.232045:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfed80 00000100:00100000:2.0:1787119489.232889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.232925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.233048:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633289472 00000100:00100000:3.0:1787119489.233055:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633289472 00002000:00100000:3.0:1787119489.233087:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (7553024->7557119) req@ffff92a6181af100 x1873929633289472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.233096:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181af100 with x1873929633289472 ext(7553024->7557119) 00002000:00010000:3.0:1787119489.233099:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181af100 00000100:00100000:3.0:1787119489.233123:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9338 00000100:00100000:3.0:1787119489.233131:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633289472:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.233321:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633289344 00000100:00100000:1.0:1787119489.233325:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633289344 00000100:00100000:1.0:1787119489.233355:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4986 00000100:00100000:1.0:1787119489.233362:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633289344:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119489.233802:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633289472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 670us (875us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.233809:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9338 00002000:00100000:3.0:1787119489.233816:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (7553024->7557119) req@ffff92a6181af100 x1873929633289472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.233824:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181af100 with x1873929633289472 ext(7553024->7557119) 00002000:00010000:3.0:1787119489.233828:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181af100 00000100:00100000:2.0:1787119489.241911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.241942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.241962:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633289728 00000100:00100000:2.0:1787119489.241970:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633289728 00002000:00100000:2.0:1787119489.242007:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (23568384->23572479) req@ffff92a6181ad880 x1873929633289728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.242015:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ad880 with x1873929633289728 ext(23568384->23572479) 00002000:00010000:2.0:1787119489.242020:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ad880 00000100:00100000:2.0:1787119489.242038:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9339 00000100:00100000:2.0:1787119489.242044:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633289728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.242220:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633289728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 176us (277us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.242228:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9339 00002000:00100000:2.0:1787119489.242234:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (23568384->23572479) req@ffff92a6181ad880 x1873929633289728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.242242:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ad880 with x1873929633289728 ext(23568384->23572479) 00002000:00010000:2.0:1787119489.242245:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ad880 00000100:00100000:2.0:1787119489.242284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.242344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.242358:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633289856 00000100:00100000:2.0:1787119489.242361:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633289856 00002000:00100000:2.0:1787119489.242374:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (29077504->29081599) req@ffff92a6181ace00 x1873929633289856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.242380:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ace00 with x1873929633289856 ext(29077504->29081599) 00002000:00010000:2.0:1787119489.242383:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181ace00 00000100:00100000:2.0:1787119489.242391:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633289984 00000100:00100000:2.0:1787119489.242393:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633289984 00002000:00100000:2.0:1787119489.242400:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (11825152->11829247) req@ffff92a6181aca80 x1873929633289984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.242404:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aca80 with x1873929633289984 ext(11825152->11829247) 00002000:00010000:2.0:1787119489.242406:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181aca80 00000100:00100000:2.0:1787119489.242414:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9340 00000100:00100000:2.0:1787119489.242418:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633289856:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.242677:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633289600 00000100:00100000:3.0:1787119489.242682:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633289600 00000100:00100000:3.0:1787119489.242714:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4987 00000100:00100000:3.0:1787119489.242720:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633289600:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119489.242763:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633289856:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 343us (478us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.242771:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9340 00002000:00100000:2.0:1787119489.242776:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (29077504->29081599) req@ffff92a6181ace00 x1873929633289856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.242784:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ace00 with x1873929633289856 ext(29077504->29081599) 00002000:00010000:2.0:1787119489.242788:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181ace00 00000100:00100000:2.0:1787119489.242800:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9341 00000100:00100000:2.0:1787119489.242806:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633289984:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.242891:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633289984:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 84us (544us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.242898:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9341 00002000:00100000:2.0:1787119489.242903:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (11825152->11829247) req@ffff92a6181aca80 x1873929633289984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.242910:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aca80 with x1873929633289984 ext(11825152->11829247) 00002000:00010000:2.0:1787119489.242913:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181aca80 00000100:00100000:2.0:1787119489.250021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.250055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.250088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.250115:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633290112 00000100:00100000:2.0:1787119489.250127:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633290112 00002000:00100000:2.0:1787119489.250172:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (29081600->29085695) req@ffff92a6181ad500 x1873929633290112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.250184:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ad500 with x1873929633290112 ext(29081600->29085695) 00002000:00010000:2.0:1787119489.250190:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181ad500 00000100:00100000:2.0:1787119489.250211:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633290240 00000100:00100000:2.0:1787119489.250214:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633290240 00002000:00100000:2.0:1787119489.250231:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (23543808->23609343) req@ffff92a6181aea00 x1873929633290240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.250239:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aea00 with x1873929633290240 ext(23543808->23609343) 00002000:00010000:2.0:1787119489.250242:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181aea00 00000100:00100000:2.0:1787119489.250254:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633290368 00000100:00100000:2.0:1787119489.250257:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633290368 00002000:00100000:2.0:1787119489.250271:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (11829248->11833343) req@ffff92a6181aed80 x1873929633290368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.250278:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aed80 with x1873929633290368 ext(11829248->11833343) 00002000:00010000:2.0:1787119489.250282:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181aed80 00000100:00100000:2.0:1787119489.250299:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9342 00000100:00100000:2.0:1787119489.250309:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633290112:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.250506:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9343 00000100:00100000:3.0:1787119489.250514:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633290240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.250539:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633290112:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 232us (529us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.250546:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9342 00002000:00100000:2.0:1787119489.250553:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (29081600->29085695) req@ffff92a6181ad500 x1873929633290112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.250561:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ad500 with x1873929633290112 ext(29081600->29085695) 00002000:00010000:2.0:1787119489.250577:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181ad500 00000100:00100000:2.0:1787119489.250593:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9344 00000100:00100000:2.0:1787119489.250600:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633290368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.251936:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633290368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1329us (1841us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.251946:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9344 00002000:00100000:2.0:1787119489.251953:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (11829248->11833343) req@ffff92a6181aed80 x1873929633290368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.251963:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aed80 with x1873929633290368 ext(11829248->11833343) 00002000:00010000:2.0:1787119489.251968:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181aed80 00000100:00100000:3.0:1787119489.256091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.256202:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633290496 00000100:00100000:0.0:1787119489.256212:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633290496 00002000:00100000:0.0:1787119489.256256:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (29057024->29122559) req@ffff92a63eb2e680 x1873929633290496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.256268:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2e680 with x1873929633290496 ext(29057024->29122559) 00002000:00010000:0.0:1787119489.256274:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2e680 00000100:00100000:0.0:1787119489.256308:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9345 00000100:00100000:0.0:1787119489.256317:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633290496:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.260368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.260406:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633290624 00000100:00100000:1.0:1787119489.260417:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633290624 00002000:00100000:1.0:1787119489.260493:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (11804672->11870207) req@ffff92a63eb2c700 x1873929633290624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.260503:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c700 with x1873929633290624 ext(11804672->11870207) 00002000:00010000:1.0:1787119489.260508:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2c700 00000100:00100000:3.0:1787119489.260525:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633290240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10011us (10469us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.260532:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9346 00000100:00100000:3.0:1787119489.260545:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9343 00000100:00100000:1.0:1787119489.260545:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633290624:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:3.0:1787119489.260551:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (23543808->23609343) req@ffff92a6181aea00 x1873929633290240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.260559:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aea00 with x1873929633290240 ext(23543808->23609343) 00002000:00010000:3.0:1787119489.260562:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181aea00 00000100:00100000:1.0:1787119489.263072:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633290624:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2522us (2702us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.263085:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9346 00002000:00100000:1.0:1787119489.263097:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (11804672->11870207) req@ffff92a63eb2c700 x1873929633290624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.263107:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c700 with x1873929633290624 ext(11804672->11870207) 00002000:00010000:1.0:1787119489.263113:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2c700 00000100:00100000:0.0:1787119489.264064:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633290496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7742us (7976us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119489.264075:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9345 00002000:00100000:0.0:1787119489.264085:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (29057024->29122559) req@ffff92a63eb2e680 x1873929633290496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.264094:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2e680 with x1873929633290496 ext(29057024->29122559) 00002000:00010000:0.0:1787119489.264099:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2e680 00000100:00100000:3.0:1787119489.267805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.271227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.271269:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.271333:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633290752 00000100:00100000:3.0:1787119489.271344:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633290752 00002000:00100000:3.0:1787119489.271434:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (23564288->23568383) req@ffff92a63eb2fb80 x1873929633290752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.271465:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2fb80 with x1873929633290752 ext(23564288->23568383) 00002000:00010000:3.0:1787119489.271471:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2fb80 00000100:00100000:3.0:1787119489.271507:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633290880 00000100:00100000:3.0:1787119489.271510:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633290880 00002000:00100000:3.0:1787119489.271527:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (21061632->21069823) req@ffff92a508cff800 x1873929633290880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.271536:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff800 with x1873929633290880 ext(21061632->21069823) 00002000:00010000:3.0:1787119489.271540:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cff800 00000100:00100000:3.0:1787119489.271561:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9347 00000100:00100000:3.0:1787119489.271581:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633290752:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.271935:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633291136 00000100:00100000:3.0:1787119489.271939:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633291136 00000100:00100000:3.0:1787119489.271968:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19435 00000100:00100000:3.0:1787119489.271974:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+104:32728:x1873929633291136:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.272016:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119489.272043:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e285f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a0b expref: 104 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.272064:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119489.272068:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119489.272266:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.272279:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.272289:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119489.272340:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976248 00000004:00010000:3.0:1787119489.272365:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c4af58e reply state 000000008ccdc450 transno 4294976249 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.272374:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119489.272580:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9348 00000100:00100000:0.0:1787119489.272591:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633290880:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.272871:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633290880:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 282us (1652us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1787119489.272879:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9348 00002000:00100000:0.0:1787119489.272887:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (21061632->21069823) req@ffff92a508cff800 x1873929633290880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/8632 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.272896:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff800 with x1873929633290880 ext(21061632->21069823) 00002000:00010000:0.0:1787119489.272900:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cff800 00000100:00100000:0.0:1787119489.273992:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+106:32728:x1873929633291136:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2012us (2716us total) trans 4294976249 rc 0/0 00000100:00100000:0.0:1787119489.274003:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19435 00000020:00080000:0.0:1787119489.274007:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119489.274371:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633290752:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2790us (6575us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.274379:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9347 00002000:00100000:2.0:1787119489.274388:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (23564288->23568383) req@ffff92a63eb2fb80 x1873929633290752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.274398:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2fb80 with x1873929633290752 ext(23564288->23568383) 00002000:00010000:2.0:1787119489.274404:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2fb80 00010000:00010000:1.0:1787119489.276550:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.276578:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.276585:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.276591:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119489.276596:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.276609:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.277135:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119489.277139:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119489.277144:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.277151:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e28a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.278097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.278125:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633291264 00000100:00100000:2.0:1787119489.278135:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633291264 00002000:00010000:2.0:1787119489.278170:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (11298734->18446744073709551615) 00002000:00100000:2.0:1787119489.278175:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ac000 with x1873929633291264 ext(11298734->18446744073709551615) 00002000:00010000:2.0:1787119489.278185:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ac000. 00000100:00100000:2.0:1787119489.278210:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9349 00000100:00100000:2.0:1787119489.278219:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633291264:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119489.278510:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 26311337 -> 11298734 00002000:00010000:2.0:1787119489.278514:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.278517:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.278519:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.278522:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1293 -> 1037 00000100:00100000:2.0:1787119489.278585:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633291264:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 365us (496us total) trans 4294969046 rc 0/0 00000100:00100000:2.0:1787119489.278592:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9349 00002000:00010000:2.0:1787119489.278597:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (11298734->18446744073709551615) 00002000:00100000:2.0:1787119489.278600:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ac000 with x1873929633291264 ext(11298734->18446744073709551615) 00002000:00010000:2.0:1787119489.278604:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ac000. 00000100:00100000:2.0:1787119489.278651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.279855:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633291392 00000100:00100000:1.0:1787119489.279865:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633291392 00002000:00100000:1.0:1787119489.279899:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (23568384->23572479) req@ffff92a6181afb80 x1873929633291392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.279909:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181afb80 with x1873929633291392 ext(23568384->23572479) 00002000:00010000:1.0:1787119489.279914:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181afb80 00000100:00100000:1.0:1787119489.279936:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9350 00000100:00100000:1.0:1787119489.279943:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633291392:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.280120:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633291392:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 176us (1468us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.280127:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9350 00002000:00100000:1.0:1787119489.280133:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (23568384->23572479) req@ffff92a6181afb80 x1873929633291392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.280141:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181afb80 with x1873929633291392 ext(23568384->23572479) 00002000:00010000:1.0:1787119489.280144:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181afb80 00000100:00100000:1.0:1787119489.285277:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633289344:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 51904us (52381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.285290:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4986 00000001:00080000:1.0:1787119489.285327:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969042 is committed 00000001:00080000:1.0:1787119489.285336:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969045 is committed 00000100:00100000:2.0:1787119489.286287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.286374:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633291520 00000100:00100000:0.0:1787119489.286383:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633291520 00002000:00100000:0.0:1787119489.286428:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (41295872->41299967) req@ffff92a6181ac700 x1873929633291520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000001:00080000:1.0:1787119489.290962:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968817 is committed 00000001:00080000:1.0:1787119489.290978:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968818 is committed 00000001:00080000:1.0:1787119489.290983:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968819 is committed 00000100:00100000:3.0:1787119489.291248:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633289600:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 48522us (49339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.291260:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4987 00002000:00100000:0.0:1787119489.291340:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ac700 with x1873929633291520 ext(41295872->41299967) 00002000:00010000:0.0:1787119489.291345:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181ac700 00000100:00100000:3.0:1787119489.291411:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9351 00000100:00100000:3.0:1787119489.291421:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633291520:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.291720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.291839:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633292032 00000100:00100000:0.0:1787119489.291846:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633292032 00000100:00100000:0.0:1787119489.291889:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19436 00000100:00100000:0.0:1787119489.291897:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+105:32727:x1873929633292032:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119489.291940:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119489.291966:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572a00/0xcaba3de8463e2820 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159f6 expref: 105 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.291984:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119489.291989:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119489.292166:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.292180:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.292190:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119489.292241:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976250 00000004:00010000:0.0:1787119489.292266:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009771577f reply state 000000000b3c3310 transno 4294976251 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.292280:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119489.292342:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+107:32727:x1873929633292032:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 445us (622us total) trans 4294976251 rc 0/0 00000100:00100000:0.0:1787119489.292348:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19436 00000020:00080000:0.0:1787119489.292351:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119489.293175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.293223:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633291776 00000100:00100000:1.0:1787119489.293229:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633291776 00002000:00100000:1.0:1787119489.293264:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (23543808->23609343) req@ffff92a6181ae680 x1873929633291776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.293274:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ae680 with x1873929633291776 ext(23543808->23609343) 00002000:00010000:1.0:1787119489.293278:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ae680 00000100:00100000:2.0:1787119489.293409:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.293677:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633291520:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2258us (7394us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.293689:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9351 00002000:00100000:3.0:1787119489.293696:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (41295872->41299967) req@ffff92a6181ac700 x1873929633291520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.293705:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ac700 with x1873929633291520 ext(41295872->41299967) 00002000:00010000:3.0:1787119489.293709:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181ac700 00000100:00100000:3.0:1787119489.293730:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9352 00000100:00100000:3.0:1787119489.293739:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633291776:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.294096:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633291648 00000100:00100000:3.0:1787119489.294101:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633291648 00000100:00100000:3.0:1787119489.294180:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19437 00000100:00100000:3.0:1787119489.294188:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+107:32728:x1873929633291648:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.294199:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.294217:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a27 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.294292:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e28ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.294304:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e28ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.294314:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e28ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119489.294334:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 11298734 00000004:00200000:3.0:1787119489.294338:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.294354:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e28ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.294378:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a27 expref: 109 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.294393:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e28ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a27 expref: 108 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.294400:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119489.294403:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.294406:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00000100:00100000:3.0:1787119489.294709:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+108:32728:x1873929633291648:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 520us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.294715:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19437 00000100:00100000:2.0:1787119489.295936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119489.296028:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.296040:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.296046:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.296052:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045e200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119489.296057:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.296064:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.296079:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119489.296082:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119489.296087:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.296093:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.296139:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633292160 00000100:00100000:1.0:1787119489.296148:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633292160 00002000:00010000:1.0:1787119489.296176:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (6431679->18446744073709551615) 00002000:00100000:1.0:1787119489.296180:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497ad80 with x1873929633292160 ext(6431679->18446744073709551615) 00002000:00010000:1.0:1787119489.296189:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497ad80. 00000100:00100000:1.0:1787119489.296251:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9353 00000100:00100000:1.0:1787119489.296261:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633292160:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119489.296967:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 39334240 -> 6431679 00002000:00010000:1.0:1787119489.296973:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.296975:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.296978:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.296980:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 907 -> 1293 00000100:00100000:1.0:1787119489.297087:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633292160:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 826us (1154us total) trans 4294969047 rc 0/0 00000100:00100000:1.0:1787119489.297096:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9353 00002000:00010000:1.0:1787119489.297099:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (6431679->18446744073709551615) 00002000:00100000:1.0:1787119489.297102:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497ad80 with x1873929633292160 ext(6431679->18446744073709551615) 00002000:00010000:1.0:1787119489.297108:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497ad80. 00000100:00100000:2.0:1787119489.303146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.303203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.303273:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633292288 00000100:00100000:0.0:1787119489.303283:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633292288 00002000:00100000:0.0:1787119489.303328:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (41361408->41365503) req@ffff92a63497aa00 x1873929633292288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.303340:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497aa00 with x1873929633292288 ext(41361408->41365503) 00002000:00010000:0.0:1787119489.303345:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63497aa00 00000100:00100000:0.0:1787119489.303379:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9354 00000100:00100000:0.0:1787119489.303388:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633292288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.303842:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633292288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 453us (708us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.303850:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9354 00002000:00100000:0.0:1787119489.303857:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (41361408->41365503) req@ffff92a63497aa00 x1873929633292288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.303865:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497aa00 with x1873929633292288 ext(41361408->41365503) 00002000:00010000:0.0:1787119489.303869:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63497aa00 00000100:00100000:1.0:1787119489.303995:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633292416 00000100:00100000:1.0:1787119489.304000:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633292416 00000100:00100000:1.0:1787119489.304044:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19438 00000100:00100000:1.0:1787119489.304053:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+107:32727:x1873929633292416:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119489.304071:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119489.304094:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a2e expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.304179:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e28c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.304194:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e28c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.304206:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e28c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119489.304230:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 6431679 00000004:00200000:1.0:1787119489.304235:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119489.304250:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e28c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.304272:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a2e expref: 109 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.304301:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e28c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a2e expref: 108 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.304310:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119489.304313:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119489.304316:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e573a00, rc 0) 00000100:00100000:1.0:1787119489.304345:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+108:32727:x1873929633292416:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 293us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.304351:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19438 00000100:00100000:3.0:1787119489.305179:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633291776:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11436us (11999us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.305191:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9352 00002000:00100000:3.0:1787119489.305201:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (23543808->23609343) req@ffff92a6181ae680 x1873929633291776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.305211:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ae680 with x1873929633291776 ext(23543808->23609343) 00002000:00010000:3.0:1787119489.305217:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ae680 00000100:00100000:2.0:1787119489.310308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.310425:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633292672 00000100:00100000:0.0:1787119489.310758:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633292672 00000100:00100000:0.0:1787119489.310866:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19439 00000100:00100000:0.0:1787119489.310879:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+108:32724:x1873929633292672:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119489.310939:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119489.310973:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e27cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047159da expref: 108 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.310992:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119489.310997:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119489.311202:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.311216:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.311225:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119489.311275:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976252 00000004:00010000:0.0:1787119489.311299:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046c45041 reply state 00000000ee7f98cb transno 4294976253 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.311308:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119489.311399:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+110:32724:x1873929633292672:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 523us (1100us total) trans 4294976253 rc 0/0 00000100:00100000:0.0:1787119489.311406:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19439 00000020:00080000:0.0:1787119489.311411:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119489.315164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119489.315273:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.315287:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.315295:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.315301:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045e200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119489.315306:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.315314:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.315330:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119489.315333:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119489.315338:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.315345:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e28cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.315417:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633292928 00000100:00100000:3.0:1787119489.315429:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633292928 00000100:00100000:3.0:1787119489.315695:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19440 00000100:00100000:3.0:1787119489.315706:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+109:32729:x1873929633292928:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.315762:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119489.315881:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e289e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a20 expref: 109 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.315895:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119489.315899:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119489.316099:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.316114:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.316123:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119489.316172:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976254 00000004:00010000:3.0:1787119489.316197:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082c9840a reply state 00000000d5e3deb6 transno 4294976255 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.316206:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119489.316294:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+111:32729:x1873929633292928:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 589us (1142us total) trans 4294976255 rc 0/0 00000100:00100000:3.0:1787119489.316302:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19440 00000020:00080000:3.0:1787119489.316307:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119489.322919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.322958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119489.323077:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.323091:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.323099:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.323108:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119489.323113:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.323121:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.323142:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119489.323146:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119489.323150:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.323157:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e28d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.323246:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633293056 00000100:00100000:0.0:1787119489.323259:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633293056 00002000:00010000:0.0:1787119489.323301:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (64395778->18446744073709551615) 00002000:00100000:0.0:1787119489.323306:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2d880 with x1873929633293056 ext(64395778->18446744073709551615) 00002000:00010000:0.0:1787119489.323318:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2d880. 00000100:00100000:0.0:1787119489.323350:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633293184 00000100:00100000:0.0:1787119489.323354:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633293184 00002000:00100000:0.0:1787119489.323377:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (44093440->44146687) req@ffff92a63eb2c380 x1873929633293184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.323387:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c380 with x1873929633293184 ext(44093440->44146687) 00002000:00010000:0.0:1787119489.323391:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2c380 00000100:00100000:0.0:1787119489.323420:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9355 00000100:00100000:3.0:1787119489.323742:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9356 00000100:00100000:3.0:1787119489.324026:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633293184:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.324712:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633293056:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119489.325117:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 56586156 -> 64395778 00002000:00010000:0.0:1787119489.325122:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:0.0:1787119489.325124:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119486 -> 1787119487 00002000:00010000:0.0:1787119489.325127:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:0.0:1787119489.325129:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1035 -> 1933 00000100:00100000:0.0:1787119489.325193:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633293056:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1763us (2283us total) trans 4294968820 rc 0/0 00000100:00100000:0.0:1787119489.325203:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9355 00002000:00010000:0.0:1787119489.325209:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (64395778->18446744073709551615) 00002000:00100000:0.0:1787119489.325213:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2d880 with x1873929633293056 ext(64395778->18446744073709551615) 00002000:00010000:0.0:1787119489.325220:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2d880. 00000100:00100000:3.0:1787119489.327402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.327881:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633293312 00000100:00100000:2.0:1787119489.327893:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633293312 00002000:00010000:2.0:1787119489.327940:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (11298734->18446744073709551615) 00002000:00100000:2.0:1787119489.327946:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2dc00 with x1873929633293312 ext(11298734->18446744073709551615) 00002000:00010000:2.0:1787119489.327960:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2dc00. 00000100:00100000:2.0:1787119489.328032:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9357 00000100:00100000:2.0:1787119489.328046:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633293312:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119489.328413:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 26311337 -> 11298734 00002000:00010000:2.0:1787119489.328418:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.328421:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.328423:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.328425:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1293 -> 1037 00000100:00100000:2.0:1787119489.328835:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633293312:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 791us (1442us total) trans 4294969048 rc 0/0 00000100:00100000:2.0:1787119489.328846:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9357 00002000:00010000:2.0:1787119489.328854:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (11298734->18446744073709551615) 00002000:00100000:2.0:1787119489.328858:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2dc00 with x1873929633293312 ext(11298734->18446744073709551615) 00002000:00010000:2.0:1787119489.328866:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2dc00. 00000100:00100000:3.0:1787119489.330956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.331171:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633293568 00000100:00100000:1.0:1787119489.331180:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633293568 00000100:00100000:1.0:1787119489.331240:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19441 00000100:00100000:1.0:1787119489.331250:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+110:32727:x1873929633293568:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119489.331305:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119489.331331:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e28c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a2e expref: 110 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.331349:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119489.331354:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119489.331847:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.331862:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.331872:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119489.331927:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976256 00000004:00010000:1.0:1787119489.331953:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8d07025 reply state 00000000a41363b3 transno 4294976257 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.331962:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119489.332149:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+112:32727:x1873929633293568:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 900us (1201us total) trans 4294976257 rc 0/0 00000100:00100000:1.0:1787119489.332158:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19441 00000020:00080000:1.0:1787119489.332163:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119489.332296:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633293184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8544us (9336us total) trans 0 rc 53248/53248 00000100:00100000:2.0:1787119489.332305:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9356 00002000:00100000:2.0:1787119489.332314:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (44093440->44146687) req@ffff92a63eb2c380 x1873929633293184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.332323:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c380 with x1873929633293184 ext(44093440->44146687) 00002000:00010000:2.0:1787119489.332328:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2c380 00000100:00100000:1.0:1787119489.333073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.333161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.333786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.333937:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633293696 00000100:00100000:2.0:1787119489.333946:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633293696 00000100:00100000:2.0:1787119489.333997:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633293824 00000100:00100000:2.0:1787119489.334001:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633293824 00000100:00100000:2.0:1787119489.334021:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19442 00000100:00100000:2.0:1787119489.334029:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+113:32724:x1873929633293696:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119489.334046:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119489.334067:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e28e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a35 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334138:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e28eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334151:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e28eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334162:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e28eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119489.334185:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 64395778 00000004:00200000:2.0:1787119489.334189:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119489.334204:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e28eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334228:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e28e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a35 expref: 115 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334244:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e28eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a35 expref: 114 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334253:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119489.334255:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119489.334259:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e561800, rc 0) 00000100:00100000:2.0:1787119489.334306:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+114:32724:x1873929633293696:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 277us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.334313:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19442 00000100:00100000:2.0:1787119489.334330:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19443 00000100:00100000:2.0:1787119489.334338:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+113:32729:x1873929633293824:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119489.334345:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119489.334353:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e28f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a3c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334387:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560c00/0xcaba3de8463e28f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334395:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560c00/0xcaba3de8463e28f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334401:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560c00/0xcaba3de8463e28f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119489.334416:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 11298734 00000004:00200000:2.0:1787119489.334419:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119489.334430:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560c00/0xcaba3de8463e28f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334916:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e28f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a3c expref: 115 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334934:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560c00/0xcaba3de8463e28f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a3c expref: 114 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.334943:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119489.334946:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119489.334948:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e560c00, rc 0) 00000100:00100000:2.0:1787119489.334977:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+114:32729:x1873929633293824:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 640us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.334987:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19443 00000100:00100000:0.0:1787119489.335418:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633294080 00000100:00100000:0.0:1787119489.335425:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633294080 00010000:00010000:3.0:1787119489.335754:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.335765:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.335884:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.335890:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e573000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.335895:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.335902:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.335915:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119489.335918:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.335921:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.335927:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573000/0xcaba3de8463e28dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.336035:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19444 00000100:00100000:2.0:1787119489.336048:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+113:32728:x1873929633294080:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119489.336091:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119489.336108:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e28ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a27 expref: 113 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.336118:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119489.336121:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119489.336313:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.336326:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.336335:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119489.336384:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976258 00000004:00010000:2.0:1787119489.336409:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c5d9af1 reply state 0000000063820de3 transno 4294976259 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.336417:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119489.336684:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+115:32728:x1873929633294080:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 638us (2898us total) trans 4294976259 rc 0/0 00000100:00100000:2.0:1787119489.336691:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19444 00000020:00080000:2.0:1787119489.336696:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119489.338899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.338974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.339103:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633294208 00000100:00100000:2.0:1787119489.339113:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633294208 00002000:00100000:2.0:1787119489.339157:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (39825408->39829503) req@ffff92a63dc06300 x1873929633294208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.339167:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc06300 with x1873929633294208 ext(39825408->39829503) 00002000:00010000:2.0:1787119489.339172:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc06300 00000100:00100000:2.0:1787119489.339199:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633294336 00000100:00100000:2.0:1787119489.339203:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633294336 00002000:00010000:2.0:1787119489.339216:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (26311337->18446744073709551615) 00002000:00100000:2.0:1787119489.339220:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05500 with x1873929633294336 ext(26311337->18446744073709551615) 00002000:00010000:2.0:1787119489.339231:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05500. 00000100:00100000:2.0:1787119489.339289:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9358 00000100:00100000:2.0:1787119489.339299:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633294208:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.339685:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633294208:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 386us (792us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.339693:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9358 00002000:00100000:2.0:1787119489.339700:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (39825408->39829503) req@ffff92a63dc06300 x1873929633294208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.339709:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc06300 with x1873929633294208 ext(39825408->39829503) 00002000:00010000:2.0:1787119489.339713:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc06300 00000100:00100000:2.0:1787119489.339730:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9359 00000100:00100000:2.0:1787119489.339737:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633294336:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119489.339926:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 6431679 -> 26311337 00002000:00010000:2.0:1787119489.339931:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.339933:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.339936:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.339939:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1293 -> 1293 00000100:00100000:2.0:1787119489.339967:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633294336:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 231us (994us total) trans 4294969049 rc 0/0 00000100:00100000:2.0:1787119489.339976:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9359 00002000:00010000:2.0:1787119489.339979:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (26311337->18446744073709551615) 00002000:00100000:2.0:1787119489.339981:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05500 with x1873929633294336 ext(26311337->18446744073709551615) 00002000:00010000:2.0:1787119489.339985:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05500. 00000100:00100000:2.0:1787119489.344844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119489.345099:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.345111:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.345118:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.345126:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e561400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119489.345130:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.345137:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.345160:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119489.345163:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119489.345169:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.345174:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2900 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.345308:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633294464 00000100:00100000:3.0:1787119489.345318:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633294464 00002000:00010000:3.0:1787119489.345353:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (56586156->18446744073709551615) 00002000:00100000:3.0:1787119489.345357:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633294464 ext(56586156->18446744073709551615) 00002000:00010000:3.0:1787119489.345369:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497a300. 00000100:00100000:3.0:1787119489.345578:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9360 00000100:00100000:3.0:1787119489.345593:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633294464:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119489.346034:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 11298734 -> 56586156 00002000:00010000:3.0:1787119489.346039:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119487 -> 1787119487 00002000:00010000:3.0:1787119489.346042:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:3.0:1787119489.346044:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119487 -> 1787119487 00002000:00010000:3.0:1787119489.346046:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1037 -> 1037 00000100:00100000:3.0:1787119489.346111:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633294464:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 522us (1278us total) trans 4294969050 rc 0/0 00000100:00100000:3.0:1787119489.346119:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9360 00002000:00010000:3.0:1787119489.346123:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (56586156->18446744073709551615) 00002000:00100000:3.0:1787119489.346126:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633294464 ext(56586156->18446744073709551615) 00002000:00010000:3.0:1787119489.346131:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497a300. 00000100:00100000:0.0:1787119489.346230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.347130:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633294592 00000100:00100000:3.0:1787119489.347140:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633294592 00000100:00100000:3.0:1787119489.347193:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19445 00000100:00100000:3.0:1787119489.347201:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+114:32727:x1873929633294592:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.347223:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.347244:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2907 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a43 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.347322:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e290e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.347337:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e290e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.347348:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e290e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119489.347373:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 26311337 00000004:00200000:3.0:1787119489.347378:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.347396:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e290e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.347421:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2907 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a43 expref: 116 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.347754:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e290e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a43 expref: 115 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.347764:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119489.347767:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.347771:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0c00, rc 0) 00000100:00100000:0.0:1787119489.348050:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+115:32727:x1873929633294592:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 848us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119489.348059:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19445 00000100:00100000:2.0:1787119489.348155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.348493:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633294720 00000100:00100000:0.0:1787119489.348501:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633294720 00002000:00100000:0.0:1787119489.348540:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (27275264->27328511) req@ffff92a634978e00 x1873929633294720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.348552:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634978e00 with x1873929633294720 ext(27275264->27328511) 00002000:00010000:0.0:1787119489.348558:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634978e00 00000100:00100000:0.0:1787119489.348590:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9361 00000100:00100000:0.0:1787119489.348597:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633294720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.353089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.353217:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633294848 00000100:00100000:3.0:1787119489.353227:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633294848 00002000:00100000:3.0:1787119489.353273:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (39829504->39833599) req@ffff92a634979f80 x1873929633294848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.353283:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979f80 with x1873929633294848 ext(39829504->39833599) 00002000:00010000:3.0:1787119489.353289:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634979f80 00000100:00100000:3.0:1787119489.353356:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9362 00000100:00100000:3.0:1787119489.353366:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633294848:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.353880:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633294848:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 512us (797us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.353891:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9362 00002000:00100000:3.0:1787119489.353899:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (39829504->39833599) req@ffff92a634979f80 x1873929633294848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.353916:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979f80 with x1873929633294848 ext(39829504->39833599) 00002000:00010000:3.0:1787119489.353921:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634979f80 00000100:00100000:2.0:1787119489.357022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.357253:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633294720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8652us (9095us total) trans 0 rc 53248/53248 00000100:00100000:0.0:1787119489.357266:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9361 00002000:00100000:0.0:1787119489.357279:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (27275264->27328511) req@ffff92a634978e00 x1873929633294720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.357296:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634978e00 with x1873929633294720 ext(27275264->27328511) 00002000:00010000:0.0:1787119489.357303:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634978e00 00000100:00100000:0.0:1787119489.357330:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633294976 00000100:00100000:0.0:1787119489.357338:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633294976 00002000:00100000:0.0:1787119489.357375:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (7548928->7553023) req@ffff92a634979500 x1873929633294976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.357384:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979500 with x1873929633294976 ext(7548928->7553023) 00002000:00010000:0.0:1787119489.357388:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979500 00000100:00100000:0.0:1787119489.357421:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9363 00000100:00100000:0.0:1787119489.357432:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633294976:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.358218:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633294976:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 783us (1200us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.358228:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9363 00002000:00100000:0.0:1787119489.358237:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (7548928->7553023) req@ffff92a634979500 x1873929633294976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.358246:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979500 with x1873929633294976 ext(7548928->7553023) 00002000:00010000:0.0:1787119489.358250:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979500 00000100:00100000:1.0:1787119489.360095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.360223:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633295104 00000100:00100000:3.0:1787119489.360234:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633295104 00000100:00100000:3.0:1787119489.360674:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19446 00000100:00100000:3.0:1787119489.360685:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+115:32728:x1873929633295104:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.360706:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.360726:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2915 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a4a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.360960:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e291c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.360975:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e291c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.360986:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e291c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119489.361011:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 56586156 00000004:00200000:3.0:1787119489.361015:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.361034:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e291c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.361059:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2915 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a4a expref: 117 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.361076:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e291c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a4a expref: 116 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.361085:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119489.361088:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.361091:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1400, rc 0) 00000100:00100000:3.0:1787119489.361155:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+116:32728:x1873929633295104:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 472us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.361162:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19446 00000100:00100000:1.0:1787119489.362260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.362344:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633295232 00000100:00100000:2.0:1787119489.362354:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633295232 00002000:00100000:2.0:1787119489.362398:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (1847296->1851391) req@ffff92a63dc05c00 x1873929633295232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.362410:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05c00 with x1873929633295232 ext(1847296->1851391) 00002000:00010000:2.0:1787119489.362416:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05c00 00000100:00100000:2.0:1787119489.362747:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9364 00000100:00100000:2.0:1787119489.362761:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633295232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.363061:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633295232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 302us (803us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.363070:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9364 00002000:00100000:2.0:1787119489.363079:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (1847296->1851391) req@ffff92a63dc05c00 x1873929633295232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.363094:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05c00 with x1873929633295232 ext(1847296->1851391) 00002000:00010000:2.0:1787119489.363099:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05c00 00000100:00100000:0.0:1787119489.368420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.368524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.368542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.368577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.368765:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633295616 00000100:00100000:2.0:1787119489.368776:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633295616 00002000:00100000:2.0:1787119489.368826:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (7553024->7557119) req@ffff92a508cff480 x1873929633295616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.368886:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff480 with x1873929633295616 ext(7553024->7557119) 00002000:00010000:2.0:1787119489.368892:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff480 00000100:00100000:2.0:1787119489.368920:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633295744 00000100:00100000:2.0:1787119489.368924:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633295744 00002000:00100000:2.0:1787119489.368943:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (39804928->39870463) req@ffff92a508cfd880 x1873929633295744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.368951:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd880 with x1873929633295744 ext(39804928->39870463) 00002000:00010000:2.0:1787119489.368955:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfd880 00000100:00100000:2.0:1787119489.368969:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633295872 00000100:00100000:2.0:1787119489.368972:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633295872 00002000:00100000:2.0:1787119489.368984:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (1851392->1855487) req@ffff92a508cfc700 x1873929633295872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.368992:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc700 with x1873929633295872 ext(1851392->1855487) 00002000:00010000:2.0:1787119489.368996:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfc700 00000100:00100000:2.0:1787119489.369011:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9365 00000100:00100000:2.0:1787119489.369020:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633295616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.369276:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633295616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 256us (750us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.369287:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9365 00002000:00100000:2.0:1787119489.369294:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (7553024->7557119) req@ffff92a508cff480 x1873929633295616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.369303:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff480 with x1873929633295616 ext(7553024->7557119) 00002000:00010000:2.0:1787119489.369306:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff480 00000100:00100000:2.0:1787119489.369323:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9366 00000100:00100000:2.0:1787119489.369329:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633295744:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.369697:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9367 00000100:00100000:2.0:1787119489.369705:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633295872:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.369814:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633295872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 109us (1235us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.369820:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9367 00002000:00100000:2.0:1787119489.369826:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (1851392->1855487) req@ffff92a508cfc700 x1873929633295872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.369834:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc700 with x1873929633295872 ext(1851392->1855487) 00002000:00010000:2.0:1787119489.369837:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfc700 00000100:00100000:1.0:1787119489.369923:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633295488 00000100:00100000:1.0:1787119489.369928:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633295488 00000100:00100000:1.0:1787119489.369966:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19447 00000100:00100000:1.0:1787119489.369973:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+116:32729:x1873929633295488:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119489.370010:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119489.370035:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560c00/0xcaba3de8463e28f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a3c expref: 116 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.370053:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119489.370058:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119489.370241:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.370254:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.370264:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119489.370315:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976260 00000004:00010000:1.0:1787119489.370340:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ffc013e reply state 00000000f5821219 transno 4294976261 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.370350:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119489.370405:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+118:32729:x1873929633295488:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 432us (1994us total) trans 4294976261 rc 0/0 00000100:00100000:1.0:1787119489.370411:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19447 00000020:00080000:1.0:1787119489.370415:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119489.370959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.371141:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633296000 00000100:00100000:3.0:1787119489.371148:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633296000 00002000:00100000:3.0:1787119489.371182:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (52510720->52514815) req@ffff92a508cfd500 x1873929633296000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.371193:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd500 with x1873929633296000 ext(52510720->52514815) 00002000:00010000:3.0:1787119489.371197:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd500 00000100:00100000:3.0:1787119489.371223:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9368 00000100:00100000:3.0:1787119489.371231:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633296000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.371894:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633296000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 662us (935us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.371903:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9368 00002000:00100000:3.0:1787119489.371910:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (52510720->52514815) req@ffff92a508cfd500 x1873929633296000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.371919:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd500 with x1873929633296000 ext(52510720->52514815) 00002000:00010000:3.0:1787119489.371923:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd500 00010000:00010000:3.0:1787119489.376158:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.376160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119489.376176:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.376183:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.376190:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e573a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.376195:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.376202:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.376220:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119489.376223:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.376227:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.376232:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573a00/0xcaba3de8463e2923 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.376235:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633296128 00000100:00100000:1.0:1787119489.376245:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633296128 00002000:00010000:1.0:1787119489.376281:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (56586156->18446744073709551615) 00002000:00100000:1.0:1787119489.376285:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497b100 with x1873929633296128 ext(56586156->18446744073709551615) 00002000:00010000:1.0:1787119489.376296:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497b100. 00000100:00100000:1.0:1787119489.376328:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9369 00000100:00100000:1.0:1787119489.376338:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633296128:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119489.376814:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 11298734 -> 56586156 00002000:00010000:1.0:1787119489.376818:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119487 -> 1787119488 00002000:00010000:1.0:1787119489.376820:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.376821:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119487 -> 1787119488 00002000:00010000:1.0:1787119489.376823:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1037 -> 1037 00000100:00100000:1.0:1787119489.376874:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633296128:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 538us (723us total) trans 4294969051 rc 0/0 00000100:00100000:1.0:1787119489.376883:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9369 00002000:00010000:1.0:1787119489.376887:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (56586156->18446744073709551615) 00002000:00100000:1.0:1787119489.376890:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497b100 with x1873929633296128 ext(56586156->18446744073709551615) 00002000:00010000:1.0:1787119489.376894:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497b100. 00000100:00100000:2.0:1787119489.379316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.379420:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633296256 00000100:00100000:0.0:1787119489.379429:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633296256 00002000:00100000:0.0:1787119489.379507:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (11825152->11829247) req@ffff92a634978700 x1873929633296256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.379519:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634978700 with x1873929633296256 ext(11825152->11829247) 00002000:00010000:0.0:1787119489.379524:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634978700 00000100:00100000:0.0:1787119489.379546:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9370 00000100:00100000:0.0:1787119489.379555:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633296256:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.379798:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633296256:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 244us (491us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.379807:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9370 00002000:00100000:0.0:1787119489.379813:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (11825152->11829247) req@ffff92a634978700 x1873929633296256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.379822:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634978700 with x1873929633296256 ext(11825152->11829247) 00002000:00010000:0.0:1787119489.379825:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634978700 00000100:00100000:3.0:1787119489.380345:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633295744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11014us (11799us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.380353:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9366 00002000:00100000:3.0:1787119489.380361:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (39804928->39870463) req@ffff92a508cfd880 x1873929633295744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.380369:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd880 with x1873929633295744 ext(39804928->39870463) 00002000:00010000:3.0:1787119489.380373:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfd880 00000100:00100000:1.0:1787119489.380482:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.380639:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633296384 00000100:00100000:3.0:1787119489.380644:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633296384 00000100:00100000:3.0:1787119489.380686:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19448 00000100:00100000:3.0:1787119489.380694:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+117:32729:x1873929633296384:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.380709:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.380727:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e292a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a51 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.380804:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2931 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.380818:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.380828:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119489.380853:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 56586156 00000004:00200000:3.0:1787119489.380858:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.380874:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.380941:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e292a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a51 expref: 119 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.380958:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a51 expref: 118 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.380965:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119489.380968:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.380972:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00000100:00100000:3.0:1787119489.381075:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+118:32729:x1873929633296384:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 382us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.381082:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19448 00000100:00100000:2.0:1787119489.385006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.385081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.385199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.385223:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633296640 00000100:00100000:3.0:1787119489.385234:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633296640 00000100:00100000:0.0:1787119489.385237:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633296512 00000100:00100000:0.0:1787119489.385240:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633296512 00002000:00100000:3.0:1787119489.385280:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (52514816->52518911) req@ffff92a63497b480 x1873929633296640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.385280:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (1826816->1892351) req@ffff92a634039500 x1873929633296512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.385292:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497b480 with x1873929633296640 ext(52514816->52518911) 00002000:00100000:0.0:1787119489.385292:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039500 with x1873929633296512 ext(1826816->1892351) 00002000:00010000:3.0:1787119489.385298:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497b480 00002000:00010000:0.0:1787119489.385298:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634039500 00000100:00100000:3.0:1787119489.385369:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9371 00000100:00100000:3.0:1787119489.385378:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633296640:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.385648:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633296640:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 270us (650us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.385668:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9371 00002000:00100000:3.0:1787119489.385675:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (52514816->52518911) req@ffff92a63497b480 x1873929633296640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.385683:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497b480 with x1873929633296640 ext(52514816->52518911) 00002000:00010000:3.0:1787119489.385687:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497b480 00000100:00100000:0.0:1787119489.385701:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9372 00000100:00100000:0.0:1787119489.385709:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633296512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.386040:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633296768 00000100:00100000:0.0:1787119489.386044:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633296768 00000100:00100000:2.0:1787119489.386063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:0.0:1787119489.386063:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (11829248->11833343) req@ffff92a63403a680 x1873929633296768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.386071:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a680 with x1873929633296768 ext(11829248->11833343) 00002000:00010000:0.0:1787119489.386075:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403a680 00000100:00100000:0.0:1787119489.386125:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633296896 00000100:00100000:0.0:1787119489.386129:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633296896 00002000:00100000:0.0:1787119489.386143:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (52510720->52514815) req@ffff92a63403ad80 x1873929633296896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.386151:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403ad80 with x1873929633296896 ext(52510720->52514815) 00002000:00010000:0.0:1787119489.386154:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403ad80 00000100:00100000:0.0:1787119489.386169:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9373 00000100:00100000:0.0:1787119489.386176:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633296768:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.386941:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9374 00000100:00100000:1.0:1787119489.386955:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633296896:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.388137:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633296768:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1953us (2929us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.388148:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9373 00002000:00100000:0.0:1787119489.388163:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (11829248->11833343) req@ffff92a63403a680 x1873929633296768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.388173:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a680 with x1873929633296768 ext(11829248->11833343) 00002000:00010000:0.0:1787119489.388179:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403a680 00000100:00100000:1.0:1787119489.388413:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633296896:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1461us (2348us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.388421:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9374 00002000:00100000:1.0:1787119489.388427:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (52510720->52514815) req@ffff92a63403ad80 x1873929633296896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.388456:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403ad80 with x1873929633296896 ext(52510720->52514815) 00002000:00010000:1.0:1787119489.388460:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403ad80 00000100:00100000:2.0:1787119489.388980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.389051:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633297024 00000100:00100000:3.0:1787119489.389061:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633297024 00002000:00100000:3.0:1787119489.389099:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (7548928->41365503) req@ffff92a63403b800 x1873929633297024/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.389109:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633297024 ext(7548928->41365503) 00002000:00010000:3.0:1787119489.389113:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403b800 00000100:00100000:3.0:1787119489.389838:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9375 00000100:00100000:0.0:1787119489.389904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.390001:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633297152 00000100:00100000:2.0:1787119489.390007:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633297152 00002000:00100000:2.0:1787119489.390032:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (52490240->52555775) req@ffff92a508cfe680 x1873929633297152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.390041:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfe680 with x1873929633297152 ext(52490240->52555775) 00002000:00010000:2.0:1787119489.390045:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfe680 00000100:00100000:2.0:1787119489.390071:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9376 00000100:00100000:2.0:1787119489.390079:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633297152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.390903:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633297024:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119489.392810:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633296512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7090us (7718us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119489.392824:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9372 00002000:00100000:2.0:1787119489.392836:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (1826816->1892351) req@ffff92a634039500 x1873929633296512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.392847:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039500 with x1873929633296512 ext(1826816->1892351) 00002000:00010000:2.0:1787119489.392854:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634039500 00000100:00100000:1.0:1787119489.399374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.399399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.399466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.400281:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633297024:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9523us (11300us total) trans 4294968821 rc 0/0 00000100:00100000:2.0:1787119489.400295:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9375 00002000:00100000:2.0:1787119489.400308:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (7548928->41365503) req@ffff92a63403b800 x1873929633297024/t4294968821(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/456 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.400318:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633297024 ext(7548928->41365503) 00002000:00010000:2.0:1787119489.400324:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403b800 00000100:00100000:2.0:1787119489.400349:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633297280 00000100:00100000:2.0:1787119489.400356:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633297280 00002000:00100000:2.0:1787119489.400385:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (52514816->52518911) req@ffff92a63dc07b80 x1873929633297280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.400393:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07b80 with x1873929633297280 ext(52514816->52518911) 00002000:00010000:2.0:1787119489.400397:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07b80 00000100:00100000:2.0:1787119489.400420:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633297408 00000100:00100000:2.0:1787119489.400424:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633297408 00000100:00100000:0.0:1787119489.400727:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633297536 00000100:00100000:0.0:1787119489.400732:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633297536 00002000:00100000:0.0:1787119489.400764:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (1892352->1929215) req@ffff92a5066dc000 x1873929633297536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.400780:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633297536 ext(1892352->1929215) 00002000:00010000:0.0:1787119489.400784:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dc000 00000100:00100000:0.0:1787119489.400806:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9377 00000100:00100000:0.0:1787119489.400815:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633297280:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.400930:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9378 00000100:00100000:1.0:1787119489.400939:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633297536:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.401009:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633297280:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 194us (1644us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.401016:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9377 00002000:00100000:0.0:1787119489.401022:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (52514816->52518911) req@ffff92a63dc07b80 x1873929633297280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.401029:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07b80 with x1873929633297280 ext(52514816->52518911) 00002000:00010000:0.0:1787119489.401032:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07b80 00000100:00100000:3.0:1787119489.401523:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633297152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11442us (11615us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.401531:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9376 00002000:00100000:3.0:1787119489.401537:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (52490240->52555775) req@ffff92a508cfe680 x1873929633297152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.401546:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfe680 with x1873929633297152 ext(52490240->52555775) 00002000:00010000:3.0:1787119489.401549:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfe680 00002000:00100000:2.0:1787119489.401923:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (11804672->11870207) req@ffff92a63dc05880 x1873929633297408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.401932:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05880 with x1873929633297408 ext(11804672->11870207) 00002000:00010000:2.0:1787119489.401936:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05880 00000100:00100000:2.0:1787119489.401958:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9379 00000100:00100000:2.0:1787119489.401968:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633297408:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.405178:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633297536:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4230us (5702us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119489.405192:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9378 00002000:00100000:3.0:1787119489.405203:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (1892352->1929215) req@ffff92a5066dc000 x1873929633297536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.405213:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633297536 ext(1892352->1929215) 00002000:00010000:3.0:1787119489.405220:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dc000 00000100:00100000:2.0:1787119489.406084:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633297408:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4113us (6678us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119489.406094:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9379 00002000:00100000:2.0:1787119489.406102:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (11804672->11870207) req@ffff92a63dc05880 x1873929633297408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.406112:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05880 with x1873929633297408 ext(11804672->11870207) 00002000:00010000:2.0:1787119489.406116:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05880 00000100:00100000:3.0:1787119489.408155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.409577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.409619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.409673:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633297792 00000100:00100000:2.0:1787119489.409683:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633297792 00000100:00100000:2.0:1787119489.409741:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4988 00000100:00100000:2.0:1787119489.409759:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633297792:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119489.410477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.410698:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633298176 00000100:00100000:2.0:1787119489.410705:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633298176 00000100:00100000:2.0:1787119489.410743:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19449 00000100:00100000:2.0:1787119489.410750:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+118:32724:x1873929633298176:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119489.410861:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119489.410888:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e28eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a35 expref: 118 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.410906:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119489.410911:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119489.411102:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.411116:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.411125:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119489.411173:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976262 00000004:00010000:2.0:1787119489.411198:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd078409 reply state 000000000ec08387 transno 4294976263 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.411208:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119489.411297:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+120:32724:x1873929633298176:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 546us (821us total) trans 4294976263 rc 0/0 00000100:00100000:2.0:1787119489.411304:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19449 00000020:00080000:2.0:1787119489.411309:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119489.412548:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633297664 00000100:00100000:0.0:1787119489.412560:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633297664 00002000:00100000:0.0:1787119489.412608:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (52490240->52555775) req@ffff92a63eb2d180 x1873929633297664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.412619:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2d180 with x1873929633297664 ext(52490240->52555775) 00002000:00010000:0.0:1787119489.412624:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2d180 00000100:00100000:0.0:1787119489.412649:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633297920 00000100:00100000:0.0:1787119489.412653:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633297920 00002000:00100000:0.0:1787119489.412668:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (23564288->23568383) req@ffff92a5066dd880 x1873929633297920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.412676:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd880 with x1873929633297920 ext(23564288->23568383) 00002000:00010000:0.0:1787119489.412679:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd880 00000100:00100000:0.0:1787119489.412694:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9380 00000100:00100000:0.0:1787119489.412700:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633297664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.412907:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9381 00000100:00100000:0.0:1787119489.412913:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633297920:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.413020:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633297920:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 105us (3400us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.413027:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9381 00002000:00100000:0.0:1787119489.413033:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (23564288->23568383) req@ffff92a5066dd880 x1873929633297920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.413042:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd880 with x1873929633297920 ext(23564288->23568383) 00002000:00010000:0.0:1787119489.413046:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd880 00000100:00100000:3.0:1787119489.414901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.415678:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633298304 00000100:00100000:2.0:1787119489.415689:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633298304 00002000:00100000:2.0:1787119489.415735:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (29077504->29081599) req@ffff92a63eb2f100 x1873929633298304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.415747:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2f100 with x1873929633298304 ext(29077504->29081599) 00002000:00010000:2.0:1787119489.415752:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2f100 00000100:00100000:2.0:1787119489.415778:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9382 00000100:00100000:2.0:1787119489.415786:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633298304:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.415997:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633298304:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 210us (1102us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.416005:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9382 00002000:00100000:2.0:1787119489.416012:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (29077504->29081599) req@ffff92a63eb2f100 x1873929633298304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.416020:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2f100 with x1873929633298304 ext(29077504->29081599) 00002000:00010000:2.0:1787119489.416024:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2f100 00010000:00010000:3.0:1787119489.417574:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.417590:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.417598:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.417606:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e561000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.417611:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.417620:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.417638:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119489.417641:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.417646:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.417651:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2938 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.419665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.419695:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633298432 00000100:00100000:2.0:1787119489.419704:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633298432 00002000:00010000:2.0:1787119489.419738:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (9936520->18446744073709551615) 00002000:00100000:2.0:1787119489.419742:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633298432 ext(9936520->18446744073709551615) 00002000:00010000:2.0:1787119489.419754:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634039180. 00000100:00100000:2.0:1787119489.419780:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9383 00000100:00100000:2.0:1787119489.419789:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633298432:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119489.420111:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 64395778 -> 9936520 00002000:00010000:2.0:1787119489.420115:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119487 -> 1787119488 00002000:00010000:2.0:1787119489.420118:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.420120:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119487 -> 1787119488 00002000:00010000:2.0:1787119489.420122:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119489.420175:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633298432:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 387us (519us total) trans 4294968822 rc 0/0 00000100:00100000:2.0:1787119489.420183:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9383 00002000:00010000:2.0:1787119489.420188:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (9936520->18446744073709551615) 00002000:00100000:2.0:1787119489.420190:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633298432 ext(9936520->18446744073709551615) 00002000:00010000:2.0:1787119489.420195:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634039180. 00000100:00100000:2.0:1787119489.420878:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633297664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8173us (12728us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119489.420887:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9380 00002000:00100000:2.0:1787119489.420897:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (52490240->52555775) req@ffff92a63eb2d180 x1873929633297664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.420908:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2d180 with x1873929633297664 ext(52490240->52555775) 00002000:00010000:2.0:1787119489.420913:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2d180 00000100:00100000:0.0:1787119489.423202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.423683:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633298560 00000100:00100000:1.0:1787119489.423694:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633298560 00002000:00100000:1.0:1787119489.423742:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (23568384->23572479) req@ffff92a508cfd180 x1873929633298560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.423753:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd180 with x1873929633298560 ext(23568384->23572479) 00002000:00010000:1.0:1787119489.423759:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd180 00000100:00100000:0.0:1787119489.424023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.426981:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633298688 00000100:00100000:1.0:1787119489.426995:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633298688 00002000:00100000:1.0:1787119489.427123:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (29081600->29085695) req@ffff92a508cff100 x1873929633298688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.427135:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633298688 ext(29081600->29085695) 00002000:00010000:1.0:1787119489.427140:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff100 00000100:00100000:1.0:1787119489.427173:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9384 00000100:00100000:1.0:1787119489.427182:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633298560:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.427419:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633298560:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 238us (4226us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.427426:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9384 00002000:00100000:1.0:1787119489.427457:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (23568384->23572479) req@ffff92a508cfd180 x1873929633298560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.427465:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd180 with x1873929633298560 ext(23568384->23572479) 00002000:00010000:1.0:1787119489.427478:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd180 00000100:00100000:1.0:1787119489.427497:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9385 00000100:00100000:1.0:1787119489.427504:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633298688:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.427605:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633298688:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 101us (3581us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.427612:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9385 00002000:00100000:1.0:1787119489.427618:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (29081600->29085695) req@ffff92a508cff100 x1873929633298688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.427626:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633298688 ext(29081600->29085695) 00002000:00010000:1.0:1787119489.427630:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff100 00000100:00100000:0.0:1787119489.429227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.431366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.431381:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633298816 00000100:00100000:2.0:1787119489.431391:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633298816 00000100:00100000:1.0:1787119489.431483:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633298944 00000100:00100000:1.0:1787119489.431488:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633298944 00000100:00100000:1.0:1787119489.431536:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19450 00000100:00100000:1.0:1787119489.431545:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+119:32724:x1873929633298944:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119489.431572:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119489.431592:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e293f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a58 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.431691:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573400/0xcaba3de8463e2946 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.431707:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573400/0xcaba3de8463e2946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.431718:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573400/0xcaba3de8463e2946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119489.431743:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 9936520 00000004:00200000:1.0:1787119489.431747:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119489.431777:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573400/0xcaba3de8463e2946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.431804:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e293f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a58 expref: 121 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.431820:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573400/0xcaba3de8463e2946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a58 expref: 120 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.431828:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119489.431831:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119489.431836:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e573400, rc 0) 00000100:00100000:1.0:1787119489.431949:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+120:32724:x1873929633298944:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 404us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.431956:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19450 00002000:00100000:2.0:1787119489.435088:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (29077504->29081599) req@ffff92a508cffb80 x1873929633298816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.435106:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cffb80 with x1873929633298816 ext(29077504->29081599) 00002000:00010000:2.0:1787119489.435114:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cffb80 00000100:00100000:2.0:1787119489.435142:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9386 00000100:00100000:2.0:1787119489.435169:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633298816:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.435385:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633298816:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 234us (6165us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.435393:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9386 00002000:00100000:2.0:1787119489.435401:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (29077504->29081599) req@ffff92a508cffb80 x1873929633298816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.435409:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cffb80 with x1873929633298816 ext(29077504->29081599) 00002000:00010000:2.0:1787119489.435413:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cffb80 00000100:00100000:1.0:1787119489.443650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.443685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.443717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.443979:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633299200 00000100:00100000:1.0:1787119489.443992:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633299200 00002000:00100000:1.0:1787119489.444047:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (23543808->23609343) req@ffff92a5066dfb80 x1873929633299200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.444059:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dfb80 with x1873929633299200 ext(23543808->23609343) 00002000:00010000:1.0:1787119489.444065:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dfb80 00000100:00100000:1.0:1787119489.444093:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633299072 00000100:00100000:1.0:1787119489.444096:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633299072 00002000:00100000:1.0:1787119489.444115:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (29057024->29122559) req@ffff92a5066ddc00 x1873929633299072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.444126:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddc00 with x1873929633299072 ext(29057024->29122559) 00002000:00010000:1.0:1787119489.444130:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ddc00 00000100:00100000:1.0:1787119489.444142:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633299328 00000100:00100000:1.0:1787119489.444148:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633299328 00002000:00100000:1.0:1787119489.444162:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (6242304->6295551) req@ffff92a5066df100 x1873929633299328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.444173:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df100 with x1873929633299328 ext(6242304->6295551) 00002000:00010000:1.0:1787119489.444177:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066df100 00000100:00100000:1.0:1787119489.444196:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9387 00000100:00100000:1.0:1787119489.444205:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633299200:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.445367:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9388 00000100:00100000:1.0:1787119489.445380:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633299072:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.446049:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9389 00000100:00100000:1.0:1787119489.446060:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633299328:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.447350:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.447843:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633299456 00000100:00100000:0.0:1787119489.447853:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633299456 00002000:00100000:0.0:1787119489.447895:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (29081600->29085695) req@ffff92a63403a300 x1873929633299456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.447905:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a300 with x1873929633299456 ext(29081600->29085695) 00002000:00010000:0.0:1787119489.447911:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403a300 00000100:00100000:0.0:1787119489.447937:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9390 00000100:00100000:0.0:1787119489.447945:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2374:x1873929633299456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.448156:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2374:x1873929633299456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 211us (811us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.448164:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9390 00002000:00100000:0.0:1787119489.448170:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (29081600->29085695) req@ffff92a63403a300 x1873929633299456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.448178:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a300 with x1873929633299456 ext(29081600->29085695) 00002000:00010000:0.0:1787119489.448181:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403a300 00000100:00100000:3.0:1787119489.451959:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633299072:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6572us (8262us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.451974:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9388 00002000:00100000:3.0:1787119489.451987:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (29057024->29122559) req@ffff92a5066ddc00 x1873929633299072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.451997:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddc00 with x1873929633299072 ext(29057024->29122559) 00002000:00010000:3.0:1787119489.452003:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ddc00 00000100:00100000:3.0:1787119489.453712:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633299328:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7644us (9984us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1787119489.453724:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9389 00002000:00100000:3.0:1787119489.453734:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (6242304->6295551) req@ffff92a5066df100 x1873929633299328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.453745:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df100 with x1873929633299328 ext(6242304->6295551) 00002000:00010000:3.0:1787119489.453760:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066df100 00000100:00100000:1.0:1787119489.454977:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633299200:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10764us (11328us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.454988:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9387 00002000:00100000:1.0:1787119489.454998:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (23543808->23609343) req@ffff92a5066dfb80 x1873929633299200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.455009:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dfb80 with x1873929633299200 ext(23543808->23609343) 00002000:00010000:1.0:1787119489.455013:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dfb80 00000001:00080000:1.0:1787119489.457530:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968820 is committed 00000001:00080000:1.0:1787119489.457543:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968821 is committed 00000100:00100000:2.0:1787119489.457706:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633297792:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 47858us (48048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.457720:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4988 00000100:00100000:0.0:1787119489.458122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.458856:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633299712 00000100:00100000:2.0:1787119489.458868:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633299712 00000100:00100000:2.0:1787119489.458935:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19451 00000100:00100000:2.0:1787119489.458944:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+120:32727:x1873929633299712:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119489.459003:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119489.459031:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e290e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a43 expref: 120 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.459052:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119489.459057:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119489.459256:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.459269:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.459297:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119489.459348:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976264 00000004:00010000:2.0:1787119489.459374:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b5feabe reply state 0000000022eef116 transno 4294976265 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.459383:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119489.460344:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+122:32727:x1873929633299712:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1393us (2916us total) trans 4294976265 rc 0/0 00000100:00100000:2.0:1787119489.460354:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19451 00000020:00080000:2.0:1787119489.460359:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119489.462352:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.462424:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.462921:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633299840 00000100:00100000:2.0:1787119489.462932:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633299840 00002000:00100000:2.0:1787119489.462983:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (3031040->3035135) req@ffff92a5066ded80 x1873929633299840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.462995:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633299840 ext(3031040->3035135) 00002000:00010000:2.0:1787119489.463001:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066ded80 00000100:00100000:2.0:1787119489.463024:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633299968 00000100:00100000:2.0:1787119489.463027:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633299968 00002000:00100000:2.0:1787119489.463041:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (29057024->29122559) req@ffff92a5066de680 x1873929633299968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787119489.463250:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9391 00000100:00100000:1.0:1787119489.463262:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633299840:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.463788:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633299840:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 526us (1442us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.463797:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9391 00002000:00100000:1.0:1787119489.463804:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (3031040->3035135) req@ffff92a5066ded80 x1873929633299840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.463811:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633299840 ext(3031040->3035135) 00002000:00010000:1.0:1787119489.463815:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066ded80 00002000:00100000:2.0:1787119489.463878:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de680 with x1873929633299968 ext(29057024->29122559) 00002000:00010000:2.0:1787119489.463883:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de680 00000100:00100000:2.0:1787119489.463912:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9392 00000100:00100000:2.0:1787119489.463921:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633299968:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.464259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119489.464350:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.464360:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.464367:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.464374:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e560a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119489.464378:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.464385:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.464401:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119489.464404:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119489.464410:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.464416:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e294d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.464581:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633300096 00000100:00100000:2.0:1787119489.464587:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633300096 00002000:00100000:2.0:1787119489.464621:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (21061632->21069823) req@ffff92a508cfc380 x1873929633300096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.464631:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc380 with x1873929633300096 ext(21061632->21069823) 00002000:00010000:2.0:1787119489.464636:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc380 00000100:00100000:2.0:1787119489.464654:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9393 00000100:00100000:2.0:1787119489.464661:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633300096:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.464812:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633300096:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 150us (554us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119489.464819:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9393 00002000:00100000:2.0:1787119489.464824:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (21061632->21069823) req@ffff92a508cfc380 x1873929633300096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/8632 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.464831:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc380 with x1873929633300096 ext(21061632->21069823) 00002000:00010000:2.0:1787119489.464834:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc380 00000100:00100000:1.0:1787119489.466072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.466159:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633300224 00000100:00100000:2.0:1787119489.466168:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633300224 00002000:00010000:2.0:1787119489.466193:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (11298734->18446744073709551615) 00002000:00100000:2.0:1787119489.466197:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc380 with x1873929633300224 ext(11298734->18446744073709551615) 00002000:00010000:2.0:1787119489.466208:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dc380. 00000100:00100000:2.0:1787119489.466241:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9394 00000100:00100000:2.0:1787119489.466249:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633300224:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119489.466585:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 26311337 -> 11298734 00002000:00010000:2.0:1787119489.466589:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119487 -> 1787119488 00002000:00010000:2.0:1787119489.466592:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.466595:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119487 -> 1787119488 00002000:00010000:2.0:1787119489.466597:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1293 -> 1293 00000100:00100000:2.0:1787119489.466710:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633300224:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 461us (645us total) trans 4294969052 rc 0/0 00000100:00100000:2.0:1787119489.466718:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9394 00002000:00010000:2.0:1787119489.466722:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (11298734->18446744073709551615) 00002000:00100000:2.0:1787119489.466725:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc380 with x1873929633300224 ext(11298734->18446744073709551615) 00002000:00010000:2.0:1787119489.466729:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dc380. 00000100:00100000:1.0:1787119489.467071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.467175:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633300352 00000100:00100000:3.0:1787119489.467181:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633300352 00002000:00100000:3.0:1787119489.467214:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (28184576->28188671) req@ffff92a5066dd180 x1873929633300352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.467740:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633300352 ext(28184576->28188671) 00002000:00010000:3.0:1787119489.467747:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:2.0:1787119489.467978:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9395 00000100:00100000:2.0:1787119489.467993:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633300352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.468238:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633300352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 251us (1166us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.468245:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9395 00002000:00100000:2.0:1787119489.468251:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (28184576->28188671) req@ffff92a5066dd180 x1873929633300352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.468260:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633300352 ext(28184576->28188671) 00002000:00010000:2.0:1787119489.468264:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:2.0:1787119489.469021:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633299968:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5099us (6593us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119489.469029:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9392 00002000:00100000:2.0:1787119489.469037:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (29057024->29122559) req@ffff92a5066de680 x1873929633299968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.469047:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de680 with x1873929633299968 ext(29057024->29122559) 00002000:00010000:2.0:1787119489.469051:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de680 00000100:00100000:3.0:1787119489.472774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.472817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.472966:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633300608 00000100:00100000:2.0:1787119489.472977:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633300608 00002000:00100000:2.0:1787119489.473025:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (41295872->41299967) req@ffff92a63eb2c000 x1873929633300608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.473038:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c000 with x1873929633300608 ext(41295872->41299967) 00002000:00010000:2.0:1787119489.473043:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2c000 00000100:00100000:2.0:1787119489.473072:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633300480 00000100:00100000:2.0:1787119489.473076:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633300480 00002000:00100000:2.0:1787119489.473092:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (28188672->28192767) req@ffff92a63eb2d500 x1873929633300480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.473101:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2d500 with x1873929633300480 ext(28188672->28192767) 00002000:00010000:2.0:1787119489.473105:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2d500 00000100:00100000:2.0:1787119489.473134:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9396 00000100:00100000:2.0:1787119489.473143:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633300608:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.473398:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633300608:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 254us (643us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.473406:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9396 00002000:00100000:2.0:1787119489.473413:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (41295872->41299967) req@ffff92a63eb2c000 x1873929633300608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.473422:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c000 with x1873929633300608 ext(41295872->41299967) 00002000:00010000:2.0:1787119489.473466:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2c000 00000100:00100000:1.0:1787119489.473640:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9397 00000100:00100000:1.0:1787119489.473651:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633300480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.473782:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633300480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 134us (964us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.473789:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9397 00002000:00100000:1.0:1787119489.473795:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (28188672->28192767) req@ffff92a63eb2d500 x1873929633300480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.473803:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2d500 with x1873929633300480 ext(28188672->28192767) 00002000:00010000:1.0:1787119489.473807:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2d500 00000100:00100000:0.0:1787119489.476078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.476122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.476214:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633300736 00000100:00100000:2.0:1787119489.476224:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633300736 00000100:00100000:2.0:1787119489.476280:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19452 00000100:00100000:2.0:1787119489.476290:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+121:32727:x1873929633300736:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119489.476312:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119489.476332:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2954 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a5f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.476412:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e295b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.476426:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e295b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.476468:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e295b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119489.476773:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 11298734 00000004:00200000:2.0:1787119489.476778:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119489.476798:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e295b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.476826:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2954 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a5f expref: 123 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.476844:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e295b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a5f expref: 122 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.476853:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119489.476856:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119489.476860:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e560a00, rc 0) 00000100:00100000:2.0:1787119489.476921:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+122:32727:x1873929633300736:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 632us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.476932:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19452 00000100:00100000:1.0:1787119489.477351:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633300864 00000100:00100000:1.0:1787119489.477357:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633300864 00002000:00100000:1.0:1787119489.477392:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (3035136->3039231) req@ffff92a511f54700 x1873929633300864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.477403:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54700 with x1873929633300864 ext(3035136->3039231) 00002000:00010000:1.0:1787119489.477407:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54700 00000100:00100000:1.0:1787119489.477763:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9398 00000100:00100000:1.0:1787119489.477773:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633300864:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.478012:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633300864:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 239us (1888us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.478019:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9398 00002000:00100000:1.0:1787119489.478025:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (3035136->3039231) req@ffff92a511f54700 x1873929633300864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.478033:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54700 with x1873929633300864 ext(3035136->3039231) 00002000:00010000:1.0:1787119489.478037:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54700 00000100:00100000:3.0:1787119489.478837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.479072:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633300992 00000100:00100000:0.0:1787119489.479080:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633300992 00002000:00100000:0.0:1787119489.479114:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (21061632->21069823) req@ffff92a63eb2ea00 x1873929633300992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.479124:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ea00 with x1873929633300992 ext(21061632->21069823) 00002000:00010000:0.0:1787119489.479129:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ea00 00000100:00100000:0.0:1787119489.479158:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9399 00000100:00100000:0.0:1787119489.479166:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633300992:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.479346:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633300992:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 180us (513us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1787119489.479353:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9399 00002000:00100000:0.0:1787119489.479359:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (21061632->21069823) req@ffff92a63eb2ea00 x1873929633300992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/8632 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.479367:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ea00 with x1873929633300992 ext(21061632->21069823) 00002000:00010000:0.0:1787119489.479371:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ea00 00000100:00100000:3.0:1787119489.480247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.480321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.480390:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633301120 00000100:00100000:0.0:1787119489.480397:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633301120 00002000:00100000:0.0:1787119489.480424:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (28164096->28229631) req@ffff92a63eb2e300 x1873929633301120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.480456:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2e300 with x1873929633301120 ext(28164096->28229631) 00002000:00010000:0.0:1787119489.480461:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2e300 00000100:00100000:0.0:1787119489.480548:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633301248 00000100:00100000:0.0:1787119489.480553:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633301248 00002000:00100000:0.0:1787119489.480581:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (41361408->41365503) req@ffff92a63eb2ce00 x1873929633301248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.480590:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ce00 with x1873929633301248 ext(41361408->41365503) 00002000:00010000:0.0:1787119489.480594:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ce00 00000100:00100000:0.0:1787119489.480609:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9400 00000100:00100000:0.0:1787119489.480692:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633301120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.481027:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9401 00000100:00100000:1.0:1787119489.481037:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633301248:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.481161:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633301248:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 126us (840us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.481169:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9401 00002000:00100000:1.0:1787119489.481175:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (41361408->41365503) req@ffff92a63eb2ce00 x1873929633301248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.481184:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ce00 with x1873929633301248 ext(41361408->41365503) 00002000:00010000:1.0:1787119489.481188:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ce00 00000100:00100000:2.0:1787119489.485355:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633301120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4654us (5099us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119489.485370:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9400 00002000:00100000:2.0:1787119489.485385:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (28164096->28229631) req@ffff92a63eb2e300 x1873929633301120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.485396:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2e300 with x1873929633301120 ext(28164096->28229631) 00002000:00010000:2.0:1787119489.485403:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2e300 00000100:00100000:3.0:1787119489.490595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.491006:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633301376 00000100:00100000:1.0:1787119489.491016:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633301376 00002000:00100000:1.0:1787119489.491074:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (3010560->3076095) req@ffff92a63eb2ed80 x1873929633301376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.491086:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ed80 with x1873929633301376 ext(3010560->3076095) 00002000:00010000:1.0:1787119489.491092:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ed80 00000100:00100000:1.0:1787119489.491128:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9402 00000100:00100000:1.0:1787119489.491138:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633301376:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.501559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.501715:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633301504 00000100:00100000:2.0:1787119489.501725:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633301504 00002000:00100000:2.0:1787119489.501773:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (41295872->41299967) req@ffff92a5066dd500 x1873929633301504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.501785:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633301504 ext(41295872->41299967) 00000100:00100000:1.0:1787119489.501789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00010000:2.0:1787119489.501791:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd500 00000100:00100000:1.0:1787119489.501870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.502316:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633301632 00000100:00100000:2.0:1787119489.502321:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633301632 00002000:00100000:2.0:1787119489.502339:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (44093440->44146687) req@ffff92a5066df480 x1873929633301632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.502348:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633301632 ext(44093440->44146687) 00000100:00100000:1.0:1787119489.502351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00010000:2.0:1787119489.502352:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:2.0:1787119489.502366:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633301760 00000100:00100000:2.0:1787119489.502369:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633301760 00002000:00100000:2.0:1787119489.502386:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (28229632->28266495) req@ffff92a5066de300 x1873929633301760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.502399:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de300 with x1873929633301760 ext(28229632->28266495) 00002000:00010000:2.0:1787119489.502402:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066de300 00000100:00100000:2.0:1787119489.502417:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9403 00000100:00100000:2.0:1787119489.502425:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633301504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.502509:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633301376:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11372us (11924us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.502518:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9402 00002000:00100000:1.0:1787119489.502525:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (3010560->3076095) req@ffff92a63eb2ed80 x1873929633301376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.502533:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ed80 with x1873929633301376 ext(3010560->3076095) 00002000:00010000:1.0:1787119489.502536:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ed80 00000100:00100000:1.0:1787119489.502555:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9404 00000100:00100000:1.0:1787119489.502573:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633301632:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.502783:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633301504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 358us (1345us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.502790:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9403 00002000:00100000:2.0:1787119489.502797:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (41295872->41299967) req@ffff92a5066dd500 x1873929633301504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.502805:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633301504 ext(41295872->41299967) 00002000:00010000:2.0:1787119489.502809:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd500 00000100:00100000:2.0:1787119489.502825:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9405 00000100:00100000:2.0:1787119489.502832:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633301760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.503116:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633302016 00000100:00100000:0.0:1787119489.503120:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633302016 00000100:00100000:0.0:1787119489.503149:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19453 00000100:00100000:0.0:1787119489.503154:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+122:32727:x1873929633302016:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119489.503185:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119489.503205:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e295b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a5f expref: 122 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.503219:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119489.503223:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119489.503371:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.503380:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.503387:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119489.503419:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976266 00000004:00010000:0.0:1787119489.503471:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e142c8b reply state 000000009ee388ba transno 4294976267 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.503480:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119489.503530:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+124:32727:x1873929633302016:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 375us (1179us total) trans 4294976267 rc 0/0 00000100:00100000:0.0:1787119489.503537:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19453 00000020:00080000:0.0:1787119489.503540:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119489.508077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.508531:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633301632:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5967us (6915us total) trans 0 rc 53248/53248 00000100:00100000:1.0:1787119489.508543:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9404 00002000:00100000:1.0:1787119489.508554:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (44093440->44146687) req@ffff92a5066df480 x1873929633301632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.508574:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633301632 ext(44093440->44146687) 00002000:00010000:1.0:1787119489.508580:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:1.0:1787119489.508600:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633302144 00000100:00100000:1.0:1787119489.508608:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633302144 00002000:00100000:1.0:1787119489.508716:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (3076096->3112959) req@ffff92a63eb2ca80 x1873929633302144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.508726:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ca80 with x1873929633302144 ext(3076096->3112959) 00002000:00010000:1.0:1787119489.508730:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ca80 00000100:00100000:1.0:1787119489.508759:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9406 00000100:00100000:1.0:1787119489.508768:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633302144:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119489.509292:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.509300:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.509305:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.509310:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045e200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.509313:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.509318:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.509330:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119489.509332:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.509335:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.509339:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2962 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.509681:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633301760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6847us (7809us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119489.509689:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9405 00002000:00100000:3.0:1787119489.509697:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (28229632->28266495) req@ffff92a5066de300 x1873929633301760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.509706:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de300 with x1873929633301760 ext(28229632->28266495) 00002000:00010000:3.0:1787119489.509710:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066de300 00000100:00100000:3.0:1787119489.509758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.509828:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.510103:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633302400 00000100:00100000:1.0:1787119489.510109:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633302400 00002000:00010000:1.0:1787119489.510131:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (56586156->18446744073709551615) 00002000:00100000:1.0:1787119489.510135:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123100 with x1873929633302400 ext(56586156->18446744073709551615) 00002000:00010000:1.0:1787119489.510144:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123100. 00000100:00100000:1.0:1787119489.510163:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633302272 00000100:00100000:1.0:1787119489.510166:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633302272 00002000:00100000:1.0:1787119489.510182:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (41361408->41365503) req@ffff92a62041d880 x1873929633302272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.510192:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d880 with x1873929633302272 ext(41361408->41365503) 00002000:00010000:1.0:1787119489.510207:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d880 00000100:00100000:1.0:1787119489.510230:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9407 00000100:00100000:1.0:1787119489.510238:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633302400:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119489.510539:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 11298734 -> 56586156 00002000:00010000:1.0:1787119489.510543:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:1.0:1787119489.510545:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.510548:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:1.0:1787119489.510550:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1293 -> 1293 00000100:00100000:1.0:1787119489.510592:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633302400:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 354us (833us total) trans 4294969053 rc 0/0 00000100:00100000:1.0:1787119489.510600:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9407 00002000:00010000:1.0:1787119489.510603:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (56586156->18446744073709551615) 00002000:00100000:1.0:1787119489.510606:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123100 with x1873929633302400 ext(56586156->18446744073709551615) 00002000:00010000:1.0:1787119489.510673:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123100. 00000100:00100000:1.0:1787119489.510691:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9408 00000100:00100000:1.0:1787119489.510698:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633302272:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.510834:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633302272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 135us (1003us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.510843:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9408 00002000:00100000:1.0:1787119489.510849:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (41361408->41365503) req@ffff92a62041d880 x1873929633302272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.510858:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d880 with x1873929633302272 ext(41361408->41365503) 00002000:00010000:1.0:1787119489.510861:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d880 00000100:00100000:2.0:1787119489.519078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.519840:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633302144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11068us (11769us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119489.519852:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9406 00002000:00100000:1.0:1787119489.519865:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (3076096->3112959) req@ffff92a63eb2ca80 x1873929633302144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.519875:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ca80 with x1873929633302144 ext(3076096->3112959) 00002000:00010000:1.0:1787119489.519881:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ca80 00000100:00100000:1.0:1787119489.519906:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633302528 00000100:00100000:1.0:1787119489.519914:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633302528 00002000:00100000:1.0:1787119489.519945:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (39825408->39829503) req@ffff92a634038700 x1873929633302528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.519954:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038700 with x1873929633302528 ext(39825408->39829503) 00002000:00010000:1.0:1787119489.519957:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038700 00000100:00100000:1.0:1787119489.519986:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9409 00000100:00100000:1.0:1787119489.519995:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633302528:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.520186:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633302528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 192us (1119us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.520193:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9409 00002000:00100000:1.0:1787119489.520200:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (39825408->39829503) req@ffff92a634038700 x1873929633302528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.520207:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038700 with x1873929633302528 ext(39825408->39829503) 00002000:00010000:1.0:1787119489.520210:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038700 00000100:00100000:2.0:1787119489.523331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.523366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.523803:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633302656 00000100:00100000:0.0:1787119489.523814:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633302656 00000100:00100000:3.0:1787119489.523818:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633302784 00000100:00100000:3.0:1787119489.523822:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633302784 00002000:00100000:0.0:1787119489.523865:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (28184576->28250111) req@ffff92a63403bb80 x1873929633302656/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.523876:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633302656 ext(28184576->28250111) 00002000:00010000:0.0:1787119489.523881:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403bb80 00000100:00100000:0.0:1787119489.523921:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9410 00000100:00100000:0.0:1787119489.523995:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633302656:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119489.524019:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19454 00000100:00100000:2.0:1787119489.524026:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+123:32727:x1873929633302784:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119489.524038:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119489.524057:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a66 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.524140:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e2970 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.524153:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e2970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.524164:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e2970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119489.524192:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 56586156 00000004:00200000:2.0:1787119489.524196:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119489.524214:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e2970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.524240:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a66 expref: 125 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.524258:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e2970 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a66 expref: 124 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.524267:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119489.524270:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119489.524274:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e561800, rc 0) 00000100:00100000:2.0:1787119489.524306:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+124:32727:x1873929633302784:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 281us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.524313:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19454 00000100:00100000:3.0:1787119489.528875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.528905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.528931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.528959:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633302912 00000100:00100000:3.0:1787119489.528968:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633302912 00000100:00100000:2.0:1787119489.528994:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633303168 00000100:00100000:2.0:1787119489.528998:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633303168 00002000:00100000:3.0:1787119489.529027:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (44093440->44146687) req@ffff92a62041d500 x1873929633302912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.529038:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633302912 ext(44093440->44146687) 00000100:00100000:2.0:1787119489.529038:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19455 00002000:00010000:3.0:1787119489.529044:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d500 00000100:00100000:2.0:1787119489.529046:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+124:32724:x1873929633303168:12345-192.168.201.59@tcp:36:fsx.0 00000100:00100000:3.0:1787119489.529054:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633303296 00000100:00100000:3.0:1787119489.529057:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633303296 00002000:00100000:3.0:1787119489.529069:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (39829504->39833599) req@ffff92a633e3ea00 x1873929633303296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.529077:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3ea00 with x1873929633303296 ext(39829504->39833599) 00002000:00010000:3.0:1787119489.529080:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3ea00 00010000:00010000:2.0:1787119489.529091:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787119489.529092:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9411 00000100:00100000:3.0:1787119489.529098:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633302912:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:2.0:1787119489.529116:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573400/0xcaba3de8463e2946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a58 expref: 124 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.529134:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119489.529139:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119489.529323:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.529326:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9412 00000100:00100000:3.0:1787119489.529333:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633303296:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:2.0:1787119489.529336:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.529346:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119489.529401:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976268 00000004:00010000:2.0:1787119489.529426:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a749dd78 reply state 00000000bdb9047d transno 4294976269 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119489.529434:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119489.529483:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633303296:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 150us (550us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.529491:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9412 00002000:00100000:3.0:1787119489.529497:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (39829504->39833599) req@ffff92a633e3ea00 x1873929633303296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.529505:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3ea00 with x1873929633303296 ext(39829504->39833599) 00002000:00010000:3.0:1787119489.529509:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3ea00 00000100:00100000:2.0:1787119489.529723:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+126:32724:x1873929633303168:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 676us (815us total) trans 4294976269 rc 0/0 00000100:00100000:2.0:1787119489.529731:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19455 00000020:00080000:2.0:1787119489.529734:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119489.530176:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633302656:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 6245us (6853us total) trans 4294968823 rc 0/0 00000100:00100000:2.0:1787119489.530184:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9410 00002000:00100000:2.0:1787119489.530190:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (28184576->28250111) req@ffff92a63403bb80 x1873929633302656/t4294968823(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/448 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.530197:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633302656 ext(28184576->28250111) 00002000:00010000:2.0:1787119489.530201:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403bb80 00000100:00100000:1.0:1787119489.532791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.532952:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633303424 00000100:00100000:3.0:1787119489.532961:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633303424 00002000:00100000:3.0:1787119489.533004:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (52510720->52514815) req@ffff92a5066df800 x1873929633303424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.533015:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df800 with x1873929633303424 ext(52510720->52514815) 00002000:00010000:3.0:1787119489.533020:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df800 00000100:00100000:3.0:1787119489.533056:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9413 00000100:00100000:3.0:1787119489.533066:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633303424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.533322:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633303424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 256us (539us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.533330:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9413 00002000:00100000:3.0:1787119489.533336:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (52510720->52514815) req@ffff92a5066df800 x1873929633303424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.533344:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df800 with x1873929633303424 ext(52510720->52514815) 00002000:00010000:3.0:1787119489.533347:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df800 00000100:00100000:1.0:1787119489.536718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.536783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.536819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.536842:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633303552 00000100:00100000:2.0:1787119489.536843:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633303680 00000100:00100000:2.0:1787119489.536851:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633303680 00000100:00100000:1.0:1787119489.536851:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633303552 00002000:00010000:1.0:1787119489.536885:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (9219840->18446744073709551615) 00002000:00100000:1.0:1787119489.536890:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633303552 ext(9219840->18446744073709551615) 00000100:00100000:2.0:1787119489.536898:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4989 00002000:00010000:1.0:1787119489.536900:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dea00. 00000100:00100000:2.0:1787119489.536907:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633303680:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119489.536913:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633303808 00000100:00100000:1.0:1787119489.536915:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633303808 00002000:00100000:1.0:1787119489.536933:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (39804928->39870463) req@ffff92a6068bf480 x1873929633303808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.536942:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633303808 ext(39804928->39870463) 00002000:00010000:1.0:1787119489.536947:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf480 00000100:00100000:1.0:1787119489.536961:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9414 00000100:00100000:1.0:1787119489.536968:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633303552:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119489.537230:0:19246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 9936520 -> 9219840 00000100:00100000:2.0:1787119489.537232:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9415 00002000:00010000:1.0:1787119489.537233:0:19246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:1.0:1787119489.537236:0:19246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:1.0:1787119489.537238:0:19246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00000100:00100000:2.0:1787119489.537239:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2374:x1873929633303808:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:1.0:1787119489.537241:0:19246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119489.537299:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633303552:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 329us (693us total) trans 4294968824 rc 0/0 00000100:00100000:1.0:1787119489.537307:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9414 00002000:00010000:1.0:1787119489.537310:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (9219840->18446744073709551615) 00002000:00100000:1.0:1787119489.537313:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633303552 ext(9219840->18446744073709551615) 00002000:00010000:1.0:1787119489.537318:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dea00. 00000100:00100000:3.0:1787119489.537823:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633302912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8723us (8958us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1787119489.537831:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9411 00002000:00100000:3.0:1787119489.537838:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (44093440->44146687) req@ffff92a62041d500 x1873929633302912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.537845:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633302912 ext(44093440->44146687) 00002000:00010000:3.0:1787119489.537850:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d500 00010000:00010000:3.0:1787119489.537875:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.537884:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.537892:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.537898:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e561400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.537902:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.537913:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.537929:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119489.537932:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.537937:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.537943:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2977 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.538395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.538494:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633303936 00000100:00100000:3.0:1787119489.538501:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633303936 00002000:00100000:3.0:1787119489.538524:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (52514816->52518911) req@ffff92a6068bd500 x1873929633303936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.538533:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd500 with x1873929633303936 ext(52514816->52518911) 00002000:00010000:3.0:1787119489.538536:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bd500 00000100:00100000:3.0:1787119489.538570:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9416 00000100:00100000:3.0:1787119489.538579:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633303936:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.538734:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633303936:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 155us (339us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.538741:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9416 00002000:00100000:3.0:1787119489.538746:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (52514816->52518911) req@ffff92a6068bd500 x1873929633303936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.538768:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd500 with x1873929633303936 ext(52514816->52518911) 00002000:00010000:3.0:1787119489.538771:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bd500 00000100:00100000:1.0:1787119489.543084:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.545559:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633304064 00000100:00100000:1.0:1787119489.545586:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633304064 00000100:00100000:1.0:1787119489.545770:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19456 00000100:00100000:1.0:1787119489.545781:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+125:32724:x1873929633304064:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119489.545805:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119489.545826:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e297e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a6d expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.545914:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573e00/0xcaba3de8463e2985 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.545928:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573e00/0xcaba3de8463e2985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.545939:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573e00/0xcaba3de8463e2985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119489.545964:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 9219840 00000004:00200000:1.0:1787119489.545968:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119489.545986:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573e00/0xcaba3de8463e2985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.546009:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e297e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a6d expref: 127 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.546021:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573e00/0xcaba3de8463e2985 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a6d expref: 126 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.546027:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119489.546029:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119489.546032:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e573e00, rc 0) 00000100:00100000:1.0:1787119489.546089:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+126:32724:x1873929633304064:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 311us (3015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.546096:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19456 00000100:00100000:2.0:1787119489.550667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.550702:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633304192 00000100:00100000:2.0:1787119489.550712:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633304192 00002000:00100000:2.0:1787119489.550762:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (39825408->39829503) req@ffff92a63403aa00 x1873929633304192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.550773:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403aa00 with x1873929633304192 ext(39825408->39829503) 00002000:00010000:2.0:1787119489.550780:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403aa00 00000100:00100000:2.0:1787119489.550813:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9417 00000100:00100000:2.0:1787119489.550822:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633304192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.554839:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633304192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4006us (4171us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.554853:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9417 00002000:00100000:2.0:1787119489.555001:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (39825408->39829503) req@ffff92a63403aa00 x1873929633304192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.555012:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403aa00 with x1873929633304192 ext(39825408->39829503) 00002000:00010000:2.0:1787119489.555018:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403aa00 00000100:00100000:3.0:1787119489.555056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.555076:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633304320 00000100:00100000:3.0:1787119489.555084:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633304320 00002000:00100000:3.0:1787119489.555114:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (52490240->52555775) req@ffff92a633e3f480 x1873929633304320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.555122:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f480 with x1873929633304320 ext(52490240->52555775) 00002000:00010000:3.0:1787119489.555125:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3f480 00000100:00100000:3.0:1787119489.555144:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9418 00000100:00100000:3.0:1787119489.555152:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633304320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.555165:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633303808:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17927us (18346us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119489.555172:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9415 00002000:00100000:2.0:1787119489.555176:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (39804928->39870463) req@ffff92a6068bf480 x1873929633303808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.555183:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633303808 ext(39804928->39870463) 00002000:00010000:2.0:1787119489.555186:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf480 00000100:00100000:1.0:1787119489.564222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.564254:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633304448 00000100:00100000:2.0:1787119489.564266:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633304448 00002000:00100000:2.0:1787119489.564313:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (39829504->39833599) req@ffff92a6068bea00 x1873929633304448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.564325:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bea00 with x1873929633304448 ext(39829504->39833599) 00002000:00010000:2.0:1787119489.564330:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bea00 00000100:00100000:2.0:1787119489.564366:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9419 00000100:00100000:2.0:1787119489.564376:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633304448:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.564765:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633304448:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 390us (553us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.564773:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9419 00002000:00100000:2.0:1787119489.564780:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (39829504->39833599) req@ffff92a6068bea00 x1873929633304448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.564789:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bea00 with x1873929633304448 ext(39829504->39833599) 00002000:00010000:2.0:1787119489.564793:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bea00 00000100:00100000:0.0:1787119489.566044:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633304320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10885us (10982us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119489.566057:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9418 00002000:00100000:0.0:1787119489.566067:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (52490240->52555775) req@ffff92a633e3f480 x1873929633304320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.566078:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f480 with x1873929633304320 ext(52490240->52555775) 00002000:00010000:0.0:1787119489.566083:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3f480 00000100:00100000:0.0:1787119489.566142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.566250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.567371:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633304832 00000100:00100000:3.0:1787119489.567383:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633304832 00000100:00100000:3.0:1787119489.567526:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19457 00000100:00100000:3.0:1787119489.567537:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+126:32724:x1873929633304832:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.567599:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119489.567812:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573e00/0xcaba3de8463e2985 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a6d expref: 126 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.567832:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119489.567837:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119489.568032:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.568046:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.568055:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119489.568108:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976270 00000004:00010000:3.0:1787119489.568134:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba39eb89 reply state 00000000bd25d87d transno 4294976271 ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.568142:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119489.569478:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+128:32724:x1873929633304832:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1935us (3219us total) trans 4294976271 rc 0/0 00000100:00100000:3.0:1787119489.569491:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19457 00000020:00080000:3.0:1787119489.569498:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119489.569596:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633304576 00000100:00100000:2.0:1787119489.569605:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633304576 00002000:00100000:2.0:1787119489.569643:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (7548928->41365503) req@ffff92a511f56300 x1873929633304576/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.569653:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56300 with x1873929633304576 ext(7548928->41365503) 00000100:00100000:0.0:1787119489.569654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00010000:2.0:1787119489.569658:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f56300 00000100:00100000:0.0:1787119489.570200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119489.573023:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.573042:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.573050:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.573056:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a600031a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119489.573061:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.573068:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.573083:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119489.573086:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119489.573091:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.573096:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e298c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.573574:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633304960 00000100:00100000:0.0:1787119489.573586:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633304960 00000100:00100000:1.0:1787119489.573647:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633305088 00000100:00100000:1.0:1787119489.573651:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633305088 00002000:00100000:1.0:1787119489.573692:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (29077504->29081599) req@ffff92a511f54a80 x1873929633305088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.573698:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (39804928->39870463) req@ffff92a511f57b80 x1873929633304960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.573704:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54a80 with x1873929633305088 ext(29077504->29081599) 00002000:00100000:0.0:1787119489.573707:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57b80 with x1873929633304960 ext(39804928->39870463) 00002000:00010000:1.0:1787119489.573709:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f54a80 00002000:00010000:0.0:1787119489.573710:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57b80 00000100:00100000:1.0:1787119489.573738:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9420 00000100:00100000:1.0:1787119489.573748:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633304576:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119489.573840:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9421 00000100:00100000:0.0:1787119489.573847:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633305088:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.574018:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9422 00000100:00100000:0.0:1787119489.574022:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2373:x1873929633305088:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 176us (3823us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.574026:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633304960:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.574029:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9421 00002000:00100000:0.0:1787119489.574035:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (29077504->29081599) req@ffff92a511f54a80 x1873929633305088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.574043:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54a80 with x1873929633305088 ext(29077504->29081599) 00002000:00010000:0.0:1787119489.574046:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f54a80 00000100:00100000:3.0:1787119489.579265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.579530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.579557:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633305216 00000100:00100000:3.0:1787119489.579577:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633305216 00002000:00010000:3.0:1787119489.579729:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (27931118->18446744073709551615) 00002000:00100000:3.0:1787119489.579734:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b7800 with x1873929633305216 ext(27931118->18446744073709551615) 00002000:00010000:3.0:1787119489.579745:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5068b7800. 00000100:00100000:3.0:1787119489.579768:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633305344 00000100:00100000:3.0:1787119489.579771:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633305344 00002000:00100000:3.0:1787119489.579793:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (29081600->29085695) req@ffff92a63ebd4a80 x1873929633305344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.579803:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd4a80 with x1873929633305344 ext(29081600->29085695) 00002000:00010000:3.0:1787119489.579807:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd4a80 00000100:00100000:3.0:1787119489.579837:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9423 00000100:00100000:3.0:1787119489.579849:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633305216:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119489.580036:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 9219840 -> 27931118 00002000:00010000:3.0:1787119489.580039:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119489.580041:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:3.0:1787119489.580043:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119489.580044:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1165 00000100:00100000:3.0:1787119489.580082:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633305216:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 238us (827us total) trans 4294968825 rc 0/0 00000100:00100000:3.0:1787119489.580087:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9423 00002000:00010000:3.0:1787119489.580089:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (27931118->18446744073709551615) 00002000:00100000:3.0:1787119489.580091:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b7800 with x1873929633305216 ext(27931118->18446744073709551615) 00002000:00010000:3.0:1787119489.580094:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5068b7800. 00000100:00100000:3.0:1787119489.580106:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9424 00000100:00100000:3.0:1787119489.580110:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2374:x1873929633305344:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.580236:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2374:x1873929633305344:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 126us (707us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.580241:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9424 00002000:00100000:3.0:1787119489.580245:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (29081600->29085695) req@ffff92a63ebd4a80 x1873929633305344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.580251:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd4a80 with x1873929633305344 ext(29081600->29085695) 00002000:00010000:3.0:1787119489.580253:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd4a80 00000100:00100000:1.0:1787119489.583311:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633304576:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9553us (17158us total) trans 4294969054 rc 0/0 00000100:00100000:1.0:1787119489.583325:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9420 00002000:00100000:1.0:1787119489.583338:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (7548928->41365503) req@ffff92a511f56300 x1873929633304576/t4294969054(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/456 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.583348:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56300 with x1873929633304576 ext(7548928->41365503) 00002000:00010000:1.0:1787119489.583354:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f56300 00000100:00100000:1.0:1787119489.583496:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633304960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9470us (13841us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.583503:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9422 00002000:00100000:1.0:1787119489.583511:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (39804928->39870463) req@ffff92a511f57b80 x1873929633304960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.583519:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57b80 with x1873929633304960 ext(39804928->39870463) 00002000:00010000:1.0:1787119489.583523:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57b80 00000100:00100000:3.0:1787119489.585247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.585401:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633305472 00000100:00100000:1.0:1787119489.585410:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633305472 00002000:00100000:1.0:1787119489.585499:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (27869184->27873279) req@ffff92a63ebd5180 x1873929633305472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.585511:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5180 with x1873929633305472 ext(27869184->27873279) 00002000:00010000:1.0:1787119489.585517:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd5180 00000100:00100000:1.0:1787119489.585540:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9425 00000100:00100000:1.0:1787119489.585549:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633305472:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.586063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.586702:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633305472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1152us (1462us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.586712:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9425 00002000:00100000:1.0:1787119489.586721:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (27869184->27873279) req@ffff92a63ebd5180 x1873929633305472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.586731:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5180 with x1873929633305472 ext(27869184->27873279) 00002000:00010000:1.0:1787119489.586735:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd5180 00000100:00100000:1.0:1787119489.586818:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633305600 00000100:00100000:1.0:1787119489.586823:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633305600 00002000:00100000:1.0:1787119489.586847:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (29057024->29122559) req@ffff92a63ebd4700 x1873929633305600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.586856:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd4700 with x1873929633305600 ext(29057024->29122559) 00002000:00010000:1.0:1787119489.586860:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd4700 00000100:00100000:1.0:1787119489.586881:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9426 00000100:00100000:1.0:1787119489.586889:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633305600:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.589719:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633305600:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2820us (3648us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.589733:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9426 00002000:00100000:3.0:1787119489.589744:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (29057024->29122559) req@ffff92a63ebd4700 x1873929633305600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.589762:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd4700 with x1873929633305600 ext(29057024->29122559) 00002000:00010000:3.0:1787119489.589767:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd4700 00000100:00100000:1.0:1787119489.597889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.597934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.597961:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633305856 00000100:00100000:1.0:1787119489.597970:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633305856 00000100:00100000:1.0:1787119489.598020:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4990 00000100:00100000:1.0:1787119489.598029:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2374:x1873929633305856:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119489.600026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.600060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.600096:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633305728 00000100:00100000:3.0:1787119489.600105:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633305728 00002000:00100000:3.0:1787119489.600138:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (27873280->27877375) req@ffff92a6068bd180 x1873929633305728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.600146:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd180 with x1873929633305728 ext(27873280->27877375) 00002000:00010000:3.0:1787119489.600150:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd180 00000100:00100000:3.0:1787119489.600165:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633305984 00000100:00100000:3.0:1787119489.600167:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633305984 00002000:00100000:3.0:1787119489.600176:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (7548928->41365503) req@ffff92a63ebd5c00 x1873929633305984/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.600182:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5c00 with x1873929633305984 ext(7548928->41365503) 00002000:00010000:3.0:1787119489.600184:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5c00 00000100:00100000:3.0:1787119489.600190:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633306112 00000100:00100000:3.0:1787119489.600192:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633306112 00002000:00100000:3.0:1787119489.600199:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (21061632->21069823) req@ffff92a63ebd6680 x1873929633306112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.600204:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6680 with x1873929633306112 ext(21061632->21069823) 00002000:00010000:3.0:1787119489.600205:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd6680 00000100:00100000:3.0:1787119489.600215:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9427 00000100:00100000:3.0:1787119489.600219:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633305728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.601769:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9428 00000100:00100000:3.0:1787119489.601785:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2373:x1873929633305984:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119489.601955:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9429 00000100:00100000:3.0:1787119489.601961:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633306112:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.602112:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633306112:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 150us (2051us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1787119489.602117:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9429 00002000:00100000:3.0:1787119489.602123:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (21061632->21069823) req@ffff92a63ebd6680 x1873929633306112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/8632 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.602130:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6680 with x1873929633306112 ext(21061632->21069823) 00002000:00010000:3.0:1787119489.602134:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd6680 00000100:00100000:3.0:1787119489.602193:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633305728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1973us (4315us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.602197:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9427 00002000:00100000:3.0:1787119489.602201:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (27873280->27877375) req@ffff92a6068bd180 x1873929633305728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.602206:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd180 with x1873929633305728 ext(27873280->27877375) 00002000:00010000:3.0:1787119489.602209:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd180 00000001:00080000:0.0:1787119489.603579:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968823 is committed 00000100:00100000:2.0:1787119489.607676:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633303680:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 70753us (70876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.607691:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4989 00000100:00100000:3.0:1787119489.613265:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2373:x1873929633305984:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 11475us (13238us total) trans 4294969055 rc 0/0 00000100:00100000:3.0:1787119489.613286:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9428 00002000:00100000:3.0:1787119489.613298:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (7548928->41365503) req@ffff92a63ebd5c00 x1873929633305984/t4294969055(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/456 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.613310:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5c00 with x1873929633305984 ext(7548928->41365503) 00002000:00010000:3.0:1787119489.613316:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5c00 00000100:00100000:0.0:1787119489.614274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.614990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.615067:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633306240 00000100:00100000:2.0:1787119489.615075:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633306240 00002000:00100000:2.0:1787119489.615113:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (27848704->27918335) req@ffff92a511f57800 x1873929633306240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.615124:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633306240 ext(27848704->27918335) 00002000:00010000:2.0:1787119489.615129:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f57800 00000100:00100000:2.0:1787119489.615155:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9430 00000100:00100000:2.0:1787119489.615163:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633306240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.615521:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633306368 00000100:00100000:0.0:1787119489.615526:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633306368 00002000:00100000:0.0:1787119489.615548:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (41295872->41299967) req@ffff92a511f54000 x1873929633306368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.615557:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633306368 ext(41295872->41299967) 00002000:00010000:0.0:1787119489.615570:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f54000 00000100:00100000:0.0:1787119489.615596:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9431 00000100:00100000:0.0:1787119489.615604:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2376:x1873929633306368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.615738:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2376:x1873929633306368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 135us (751us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.615874:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9431 00002000:00100000:0.0:1787119489.615885:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (41295872->41299967) req@ffff92a511f54000 x1873929633306368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.615894:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633306368 ext(41295872->41299967) 00002000:00010000:0.0:1787119489.615897:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f54000 00000100:00100000:1.0:1787119489.623648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.623685:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633306496 00000100:00100000:1.0:1787119489.623696:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633306496 00002000:00100000:1.0:1787119489.623749:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (41361408->41365503) req@ffff92a6068bdf80 x1873929633306496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.623761:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bdf80 with x1873929633306496 ext(41361408->41365503) 00002000:00010000:1.0:1787119489.623767:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bdf80 00000100:00100000:1.0:1787119489.623796:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9432 00000100:00100000:1.0:1787119489.623806:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2373:x1873929633306496:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.624045:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2373:x1873929633306496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 240us (406us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.624053:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9432 00002000:00100000:1.0:1787119489.624060:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (41361408->41365503) req@ffff92a6068bdf80 x1873929633306496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.624068:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bdf80 with x1873929633306496 ext(41361408->41365503) 00002000:00010000:1.0:1787119489.624071:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bdf80 00000100:00100000:3.0:1787119489.625024:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633306240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9855us (10749us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1787119489.625035:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9430 00002000:00100000:3.0:1787119489.625044:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (27848704->27918335) req@ffff92a511f57800 x1873929633306240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.625053:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633306240 ext(27848704->27918335) 00002000:00010000:3.0:1787119489.625059:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f57800 00000100:00100000:0.0:1787119489.625197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.625302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.625598:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633306752 00000100:00100000:3.0:1787119489.625605:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633306752 00000100:00100000:3.0:1787119489.625732:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19458 00000100:00100000:3.0:1787119489.625741:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+127:32720:x1873929633306752:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.625802:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119489.625829:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e287b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a12 expref: 127 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.625850:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119489.625855:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119489.626059:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.626073:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.626083:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119489.626135:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976272 00000004:00010000:3.0:1787119489.626161:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007187e436 reply state 0000000021e3981d transno 4294976273 ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.626170:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119489.626242:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+129:32720:x1873929633306752:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 502us (1044us total) trans 4294976273 rc 0/0 00000100:00100000:3.0:1787119489.626248:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19458 00000020:00080000:3.0:1787119489.626253:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119489.626276:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633306880 00000100:00100000:3.0:1787119489.626359:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633306880 00000100:00100000:3.0:1787119489.626390:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4991 00000100:00100000:3.0:1787119489.626397:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633306880:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119489.634056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.634099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119489.634144:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.634157:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.634165:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.634171:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a600031000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119489.634176:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.634183:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.634199:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119489.634202:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119489.634206:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.634212:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031000/0xcaba3de8463e2993 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.634258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.634380:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633307008 00000100:00100000:3.0:1787119489.634389:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633307008 00002000:00100000:3.0:1787119489.634430:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (44093440->44146687) req@ffff92a511f57100 x1873929633307008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.634479:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57100 with x1873929633307008 ext(44093440->44146687) 00002000:00010000:3.0:1787119489.634483:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57100 00000100:00100000:3.0:1787119489.634503:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633307136 00000100:00100000:3.0:1787119489.634505:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633307136 00002000:00100000:3.0:1787119489.634518:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (27918336->27934719) req@ffff92a511f56a00 x1873929633307136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.634524:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56a00 with x1873929633307136 ext(27918336->27934719) 00002000:00010000:3.0:1787119489.634526:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f56a00 00000100:00100000:3.0:1787119489.634534:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633307264 00000100:00100000:3.0:1787119489.634536:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633307264 00002000:00010000:3.0:1787119489.634543:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (64395778->18446744073709551615) 00002000:00100000:3.0:1787119489.634545:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54380 with x1873929633307264 ext(64395778->18446744073709551615) 00002000:00010000:3.0:1787119489.634552:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54380. 00000100:00100000:3.0:1787119489.634575:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9433 00000100:00100000:3.0:1787119489.634584:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2373:x1873929633307008:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.634652:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9434 00000100:00100000:0.0:1787119489.634662:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633307136:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.634900:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633307136:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 240us (800us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119489.634907:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9435 00000100:00100000:3.0:1787119489.634914:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633307264:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119489.635116:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 56586156 -> 64395778 00002000:00010000:3.0:1787119489.635123:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119487 -> 1787119488 00002000:00010000:3.0:1787119489.635125:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:3.0:1787119489.635127:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119487 -> 1787119488 00002000:00010000:3.0:1787119489.635129:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1037 -> 1933 00000100:00100000:3.0:1787119489.635225:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633307264:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 310us (966us total) trans 4294968826 rc 0/0 00000100:00100000:0.0:1787119489.637292:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9434 00002000:00100000:0.0:1787119489.637311:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (27918336->27934719) req@ffff92a511f56a00 x1873929633307136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/16824 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.637322:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56a00 with x1873929633307136 ext(27918336->27934719) 00002000:00010000:0.0:1787119489.637328:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f56a00 00000100:00100000:3.0:1787119489.637350:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9435 00002000:00010000:3.0:1787119489.637354:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (64395778->18446744073709551615) 00002000:00100000:3.0:1787119489.637357:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54380 with x1873929633307264 ext(64395778->18446744073709551615) 00002000:00010000:3.0:1787119489.637366:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54380. 00000100:00100000:2.0:1787119489.643928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.643976:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633307392 00000100:00100000:2.0:1787119489.643983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.643987:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633307392 00000100:00100000:1.0:1787119489.644044:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19459 00000100:00100000:1.0:1787119489.644054:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+128:32720:x1873929633307392:12345-192.168.201.59@tcp:101:fsx.0 00000100:00100000:3.0:1787119489.644371:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2373:x1873929633307008:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9786us (10325us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1787119489.644381:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9433 00002000:00100000:3.0:1787119489.644392:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (44093440->44146687) req@ffff92a511f57100 x1873929633307008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.644409:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57100 with x1873929633307008 ext(44093440->44146687) 00002000:00010000:3.0:1787119489.644415:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57100 00000100:00100000:3.0:1787119489.644432:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633307520 00000100:00100000:3.0:1787119489.644436:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633307520 00002000:00100000:3.0:1787119489.644765:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (27869184->27931117) req@ffff92a634038000 x1873929633307520/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.644775:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633307520 ext(27869184->27931117) 00002000:00010000:3.0:1787119489.644779:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634038000 00000100:00100000:3.0:1787119489.644801:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9436 00010000:00010000:1.0:1787119489.644898:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119489.644920:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e299a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a74 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.644959:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633307520:12345-192.168.201.59@tcp:4:fsx.0 00010000:00010000:1.0:1787119489.645213:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572000/0xcaba3de8463e29a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.645229:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572000/0xcaba3de8463e29a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.645241:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572000/0xcaba3de8463e29a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119489.645265:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 64395778 00000004:00200000:1.0:1787119489.645270:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119489.645287:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572000/0xcaba3de8463e29a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.645313:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e299a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a74 expref: 130 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.645328:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572000/0xcaba3de8463e29a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a74 expref: 129 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.645336:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119489.645339:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119489.645342:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e572000, rc 0) 00000100:00100000:1.0:1787119489.645366:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+129:32720:x1873929633307392:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1315us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.645373:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19459 00000100:00100000:0.0:1787119489.648090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.652345:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633307648 00000100:00100000:3.0:1787119489.652359:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633307648 00002000:00100000:3.0:1787119489.652406:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (39825408->39829503) req@ffff92a511f57480 x1873929633307648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.652417:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633307648 ext(39825408->39829503) 00002000:00010000:3.0:1787119489.652423:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57480 00000100:00100000:0.0:1787119489.652454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.652465:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633307776 00000100:00100000:3.0:1787119489.652481:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633307776 00002000:00100000:3.0:1787119489.652499:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (27275264->27328511) req@ffff92a511f55180 x1873929633307776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.652505:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55180 with x1873929633307776 ext(27275264->27328511) 00002000:00010000:3.0:1787119489.652507:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f55180 00000100:00100000:3.0:1787119489.652527:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9437 00000100:00100000:3.0:1787119489.652536:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2374:x1873929633307648:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.652546:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9438 00000100:00100000:0.0:1787119489.652553:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633307776:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.653049:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2374:x1873929633307648:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 512us (4967us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.653057:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9437 00002000:00100000:3.0:1787119489.653064:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (39825408->39829503) req@ffff92a511f57480 x1873929633307648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.653073:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633307648 ext(39825408->39829503) 00002000:00010000:3.0:1787119489.653077:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57480 00000100:00100000:3.0:1787119489.653402:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633307520:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 8445us (9416us total) trans 4294968827 rc 0/0 00000100:00100000:3.0:1787119489.653410:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9436 00002000:00100000:3.0:1787119489.653416:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (27869184->27931117) req@ffff92a634038000 x1873929633307520/t4294968827(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/448 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.653424:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633307520 ext(27869184->27931117) 00002000:00010000:3.0:1787119489.653428:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634038000 00000100:00100000:2.0:1787119489.658012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.658094:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633307904 00000100:00100000:0.0:1787119489.658105:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633307904 00000100:00100000:0.0:1787119489.658160:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4992 00000100:00100000:0.0:1787119489.658170:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633307904:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119489.665857:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2374:x1873929633305856:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 67819us (67911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.665870:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4990 00000001:00080000:1.0:1787119489.665905:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969054 is committed 00000100:00100000:1.0:1787119489.673017:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633307776:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20452us (20570us total) trans 0 rc 53248/53248 00000100:00100000:1.0:1787119489.673031:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9438 00002000:00100000:1.0:1787119489.673044:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (27275264->27328511) req@ffff92a511f55180 x1873929633307776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.673055:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55180 with x1873929633307776 ext(27275264->27328511) 00002000:00010000:1.0:1787119489.673061:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f55180 00000100:00100000:1.0:1787119489.676143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.677097:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633308032 00000100:00100000:1.0:1787119489.677107:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633308032 00002000:00100000:1.0:1787119489.677887:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (39829504->39833599) req@ffff92a6068bd880 x1873929633308032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.677899:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd880 with x1873929633308032 ext(39829504->39833599) 00002000:00010000:1.0:1787119489.677906:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bd880 00000100:00100000:1.0:1787119489.677940:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9439 00000100:00100000:1.0:1787119489.677954:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633308032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.678163:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633308032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 213us (2026us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.678170:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9439 00002000:00100000:1.0:1787119489.678176:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (39829504->39833599) req@ffff92a6068bd880 x1873929633308032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.678183:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd880 with x1873929633308032 ext(39829504->39833599) 00002000:00010000:1.0:1787119489.678187:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bd880 00000100:00100000:0.0:1787119489.678947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.680154:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633308160 00000100:00100000:3.0:1787119489.680165:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633308160 00002000:00100000:3.0:1787119489.680210:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (28184576->28188671) req@ffff92a511f55880 x1873929633308160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.680221:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55880 with x1873929633308160 ext(28184576->28188671) 00002000:00010000:3.0:1787119489.680226:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55880 00000100:00100000:3.0:1787119489.680262:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9440 00000100:00100000:3.0:1787119489.680344:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633308160:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.680815:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633308160:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 543us (1871us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.680824:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9440 00002000:00100000:3.0:1787119489.680831:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (28184576->28188671) req@ffff92a511f55880 x1873929633308160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.680840:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55880 with x1873929633308160 ext(28184576->28188671) 00002000:00010000:3.0:1787119489.680843:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55880 00000100:00100000:1.0:1787119489.682277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.682856:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633308288 00000100:00100000:3.0:1787119489.682865:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633308288 00002000:00100000:3.0:1787119489.682907:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (1847296->1851391) req@ffff92a6068bf800 x1873929633308288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.682930:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf800 with x1873929633308288 ext(1847296->1851391) 00002000:00010000:3.0:1787119489.682935:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bf800 00000100:00100000:3.0:1787119489.683000:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9441 00000100:00100000:3.0:1787119489.683010:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633308288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.683195:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633308288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 185us (924us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.683202:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9441 00002000:00100000:3.0:1787119489.683209:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (1847296->1851391) req@ffff92a6068bf800 x1873929633308288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.683216:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf800 with x1873929633308288 ext(1847296->1851391) 00002000:00010000:3.0:1787119489.683220:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bf800 00000100:00100000:2.0:1787119489.692621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.692653:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.692675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.692764:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633308416 00000100:00100000:3.0:1787119489.692775:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633308416 00002000:00100000:3.0:1787119489.692822:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (39804928->39870463) req@ffff92a634038a80 x1873929633308416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.692840:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038a80 with x1873929633308416 ext(39804928->39870463) 00002000:00010000:3.0:1787119489.692846:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038a80 00000100:00100000:3.0:1787119489.692876:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633308544 00000100:00100000:3.0:1787119489.692879:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633308544 00002000:00100000:3.0:1787119489.692896:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (1851392->1855487) req@ffff92a634038e00 x1873929633308544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.692905:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038e00 with x1873929633308544 ext(1851392->1855487) 00002000:00010000:3.0:1787119489.692909:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634038e00 00000100:00100000:3.0:1787119489.692921:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633308672 00000100:00100000:3.0:1787119489.692924:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633308672 00002000:00100000:3.0:1787119489.692937:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (28188672->28192767) req@ffff92a634039880 x1873929633308672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787119489.692937:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9442 00002000:00100000:3.0:1787119489.692944:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039880 with x1873929633308672 ext(28188672->28192767) 00002000:00010000:3.0:1787119489.692947:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039880 00000100:00100000:2.0:1787119489.692947:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633308416:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.692959:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9443 00000100:00100000:3.0:1787119489.692965:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633308544:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.693327:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633308544:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 359us (671us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.693335:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9443 00002000:00100000:3.0:1787119489.693342:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (1851392->1855487) req@ffff92a634038e00 x1873929633308544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.693350:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038e00 with x1873929633308544 ext(1851392->1855487) 00002000:00010000:3.0:1787119489.693352:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634038e00 00000100:00100000:3.0:1787119489.693369:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9444 00000100:00100000:3.0:1787119489.693376:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633308672:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.693718:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633308672:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 341us (1041us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.693724:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9444 00002000:00100000:3.0:1787119489.693731:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (28188672->28192767) req@ffff92a634039880 x1873929633308672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.693738:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039880 with x1873929633308672 ext(28188672->28192767) 00002000:00010000:3.0:1787119489.693741:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039880 00000100:00100000:0.0:1787119489.697077:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633307904:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 38896us (39063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119489.697092:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4992 00000001:00080000:0.0:1787119489.697130:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968824 is committed 00000001:00080000:0.0:1787119489.697141:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968827 is committed 00000100:00100000:2.0:1787119489.699661:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633308416:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6704us (7039us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119489.699678:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9442 00002000:00100000:2.0:1787119489.699692:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (39804928->39870463) req@ffff92a634038a80 x1873929633308416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.699702:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038a80 with x1873929633308416 ext(39804928->39870463) 00002000:00010000:2.0:1787119489.699708:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038a80 00000100:00100000:2.0:1787119489.700652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.700765:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633308800 00000100:00100000:0.0:1787119489.700775:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633308800 00002000:00100000:0.0:1787119489.700870:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (1826816->1892351) req@ffff92a506009f80 x1873929633308800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.700880:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009f80 with x1873929633308800 ext(1826816->1892351) 00002000:00010000:0.0:1787119489.700885:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506009f80 00000100:00100000:1.0:1787119489.701686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.704980:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633308928 00000100:00100000:0.0:1787119489.704995:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633308928 00002000:00100000:0.0:1787119489.705048:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (28164096->28229631) req@ffff92a6068bf100 x1873929633308928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.705060:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf100 with x1873929633308928 ext(28164096->28229631) 00002000:00010000:0.0:1787119489.705065:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf100 00000100:00100000:0.0:1787119489.705092:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9445 00000100:00100000:0.0:1787119489.705102:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633308800:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.705388:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9446 00000100:00100000:2.0:1787119489.705398:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633308928:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.705676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.705940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.705971:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633309184 00000100:00100000:1.0:1787119489.705977:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633309184 00002000:00100000:1.0:1787119489.706005:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (7548928->41365503) req@ffff92a63eb2ad80 x1873929633309184/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.706016:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633309184 ext(7548928->41365503) 00002000:00010000:1.0:1787119489.706020:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ad80 00000100:00100000:3.0:1787119489.706032:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633309056 00000100:00100000:3.0:1787119489.706037:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633309056 00000100:00100000:1.0:1787119489.706089:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9447 00000100:00100000:1.0:1787119489.706099:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633309184:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119489.706110:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19460 00000100:00100000:3.0:1787119489.706117:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+129:32724:x1873929633309056:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.706127:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.706147:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e29a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a7b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.706217:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e29af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.706230:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e29af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.706241:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e29af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119489.706266:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 27931118 00000004:00200000:3.0:1787119489.706271:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.706290:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e29af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.706318:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e29a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a7b expref: 131 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.706334:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e29af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a7b expref: 130 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.706342:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119489.706345:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.706348:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600030000, rc 0) 00000100:00100000:3.0:1787119489.706389:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+130:32724:x1873929633309056:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 272us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.706395:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19460 00000100:00100000:1.0:1787119489.714325:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633308928:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8917us (12630us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.714339:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9446 00002000:00100000:1.0:1787119489.714352:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (28164096->28229631) req@ffff92a6068bf100 x1873929633308928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.714363:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf100 with x1873929633308928 ext(28164096->28229631) 00002000:00010000:1.0:1787119489.714370:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf100 00000001:00080000:1.0:1787119489.714944:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969055 is committed 00000100:00100000:2.0:1787119489.716623:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633306880:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 90217us (91312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.716635:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4991 00000100:00100000:3.0:1787119489.716921:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633308800:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11818us (16272us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.716930:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9445 00002000:00100000:3.0:1787119489.716941:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (1826816->1892351) req@ffff92a506009f80 x1873929633308800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.716952:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009f80 with x1873929633308800 ext(1826816->1892351) 00002000:00010000:3.0:1787119489.716959:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506009f80 00000100:00100000:2.0:1787119489.717666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.722070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.722129:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633309312 00000100:00100000:0.0:1787119489.722138:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633309312 00002000:00100000:0.0:1787119489.722176:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (22183936->22241279) req@ffff92a50600b100 x1873929633309312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.722188:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600b100 with x1873929633309312 ext(22183936->22241279) 00002000:00010000:0.0:1787119489.722193:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50600b100 00000100:00100000:0.0:1787119489.722221:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633309440 00000100:00100000:0.0:1787119489.722224:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633309440 00002000:00100000:0.0:1787119489.722238:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (28229632->28266495) req@ffff92a63eb2b100 x1873929633309440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.722245:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b100 with x1873929633309440 ext(28229632->28266495) 00002000:00010000:0.0:1787119489.722249:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b100 00000100:00100000:0.0:1787119489.722263:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9448 00000100:00100000:0.0:1787119489.722271:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633309312:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.722336:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633309184:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 16236us (16394us total) trans 4294969056 rc 0/0 00000100:00100000:3.0:1787119489.722346:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9447 00002000:00100000:3.0:1787119489.722354:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (7548928->41365503) req@ffff92a63eb2ad80 x1873929633309184/t4294969056(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 520/456 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.722363:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633309184 ext(7548928->41365503) 00002000:00010000:3.0:1787119489.722366:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ad80 00000100:00100000:3.0:1787119489.722383:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9449 00000100:00100000:3.0:1787119489.722389:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633309440:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.724787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.724839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.724888:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633309568 00000100:00100000:0.0:1787119489.724897:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633309568 00002000:00100000:0.0:1787119489.724938:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (28184576->28188671) req@ffff92a63eb2bb80 x1873929633309568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.724949:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2bb80 with x1873929633309568 ext(28184576->28188671) 00002000:00010000:0.0:1787119489.724955:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2bb80 00000100:00100000:0.0:1787119489.724976:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633309696 00000100:00100000:0.0:1787119489.724979:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633309696 00002000:00100000:0.0:1787119489.724996:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (1892352->1929215) req@ffff92a63eb28380 x1873929633309696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.725004:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633309696 ext(1892352->1929215) 00002000:00010000:0.0:1787119489.725008:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb28380 00000100:00100000:0.0:1787119489.725025:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9450 00000100:00100000:0.0:1787119489.725034:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633309568:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.725255:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633309568:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 221us (477us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.725264:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9450 00002000:00100000:0.0:1787119489.725270:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (28184576->28188671) req@ffff92a63eb2bb80 x1873929633309568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.725276:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2bb80 with x1873929633309568 ext(28184576->28188671) 00002000:00010000:0.0:1787119489.725279:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2bb80 00000100:00100000:0.0:1787119489.725294:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9451 00000100:00100000:0.0:1787119489.725300:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633309696:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.725498:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633309312:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3226us (7834us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119489.725505:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9448 00002000:00100000:0.0:1787119489.725511:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (22183936->22241279) req@ffff92a50600b100 x1873929633309312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.725519:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600b100 with x1873929633309312 ext(22183936->22241279) 00002000:00010000:0.0:1787119489.725523:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50600b100 00000100:00100000:0.0:1787119489.727363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.727626:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633309440:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5234us (5565us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119489.727636:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9449 00002000:00100000:0.0:1787119489.727647:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (28229632->28266495) req@ffff92a63eb2b100 x1873929633309440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.727656:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b100 with x1873929633309440 ext(28229632->28266495) 00002000:00010000:0.0:1787119489.727661:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b100 00000100:00100000:3.0:1787119489.730526:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633309824 00000100:00100000:3.0:1787119489.730542:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633309824 00000100:00100000:2.0:1787119489.730846:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4993 00000100:00100000:2.0:1787119489.730857:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633309824:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119489.735251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.735292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.735323:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633309952 00000100:00100000:2.0:1787119489.735331:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633309952 00002000:00100000:2.0:1787119489.735374:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (28188672->28192767) req@ffff92a506008700 x1873929633309952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.735385:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008700 with x1873929633309952 ext(28188672->28192767) 00002000:00010000:2.0:1787119489.735391:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008700 00000100:00100000:2.0:1787119489.735411:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633310080 00000100:00100000:2.0:1787119489.735414:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633310080 00000100:00100000:0.0:1787119489.735708:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9452 00000100:00100000:0.0:1787119489.735720:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633309952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.735772:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633309696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10470us (10931us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119489.735781:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9451 00002000:00100000:1.0:1787119489.735788:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (1892352->1929215) req@ffff92a63eb28380 x1873929633309696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.735796:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633309696 ext(1892352->1929215) 00002000:00010000:1.0:1787119489.735800:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb28380 00000100:00100000:0.0:1787119489.735924:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633309952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 206us (683us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.735932:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9452 00002000:00100000:0.0:1787119489.735938:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (28188672->28192767) req@ffff92a506008700 x1873929633309952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.735945:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008700 with x1873929633309952 ext(28188672->28192767) 00002000:00010000:0.0:1787119489.735949:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008700 00002000:00100000:2.0:1787119489.736049:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (16539648->16543743) req@ffff92a506008000 x1873929633310080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.736057:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008000 with x1873929633310080 ext(16539648->16543743) 00002000:00010000:2.0:1787119489.736061:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008000 00000100:00100000:2.0:1787119489.736076:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9453 00000100:00100000:2.0:1787119489.736084:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633310080:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.736208:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633310080:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 124us (915us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.736215:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9453 00002000:00100000:2.0:1787119489.736221:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (16539648->16543743) req@ffff92a506008000 x1873929633310080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.736228:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008000 with x1873929633310080 ext(16539648->16543743) 00002000:00010000:2.0:1787119489.736231:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008000 00000100:00100000:0.0:1787119489.747554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.747598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.747625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.749975:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633310464 00000100:00100000:0.0:1787119489.749990:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633310464 00000100:00100000:0.0:1787119489.750058:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19461 00000100:00100000:0.0:1787119489.750069:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+130:32720:x1873929633310464:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119489.750118:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119489.750146:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572000/0xcaba3de8463e29a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a74 expref: 130 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.750166:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119489.750172:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119489.750479:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633310208 00000100:00100000:1.0:1787119489.750485:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633310208 00002000:00100000:1.0:1787119489.750514:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (28184576->28250111) req@ffff92a63eb28a80 x1873929633310208/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.750522:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633310208 ext(28184576->28250111) 00002000:00010000:1.0:1787119489.750527:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28a80 00000100:00100000:1.0:1787119489.750544:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633310592 00000100:00100000:1.0:1787119489.750547:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633310592 00002000:00100000:1.0:1787119489.750572:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (28164096->28229631) req@ffff92a63eb29500 x1873929633310592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.750581:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633310592 ext(28164096->28229631) 00002000:00010000:1.0:1787119489.750585:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29500 00000100:00100000:1.0:1787119489.750598:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9454 00000100:00100000:1.0:1787119489.750606:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633310208:12345-192.168.201.59@tcp:4:fsx.0 00010000:00010000:0.0:1787119489.751112:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.751128:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.751139:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119489.751201:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976274 00000004:00010000:0.0:1787119489.751230:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007744a82a reply state 0000000031873d36 transno 4294976275 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.751239:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119489.751309:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+132:32720:x1873929633310464:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1240us (3708us total) trans 4294976275 rc 0/0 00000100:00100000:0.0:1787119489.751317:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19461 00000020:00080000:0.0:1787119489.751322:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119489.751347:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9455 00000100:00100000:0.0:1787119489.751355:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633310592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.757258:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633309824:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 26391us (29892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.757273:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4993 00000001:00080000:1.0:1787119489.757360:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969056 is committed 00000100:00100000:1.0:1787119489.757463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.757854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.757938:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633310720 00000100:00100000:2.0:1787119489.757946:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633310720 00002000:00100000:2.0:1787119489.757981:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (16543744->16547839) req@ffff92a6068bc000 x1873929633310720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.757991:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633310720 ext(16543744->16547839) 00002000:00010000:2.0:1787119489.757997:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc000 00000100:00100000:2.0:1787119489.758022:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633310848 00000100:00100000:2.0:1787119489.758026:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633310848 00002000:00010000:2.0:1787119489.758042:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (9936520->18446744073709551615) 00002000:00100000:2.0:1787119489.758044:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc380 with x1873929633310848 ext(9936520->18446744073709551615) 00002000:00010000:2.0:1787119489.758054:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc380. 00000100:00100000:2.0:1787119489.758070:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9456 00000100:00100000:2.0:1787119489.758078:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633310720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.758233:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633310720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 155us (770us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.758240:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9456 00002000:00100000:2.0:1787119489.758246:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (16543744->16547839) req@ffff92a6068bc000 x1873929633310720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.758254:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633310720 ext(16543744->16547839) 00002000:00010000:2.0:1787119489.758258:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc000 00000100:00100000:2.0:1787119489.758271:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9457 00000100:00100000:2.0:1787119489.758279:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633310848:12345-192.168.201.59@tcp:10:fsx.0 00010000:00010000:0.0:1787119489.758940:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.758953:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.758959:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.758966:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045f400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119489.758970:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.758978:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.758998:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119489.759001:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119489.759005:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.759011:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f400/0xcaba3de8463e29b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119489.759302:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 64395778 -> 9936520 00002000:00010000:2.0:1787119489.759306:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119489.759309:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.759311:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119489.759314:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:3.0:1787119489.760122:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633310208:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9507us (12567us total) trans 4294969057 rc 0/0 00000100:00100000:3.0:1787119489.760134:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9454 00002000:00100000:3.0:1787119489.760145:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (28184576->28250111) req@ffff92a63eb28a80 x1873929633310208/t4294969057(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/448 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.760156:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633310208 ext(28184576->28250111) 00002000:00010000:3.0:1787119489.760161:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28a80 00000100:00100000:0.0:1787119489.760882:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633310592:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9522us (13251us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119489.760892:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9455 00002000:00100000:0.0:1787119489.760900:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (28164096->28229631) req@ffff92a63eb29500 x1873929633310592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.760909:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633310592 ext(28164096->28229631) 00002000:00010000:0.0:1787119489.760913:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29500 00000100:00100000:2.0:1787119489.761323:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633310848:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 3041us (3466us total) trans 4294968828 rc 0/0 00000100:00100000:2.0:1787119489.761331:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9457 00002000:00010000:2.0:1787119489.761335:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (9936520->18446744073709551615) 00002000:00100000:2.0:1787119489.761338:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc380 with x1873929633310848 ext(9936520->18446744073709551615) 00002000:00010000:2.0:1787119489.761348:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc380. 00000100:00100000:2.0:1787119489.766763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.766834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.766858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.766879:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633311104 00000100:00100000:3.0:1787119489.766889:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633311104 00000100:00100000:3.0:1787119489.766944:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4994 00000100:00100000:3.0:1787119489.766954:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633311104:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119489.766961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.766989:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633310976 00000100:00100000:0.0:1787119489.766993:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633310976 00002000:00100000:0.0:1787119489.767020:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (28184576->28188671) req@ffff92a50600b480 x1873929633310976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.767031:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600b480 with x1873929633310976 ext(28184576->28188671) 00002000:00010000:0.0:1787119489.767037:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600b480 00000100:00100000:1.0:1787119489.767062:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633311360 00000100:00100000:1.0:1787119489.767066:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633311360 00002000:00100000:1.0:1787119489.767086:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (28229632->28266495) req@ffff92a50600aa00 x1873929633311360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.767095:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600aa00 with x1873929633311360 ext(28229632->28266495) 00002000:00010000:1.0:1787119489.767099:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600aa00 00000100:00100000:1.0:1787119489.767125:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9458 00000100:00100000:1.0:1787119489.767133:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633310976:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.767156:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9459 00000100:00100000:3.0:1787119489.767164:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633311360:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.767346:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633310976:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 213us (592us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.767355:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9458 00002000:00100000:1.0:1787119489.767362:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (28184576->28188671) req@ffff92a50600b480 x1873929633310976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.767370:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600b480 with x1873929633310976 ext(28184576->28188671) 00002000:00010000:1.0:1787119489.767374:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600b480 00000100:00100000:2.0:1787119489.767749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.767921:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633311488 00000100:00100000:3.0:1787119489.767927:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633311488 00000100:00100000:3.0:1787119489.767956:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19462 00000100:00100000:3.0:1787119489.767962:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+131:32720:x1873929633311488:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.767978:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.767997:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e29bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a82 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.768052:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633311232 00000100:00100000:1.0:1787119489.768056:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633311232 00010000:00010000:3.0:1787119489.768075:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e29c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1787119489.768077:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (16519168->16584703) req@ffff92a506008a80 x1873929633311232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.768086:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008a80 with x1873929633311232 ext(16519168->16584703) 00010000:00010000:3.0:1787119489.768088:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e29c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119489.768089:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008a80 00010000:00010000:3.0:1787119489.768099:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e29c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.768107:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9460 00000100:00100000:1.0:1787119489.768113:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633311232:12345-192.168.201.59@tcp:3:fsx.0 00000004:00200000:3.0:1787119489.768123:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 9936520 00000004:00200000:3.0:1787119489.768127:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.768143:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e29c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.768169:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e29bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a82 expref: 133 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.768189:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e29c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a82 expref: 132 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.768198:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119489.768200:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.768204:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600031200, rc 0) 00000100:00100000:3.0:1787119489.768239:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+132:32720:x1873929633311488:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 276us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.768246:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19462 00000100:00100000:3.0:1787119489.773787:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633311360:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6614us (6919us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119489.773800:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9459 00002000:00100000:3.0:1787119489.773812:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (28229632->28266495) req@ffff92a50600aa00 x1873929633311360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.773822:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600aa00 with x1873929633311360 ext(28229632->28266495) 00002000:00010000:3.0:1787119489.773829:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600aa00 00000100:00100000:3.0:1787119489.774408:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633311232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6292us (7443us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.774417:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9460 00000100:00100000:1.0:1787119489.774428:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:3.0:1787119489.774433:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (16519168->16584703) req@ffff92a506008a80 x1873929633311232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.774458:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008a80 with x1873929633311232 ext(16519168->16584703) 00002000:00010000:3.0:1787119489.774462:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008a80 00000100:00100000:2.0:1787119489.774713:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633311616 00000100:00100000:2.0:1787119489.774721:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633311616 00002000:00100000:2.0:1787119489.774759:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (28188672->28192767) req@ffff92a6068bfb80 x1873929633311616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.774769:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bfb80 with x1873929633311616 ext(28188672->28192767) 00002000:00010000:2.0:1787119489.774772:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bfb80 00000100:00100000:2.0:1787119489.774801:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9461 00000100:00100000:2.0:1787119489.774811:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633311616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.775011:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633311616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 201us (583us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.775018:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9461 00002000:00100000:2.0:1787119489.775024:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (28188672->28192767) req@ffff92a6068bfb80 x1873929633311616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.775031:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bfb80 with x1873929633311616 ext(28188672->28192767) 00002000:00010000:2.0:1787119489.775034:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bfb80 00000100:00100000:1.0:1787119489.777645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.777736:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633311744 00000100:00100000:3.0:1787119489.778066:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633311744 00000100:00100000:2.0:1787119489.778156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.778213:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633311872 00000100:00100000:1.0:1787119489.778217:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633311872 00002000:00100000:1.0:1787119489.778252:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (28184576->28250111) req@ffff92a50600a680 x1873929633311872/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.778263:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600a680 with x1873929633311872 ext(28184576->28250111) 00002000:00010000:1.0:1787119489.778269:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600a680 00000100:00100000:1.0:1787119489.778302:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9462 00000100:00100000:1.0:1787119489.778312:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633311872:12345-192.168.201.59@tcp:4:fsx.0 00002000:00100000:3.0:1787119489.778579:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (6242304->6295551) req@ffff92a6068bc700 x1873929633311744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.778589:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc700 with x1873929633311744 ext(6242304->6295551) 00002000:00010000:3.0:1787119489.778593:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc700 00000100:00100000:3.0:1787119489.778662:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9463 00000100:00100000:3.0:1787119489.778670:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633311744:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.781984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.784811:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633311744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6129us (7164us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1787119489.784825:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9463 00002000:00100000:3.0:1787119489.784839:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (6242304->6295551) req@ffff92a6068bc700 x1873929633311744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.784849:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc700 with x1873929633311744 ext(6242304->6295551) 00002000:00010000:3.0:1787119489.784856:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc700 00000100:00100000:1.0:1787119489.786110:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633311872:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 7793us (7948us total) trans 4294969058 rc 0/0 00000100:00100000:1.0:1787119489.786142:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9462 00002000:00100000:1.0:1787119489.786153:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (28184576->28250111) req@ffff92a50600a680 x1873929633311872/t4294969058(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/448 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.786164:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600a680 with x1873929633311872 ext(28184576->28250111) 00002000:00010000:1.0:1787119489.786170:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600a680 00000100:00100000:2.0:1787119489.786398:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633312000 00000100:00100000:2.0:1787119489.786407:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633312000 00002000:00100000:3.0:1787119489.786952:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (28164096->28229631) req@ffff92a63ebd5880 x1873929633312000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.786963:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5880 with x1873929633312000 ext(28164096->28229631) 00002000:00010000:3.0:1787119489.786967:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5880 00000100:00100000:3.0:1787119489.786996:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9464 00000100:00100000:3.0:1787119489.787006:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633312000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.791040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.791076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.791152:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633312256 00000100:00100000:0.0:1787119489.791162:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633312256 00000100:00100000:0.0:1787119489.791217:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19463 00000100:00100000:0.0:1787119489.791227:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+132:32724:x1873929633312256:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119489.791280:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119489.791307:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030000/0xcaba3de8463e29af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a7b expref: 132 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.791324:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119489.791329:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119489.791583:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.791597:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.791779:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119489.791838:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976276 00000004:00010000:0.0:1787119489.791864:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089c8fc95 reply state 0000000071286197 transno 4294976277 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.791874:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119489.791959:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+134:32724:x1873929633312256:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 733us (929us total) trans 4294976277 rc 0/0 00000100:00100000:0.0:1787119489.791968:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19463 00000020:00080000:0.0:1787119489.791973:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119489.792764:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633312000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5756us (10785us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.792775:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9464 00002000:00100000:3.0:1787119489.792784:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (28164096->28229631) req@ffff92a63ebd5880 x1873929633312000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.792794:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5880 with x1873929633312000 ext(28164096->28229631) 00002000:00010000:3.0:1787119489.792799:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5880 00010000:00010000:3.0:1787119489.794040:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.794058:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.794066:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.794072:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045ec00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.794077:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.794085:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.794100:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119489.794103:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.794107:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.794113:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e29cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.794727:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633312384 00000100:00100000:0.0:1787119489.794737:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633312384 00000100:00100000:0.0:1787119489.794889:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4995 00000100:00100000:0.0:1787119489.794900:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633312384:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119489.796123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.796192:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633312512 00000100:00100000:3.0:1787119489.796199:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633312512 00002000:00010000:3.0:1787119489.796226:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (46658807->18446744073709551615) 00002000:00100000:3.0:1787119489.796230:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b480 with x1873929633312512 ext(46658807->18446744073709551615) 00002000:00010000:3.0:1787119489.796242:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2b480. 00000100:00100000:3.0:1787119489.796272:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9465 00000100:00100000:3.0:1787119489.796281:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633312512:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119489.796983:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 27931118 -> 46658807 00002000:00010000:3.0:1787119489.796989:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119489.796992:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119487 -> 1787119488 00002000:00010000:3.0:1787119489.796995:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119489.796997:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1165 -> 1421 00000100:00100000:3.0:1787119489.797096:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633312512:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 814us (977us total) trans 4294968829 rc 0/0 00000100:00100000:3.0:1787119489.797105:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9465 00002000:00010000:3.0:1787119489.797110:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (46658807->18446744073709551615) 00002000:00100000:3.0:1787119489.797113:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b480 with x1873929633312512 ext(46658807->18446744073709551615) 00002000:00010000:3.0:1787119489.797118:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2b480. 00000100:00100000:0.0:1787119489.803969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.803998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.804022:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633312640 00000100:00100000:0.0:1787119489.804031:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633312640 00002000:00100000:0.0:1787119489.804074:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (3031040->3035135) req@ffff92a63eb28000 x1873929633312640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.804085:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28000 with x1873929633312640 ext(3031040->3035135) 00002000:00010000:0.0:1787119489.804090:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb28000 00000100:00100000:1.0:1787119489.804099:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633312768 00000100:00100000:1.0:1787119489.804103:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633312768 00000100:00100000:0.0:1787119489.804116:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9466 00002000:00100000:1.0:1787119489.804122:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (28229632->28266495) req@ffff92a63eb28e00 x1873929633312768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787119489.804124:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633312640:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:1.0:1787119489.804131:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28e00 with x1873929633312768 ext(28229632->28266495) 00002000:00010000:1.0:1787119489.804134:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28e00 00000100:00100000:1.0:1787119489.804150:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9467 00000100:00100000:1.0:1787119489.804155:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633312768:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.804312:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633312640:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 187us (351us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.804320:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9466 00002000:00100000:0.0:1787119489.804326:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (3031040->3035135) req@ffff92a63eb28000 x1873929633312640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.804334:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28000 with x1873929633312640 ext(3031040->3035135) 00002000:00010000:0.0:1787119489.804337:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb28000 00000100:00100000:1.0:1787119489.804338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.804566:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633312896 00000100:00100000:2.0:1787119489.804571:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633312896 00000100:00100000:2.0:1787119489.804611:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19464 00000100:00100000:2.0:1787119489.804618:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+133:32724:x1873929633312896:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119489.804633:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119489.804654:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560c00/0xcaba3de8463e29d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a89 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.804729:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e29d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.804743:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e29d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.804763:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e29d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119489.804787:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 46658807 00000004:00200000:2.0:1787119489.804792:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119489.804809:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e29d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.804834:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560c00/0xcaba3de8463e29d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a89 expref: 135 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.804849:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e29d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a89 expref: 134 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.804857:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119489.804860:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119489.804864:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e560a00, rc 0) 00000100:00100000:2.0:1787119489.805195:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+134:32724:x1873929633312896:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 577us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.805202:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19464 00000100:00100000:1.0:1787119489.808987:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633312768:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4820us (4976us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119489.808999:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9467 00000100:00100000:0.0:1787119489.809452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:1.0:1787119489.810122:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (28229632->28266495) req@ffff92a63eb28e00 x1873929633312768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.810135:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28e00 with x1873929633312768 ext(28229632->28266495) 00002000:00010000:1.0:1787119489.810143:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28e00 00000100:00100000:1.0:1787119489.811663:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633313024 00000100:00100000:1.0:1787119489.811680:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633313024 00002000:00100000:1.0:1787119489.811732:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (3035136->3039231) req@ffff92a63eb29180 x1873929633313024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.811744:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29180 with x1873929633313024 ext(3035136->3039231) 00002000:00010000:1.0:1787119489.811750:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29180 00000100:00100000:1.0:1787119489.811775:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9468 00000100:00100000:1.0:1787119489.811784:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633313024:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.812034:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633313024:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 250us (2597us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.812042:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9468 00002000:00100000:1.0:1787119489.812049:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (3035136->3039231) req@ffff92a63eb29180 x1873929633313024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.812056:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29180 with x1873929633313024 ext(3035136->3039231) 00002000:00010000:1.0:1787119489.812059:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29180 00000100:00100000:0.0:1787119489.815544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.816103:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633313152 00000100:00100000:2.0:1787119489.816115:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633313152 00002000:00100000:2.0:1787119489.816165:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (3010560->3076095) req@ffff92a63eb29f80 x1873929633313152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.816176:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633313152 ext(3010560->3076095) 00002000:00010000:2.0:1787119489.816182:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29f80 00000100:00100000:2.0:1787119489.816218:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9469 00000100:00100000:2.0:1787119489.816227:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633313152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.821995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.822078:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633313280 00000100:00100000:2.0:1787119489.822097:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633313280 00002000:00100000:2.0:1787119489.822143:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (4595712->4599807) req@ffff92a63ebd5f80 x1873929633313280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.822155:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5f80 with x1873929633313280 ext(4595712->4599807) 00002000:00010000:2.0:1787119489.822160:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd5f80 00000100:00100000:2.0:1787119489.822193:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9470 00000100:00100000:2.0:1787119489.822203:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633313280:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.822429:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633313280:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 219us (472us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.822457:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9470 00002000:00100000:2.0:1787119489.822471:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (4595712->4599807) req@ffff92a63ebd5f80 x1873929633313280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.822485:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5f80 with x1873929633313280 ext(4595712->4599807) 00002000:00010000:2.0:1787119489.822489:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd5f80 00000100:00100000:0.0:1787119489.822839:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633313152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6611us (7305us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119489.822848:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9469 00002000:00100000:0.0:1787119489.822854:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (3010560->3076095) req@ffff92a63eb29f80 x1873929633313152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.822863:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633313152 ext(3010560->3076095) 00002000:00010000:0.0:1787119489.822867:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29f80 00000001:00080000:3.0:1787119489.825070:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969057 is committed 00000100:00100000:0.0:1787119489.826314:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633311104:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 59355us (59473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119489.826325:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4994 00000100:00100000:0.0:1787119489.834045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.834157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.835378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.835572:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633313408 00000100:00100000:1.0:1787119489.835581:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633313408 00002000:00100000:1.0:1787119489.835630:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (28184576->28250111) req@ffff92a63eb2b800 x1873929633313408/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.835641:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633313408 ext(28184576->28250111) 00002000:00010000:1.0:1787119489.835646:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b800 00000100:00100000:1.0:1787119489.835668:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633313536 00000100:00100000:1.0:1787119489.835671:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633313536 00002000:00100000:1.0:1787119489.835688:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (3076096->3112959) req@ffff92a63eb2a300 x1873929633313536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.835696:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a300 with x1873929633313536 ext(3076096->3112959) 00002000:00010000:1.0:1787119489.835699:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2a300 00000100:00100000:1.0:1787119489.835718:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9471 00000100:00100000:1.0:1787119489.835727:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633313408:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119489.835943:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9472 00000100:00100000:1.0:1787119489.835951:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633313536:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.837632:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633313664 00000100:00100000:1.0:1787119489.837643:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633313664 00002000:00100000:1.0:1787119489.837684:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (4599808->4603903) req@ffff92a509640700 x1873929633313664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.837695:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640700 with x1873929633313664 ext(4599808->4603903) 00002000:00010000:1.0:1787119489.837700:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640700 00000100:00100000:1.0:1787119489.837729:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9473 00000100:00100000:1.0:1787119489.837738:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633313664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.839658:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633313664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1566us (3930us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.839671:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9473 00002000:00100000:1.0:1787119489.839681:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (4599808->4603903) req@ffff92a509640700 x1873929633313664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.839691:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640700 with x1873929633313664 ext(4599808->4603903) 00002000:00010000:1.0:1787119489.839696:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640700 00000100:00100000:3.0:1787119489.850654:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633313408:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 14918us (16605us total) trans 4294969059 rc 0/0 00000100:00100000:3.0:1787119489.850671:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9471 00002000:00100000:3.0:1787119489.850684:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (28184576->28250111) req@ffff92a63eb2b800 x1873929633313408/t4294969059(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/448 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.850695:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633313408 ext(28184576->28250111) 00002000:00010000:3.0:1787119489.850701:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b800 00000100:00100000:3.0:1787119489.855500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.855692:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633313920 00000100:00100000:1.0:1787119489.855702:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633313920 00000100:00100000:1.0:1787119489.855765:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19465 00000100:00100000:1.0:1787119489.855775:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+134:32728:x1873929633313920:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119489.855828:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119489.855856:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e291c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a4a expref: 134 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.855874:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119489.855879:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119489.856064:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.856077:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.856086:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119489.856130:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976278 00000004:00010000:1.0:1787119489.856153:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4ab85be reply state 00000000ad830f38 transno 4294976279 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.856162:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119489.856245:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+136:32728:x1873929633313920:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 472us (756us total) trans 4294976279 rc 0/0 00000100:00100000:1.0:1787119489.856252:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19465 00000020:00080000:1.0:1787119489.856257:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119489.858435:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633313536:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22469us (24263us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119489.858467:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9472 00002000:00100000:1.0:1787119489.858480:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (3076096->3112959) req@ffff92a63eb2a300 x1873929633313536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.858489:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a300 with x1873929633313536 ext(3076096->3112959) 00002000:00010000:1.0:1787119489.858495:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2a300 00000100:00100000:3.0:1787119489.859663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.859815:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633314048 00000100:00100000:1.0:1787119489.859823:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633314048 00002000:00100000:1.0:1787119489.859864:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (4575232->4640767) req@ffff92a63ebd7b80 x1873929633314048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.859878:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7b80 with x1873929633314048 ext(4575232->4640767) 00002000:00010000:1.0:1787119489.859882:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd7b80 00000100:00100000:1.0:1787119489.859914:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9474 00000100:00100000:1.0:1787119489.859923:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633314048:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.860393:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.860634:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633314176 00000100:00100000:3.0:1787119489.860640:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633314176 00000100:00100000:3.0:1787119489.860714:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4996 00000100:00100000:3.0:1787119489.860723:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633314176:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119489.865253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119489.865278:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.865292:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.865300:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.865306:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e572c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119489.865311:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.865314:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633314304 00010000:00010000:2.0:1787119489.865317:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.865322:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633314304 00010000:00010000:2.0:1787119489.865332:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119489.865335:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119489.865338:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.865344:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572c00/0xcaba3de8463e29e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119489.865357:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (64395778->18446744073709551615) 00002000:00100000:1.0:1787119489.865362:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6d80 with x1873929633314304 ext(64395778->18446744073709551615) 00002000:00010000:1.0:1787119489.865372:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd6d80. 00000100:00100000:1.0:1787119489.865403:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9475 00000100:00100000:1.0:1787119489.865412:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633314304:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119489.865979:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 56586156 -> 64395778 00002000:00010000:1.0:1787119489.865985:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119487 -> 1787119488 00002000:00010000:1.0:1787119489.865987:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119487 -> 1787119488 00002000:00010000:1.0:1787119489.865989:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119487 -> 1787119488 00002000:00010000:1.0:1787119489.865991:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1037 -> 1933 00000100:00100000:1.0:1787119489.866049:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633314304:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 637us (805us total) trans 4294969060 rc 0/0 00000100:00100000:1.0:1787119489.866056:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9475 00002000:00010000:1.0:1787119489.866060:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (64395778->18446744073709551615) 00002000:00100000:1.0:1787119489.866062:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6d80 with x1873929633314304 ext(64395778->18446744073709551615) 00002000:00010000:1.0:1787119489.866067:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd6d80. 00000100:00100000:0.0:1787119489.870748:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633314048:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10814us (11080us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119489.870764:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9474 00002000:00100000:0.0:1787119489.870776:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (4575232->4640767) req@ffff92a63ebd7b80 x1873929633314048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.870787:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7b80 with x1873929633314048 ext(4575232->4640767) 00002000:00010000:0.0:1787119489.870795:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd7b80 00000100:00100000:1.0:1787119489.872991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.873051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.873141:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633314560 00000100:00100000:3.0:1787119489.873150:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633314560 00000100:00100000:3.0:1787119489.873205:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633314688 00000100:00100000:3.0:1787119489.873209:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633314688 00000100:00100000:3.0:1787119489.873234:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19466 00000100:00100000:3.0:1787119489.873242:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+136:32720:x1873929633314560:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.873299:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787119489.873314:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19467 00000100:00100000:1.0:1787119489.873323:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+136:32728:x1873929633314688:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.873327:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e29c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a82 expref: 136 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.873332:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.873344:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119489.873347:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e29e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.873349:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119489.873400:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e29ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.873413:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e29ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.873422:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e29ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119489.873460:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 64395778 00010000:00010000:3.0:1787119489.873590:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119489.873591:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1787119489.873598:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787119489.873612:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e29ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.873638:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e29e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a90 expref: 138 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.873651:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e29ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a90 expref: 137 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.873659:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119489.873662:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119489.873666:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e573c00, rc 0) 00010000:00010000:3.0:1787119489.873679:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.873715:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+137:32728:x1873929633314688:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 393us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.873722:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19467 00000001:00080000:3.0:1787119489.873731:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976280 00000004:00010000:3.0:1787119489.873767:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebc32a8c reply state 000000001099ef8e transno 4294976281 ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.873776:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119489.873821:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+138:32720:x1873929633314560:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 579us (851us total) trans 4294976281 rc 0/0 00000100:00100000:3.0:1787119489.873830:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19466 00000020:00080000:3.0:1787119489.873834:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119489.877171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.877637:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633314816 00000100:00100000:2.0:1787119489.877647:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633314816 00002000:00100000:2.0:1787119489.877695:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (4640768->4677631) req@ffff92a63ebd7800 x1873929633314816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.877707:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7800 with x1873929633314816 ext(4640768->4677631) 00002000:00010000:2.0:1787119489.877713:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd7800 00000100:00100000:2.0:1787119489.877746:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9476 00000100:00100000:2.0:1787119489.877755:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633314816:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119489.877836:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.877847:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.877855:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.877862:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a600031a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.877868:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.877875:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.877890:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119489.877893:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.877897:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.877902:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.881044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.881098:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633314944 00000100:00100000:2.0:1787119489.881108:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633314944 00002000:00010000:2.0:1787119489.881143:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (9219840->18446744073709551615) 00002000:00100000:2.0:1787119489.881148:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7480 with x1873929633314944 ext(9219840->18446744073709551615) 00002000:00010000:2.0:1787119489.881160:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd7480. 00000100:00100000:2.0:1787119489.881191:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9477 00000100:00100000:2.0:1787119489.881200:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633314944:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119489.881609:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 9936520 -> 9219840 00002000:00010000:2.0:1787119489.881614:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119489.881616:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:2.0:1787119489.881618:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119489.881620:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119489.881683:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633314944:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 483us (647us total) trans 4294968830 rc 0/0 00000100:00100000:2.0:1787119489.881691:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9477 00002000:00010000:2.0:1787119489.881695:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (9219840->18446744073709551615) 00002000:00100000:2.0:1787119489.881698:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7480 with x1873929633314944 ext(9219840->18446744073709551615) 00002000:00010000:2.0:1787119489.881702:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd7480. 00000001:00080000:1.0:1787119489.883116:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969058 is committed 00000100:00100000:0.0:1787119489.883857:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633312384:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 88954us (92773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119489.883867:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4995 00000100:00100000:1.0:1787119489.901812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.901914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.902428:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633315072 00000100:00100000:2.0:1787119489.902593:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633315072 00002000:00100000:2.0:1787119489.902643:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (27275264->27328511) req@ffff92a5069e3b80 x1873929633315072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.902655:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3b80 with x1873929633315072 ext(27275264->27328511) 00002000:00010000:2.0:1787119489.902661:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e3b80 00000100:00100000:2.0:1787119489.902689:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9478 00000100:00100000:2.0:1787119489.902698:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633315072:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.904384:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633315200 00000100:00100000:3.0:1787119489.904396:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633315200 00000100:00100000:3.0:1787119489.904463:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19468 00000100:00100000:3.0:1787119489.904473:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+137:32720:x1873929633315200:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119489.904492:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119489.904512:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a97 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.904602:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e2a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.905402:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e2a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.905431:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e2a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119489.905493:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 9219840 00000004:00200000:3.0:1787119489.905498:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119489.905517:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e2a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.905548:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e29fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a97 expref: 139 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.905579:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e2a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a97 expref: 138 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.905588:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119489.905591:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119489.905594:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600031200, rc 0) 00000100:00100000:3.0:1787119489.906289:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+138:32720:x1873929633315200:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1814us (4371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.906303:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19468 00000100:00100000:3.0:1787119489.906416:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633314816:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 28661us (29254us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119489.906425:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9476 00002000:00100000:3.0:1787119489.906435:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (4640768->4677631) req@ffff92a63ebd7800 x1873929633314816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.906473:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7800 with x1873929633314816 ext(4640768->4677631) 00002000:00010000:3.0:1787119489.906478:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd7800 00000100:00100000:3.0:1787119489.915256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.915294:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633315456 00000100:00100000:3.0:1787119489.915304:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633315456 00000100:00100000:3.0:1787119489.915362:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19469 00000100:00100000:3.0:1787119489.915374:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+138:32729:x1873929633315456:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.915456:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119489.915487:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2931 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a51 expref: 138 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.915505:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119489.915510:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119489.916215:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.916231:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.916239:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119489.916291:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976282 00000004:00010000:3.0:1787119489.916315:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005285cd26 reply state 00000000e351a6b4 transno 4294976283 ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.916324:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119489.916930:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+140:32729:x1873929633315456:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1553us (1684us total) trans 4294976283 rc 0/0 00000100:00100000:3.0:1787119489.917366:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19469 00000020:00080000:3.0:1787119489.917375:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119489.918275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.920020:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633315072:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17315us (18211us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1787119489.920034:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9478 00002000:00100000:3.0:1787119489.920046:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (27275264->27328511) req@ffff92a5069e3b80 x1873929633315072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.920056:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3b80 with x1873929633315072 ext(27275264->27328511) 00002000:00010000:3.0:1787119489.920062:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e3b80 00000100:00100000:3.0:1787119489.920087:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633315584 00000100:00100000:3.0:1787119489.920094:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633315584 00002000:00100000:3.0:1787119489.920129:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (24838144->24842239) req@ffff92a506e5a300 x1873929633315584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.920138:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5a300 with x1873929633315584 ext(24838144->24842239) 00002000:00010000:3.0:1787119489.920142:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e5a300 00000100:00100000:3.0:1787119489.920166:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9479 00000100:00100000:3.0:1787119489.920176:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633315584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.920369:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633315584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 194us (2308us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.920377:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9479 00002000:00100000:3.0:1787119489.920383:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (24838144->24842239) req@ffff92a506e5a300 x1873929633315584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.920392:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5a300 with x1873929633315584 ext(24838144->24842239) 00002000:00010000:3.0:1787119489.920395:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e5a300 00010000:00010000:3.0:1787119489.921184:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.921196:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.921203:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.921210:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a600031a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.921215:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.921223:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.921239:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119489.921241:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.921246:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.921252:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.921952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.922397:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633315712 00000100:00100000:0.0:1787119489.922407:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633315712 00002000:00010000:0.0:1787119489.922478:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (64395778->18446744073709551615) 00002000:00100000:0.0:1787119489.922483:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58e00 with x1873929633315712 ext(64395778->18446744073709551615) 00002000:00010000:0.0:1787119489.922497:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e58e00. 00000100:00100000:0.0:1787119489.922525:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9480 00000100:00100000:0.0:1787119489.922534:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633315712:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119489.922824:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 56586156 -> 64395778 00002000:00010000:0.0:1787119489.922828:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119489.922831:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119488 00002000:00010000:0.0:1787119489.922833:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119489.922835:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1037 -> 1933 00000100:00100000:0.0:1787119489.922892:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633315712:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 358us (943us total) trans 4294969061 rc 0/0 00000100:00100000:0.0:1787119489.922898:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9480 00002000:00010000:0.0:1787119489.922902:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (64395778->18446744073709551615) 00002000:00100000:0.0:1787119489.922904:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58e00 with x1873929633315712 ext(64395778->18446744073709551615) 00002000:00010000:0.0:1787119489.922909:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e58e00. 00000100:00100000:0.0:1787119489.923708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.923771:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633315968 00000100:00100000:3.0:1787119489.923777:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633315968 00000100:00100000:3.0:1787119489.923822:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19470 00000100:00100000:3.0:1787119489.923830:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+139:32720:x1873929633315968:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119489.923876:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119489.923903:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031200/0xcaba3de8463e2a03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a97 expref: 139 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.923922:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119489.923927:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119489.924095:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.924109:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.924118:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119489.924159:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976284 00000004:00010000:3.0:1787119489.924179:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a61491a reply state 00000000bc5f3e89 transno 4294976285 ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.924188:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119489.924259:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+141:32720:x1873929633315968:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 430us (554us total) trans 4294976285 rc 0/0 00000100:00100000:3.0:1787119489.924266:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19470 00000020:00080000:3.0:1787119489.924270:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119489.932664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.932713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.932732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.932757:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633316096 00000100:00100000:0.0:1787119489.932765:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633316096 00002000:00100000:0.0:1787119489.932805:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (24842240->24846335) req@ffff92a509642a00 x1873929633316096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.932817:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642a00 with x1873929633316096 ext(24842240->24846335) 00002000:00010000:0.0:1787119489.932822:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509642a00 00000100:00100000:0.0:1787119489.932842:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633316352 00000100:00100000:0.0:1787119489.932844:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633316352 00002000:00010000:0.0:1787119489.932854:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (27931118->18446744073709551615) 00002000:00100000:0.0:1787119489.932857:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643b80 with x1873929633316352 ext(27931118->18446744073709551615) 00002000:00010000:0.0:1787119489.932867:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509643b80. 00000100:00100000:0.0:1787119489.932878:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633316224 00000100:00100000:0.0:1787119489.932880:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633316224 00002000:00100000:0.0:1787119489.932895:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (1847296->1851391) req@ffff92a509642d80 x1873929633316224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.932903:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642d80 with x1873929633316224 ext(1847296->1851391) 00002000:00010000:0.0:1787119489.932907:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509642d80 00000100:00100000:0.0:1787119489.932923:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9481 00000100:00100000:0.0:1787119489.932932:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633316096:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.933228:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633316096:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 296us (568us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.933236:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9481 00002000:00100000:0.0:1787119489.933243:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (24842240->24846335) req@ffff92a509642a00 x1873929633316096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.933252:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642a00 with x1873929633316096 ext(24842240->24846335) 00002000:00010000:0.0:1787119489.933256:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509642a00 00000100:00100000:0.0:1787119489.933273:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9482 00000100:00100000:0.0:1787119489.933280:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633316352:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:3.0:1787119489.933341:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9483 00000100:00100000:3.0:1787119489.933349:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633316224:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.933480:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633316224:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 131us (746us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.933487:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9483 00002000:00100000:3.0:1787119489.933492:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (1847296->1851391) req@ffff92a509642d80 x1873929633316224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.933500:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642d80 with x1873929633316224 ext(1847296->1851391) 00002000:00010000:3.0:1787119489.933504:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509642d80 00002000:00010000:0.0:1787119489.933593:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 9219840 -> 27931118 00002000:00010000:0.0:1787119489.933597:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119489.933600:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119487 00002000:00010000:0.0:1787119489.933602:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119489.933605:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:0.0:1787119489.933641:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633316352:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 361us (927us total) trans 4294968831 rc 0/0 00000100:00100000:0.0:1787119489.933860:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9482 00002000:00010000:0.0:1787119489.933864:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (27931118->18446744073709551615) 00002000:00100000:0.0:1787119489.933867:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643b80 with x1873929633316352 ext(27931118->18446744073709551615) 00002000:00010000:0.0:1787119489.933872:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509643b80. 00010000:00010000:0.0:1787119489.934425:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.934436:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.934599:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.934606:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a600031c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119489.934611:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.934619:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.934636:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119489.934639:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119489.934644:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.934650:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.937755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.938226:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633316480 00000100:00100000:1.0:1787119489.938237:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633316480 00000100:00100000:1.0:1787119489.938328:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19471 00000100:00100000:1.0:1787119489.938339:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+140:32729:x1873929633316480:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119489.938360:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119489.938379:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573e00/0xcaba3de8463e2a18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715a9e expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.938606:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e2a1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.938621:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e2a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.938632:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e2a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119489.938659:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 64395778 00000004:00200000:1.0:1787119489.938664:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119489.938682:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e2a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.938709:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573e00/0xcaba3de8463e2a18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a9e expref: 142 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.938726:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e2a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a9e expref: 141 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.938734:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119489.938737:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119489.938741:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e573600, rc 0) 00000100:00100000:1.0:1787119489.942665:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+141:32729:x1873929633316480:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 4316us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119489.942678:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19471 00000100:00100000:3.0:1787119489.944101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.944194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.944234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.944262:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633316608 00000100:00100000:3.0:1787119489.944271:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633316608 00002000:00100000:3.0:1787119489.944318:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (27869184->27873279) req@ffff92a506e5aa00 x1873929633316608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787119489.944319:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633316736 00000100:00100000:1.0:1787119489.944323:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633316736 00002000:00100000:3.0:1787119489.944329:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5aa00 with x1873929633316608 ext(27869184->27873279) 00002000:00010000:3.0:1787119489.944334:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e5aa00 00002000:00100000:1.0:1787119489.944341:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (24817664->24883199) req@ffff92a506e59880 x1873929633316736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.944349:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59880 with x1873929633316736 ext(24817664->24883199) 00002000:00010000:1.0:1787119489.944352:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59880 00000100:00100000:3.0:1787119489.944361:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633316864 00000100:00100000:3.0:1787119489.944364:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633316864 00000100:00100000:1.0:1787119489.944369:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9484 00000100:00100000:1.0:1787119489.944377:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633316608:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:3.0:1787119489.944379:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (1851392->1855487) req@ffff92a506e5bb80 x1873929633316864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.944386:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5bb80 with x1873929633316864 ext(1851392->1855487) 00002000:00010000:3.0:1787119489.944389:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5bb80 00000100:00100000:3.0:1787119489.944405:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9485 00000100:00100000:3.0:1787119489.944410:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633316736:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.944614:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9486 00000100:00100000:0.0:1787119489.944623:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633316864:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119489.944789:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633316864:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 167us (553us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119489.944796:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9486 00002000:00100000:0.0:1787119489.944802:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (1851392->1855487) req@ffff92a506e5bb80 x1873929633316864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.944810:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5bb80 with x1873929633316864 ext(1851392->1855487) 00002000:00010000:0.0:1787119489.944813:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5bb80 00000100:00100000:1.0:1787119489.945007:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633316608:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 629us (912us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.945014:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9484 00002000:00100000:1.0:1787119489.945019:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (27869184->27873279) req@ffff92a506e5aa00 x1873929633316608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.945027:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5aa00 with x1873929633316608 ext(27869184->27873279) 00002000:00010000:1.0:1787119489.945031:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e5aa00 00000100:00100000:0.0:1787119489.948226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.948303:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633316992 00000100:00100000:1.0:1787119489.948313:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633316992 00002000:00100000:1.0:1787119489.948356:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (1826816->1892351) req@ffff92a509641f80 x1873929633316992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.948367:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641f80 with x1873929633316992 ext(1826816->1892351) 00002000:00010000:1.0:1787119489.948372:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509641f80 00000100:00100000:1.0:1787119489.948394:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9487 00000001:00080000:3.0:1787119489.948403:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969060 is committed 00000100:00100000:1.0:1787119489.948403:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633316992:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.948494:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633314176:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 87772us (88102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119489.948502:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4996 00000100:00100000:3.0:1787119489.955889:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633316736:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11468us (11685us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119489.955904:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9485 00002000:00100000:3.0:1787119489.955917:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (24817664->24883199) req@ffff92a506e59880 x1873929633316736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.955928:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59880 with x1873929633316736 ext(24817664->24883199) 00002000:00010000:3.0:1787119489.955934:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59880 00000100:00100000:0.0:1787119489.957784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.957817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.957897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.957967:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633316992:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9562us (9748us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119489.957978:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9487 00002000:00100000:2.0:1787119489.957991:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (1826816->1892351) req@ffff92a509641f80 x1873929633316992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.958001:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641f80 with x1873929633316992 ext(1826816->1892351) 00002000:00010000:2.0:1787119489.958007:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509641f80 00000100:00100000:2.0:1787119489.958031:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633317120 00000100:00100000:2.0:1787119489.958039:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633317120 00002000:00100000:2.0:1787119489.958072:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (27873280->27877375) req@ffff92a509641500 x1873929633317120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.958080:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641500 with x1873929633317120 ext(27873280->27877375) 00002000:00010000:2.0:1787119489.958314:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641500 00000100:00100000:1.0:1787119489.960823:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633317248 00000100:00100000:1.0:1787119489.960837:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633317248 00002000:00100000:1.0:1787119489.960888:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (27275264->27328511) req@ffff92a509643100 x1873929633317248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.960901:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643100 with x1873929633317248 ext(27275264->27328511) 00002000:00010000:1.0:1787119489.960906:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643100 00000100:00100000:1.0:1787119489.960942:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9488 00000100:00100000:1.0:1787119489.960951:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633317120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.960988:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9489 00000100:00100000:3.0:1787119489.960997:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633317248:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.961213:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633317120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 257us (3431us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119489.961220:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9488 00002000:00100000:1.0:1787119489.961227:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (27873280->27877375) req@ffff92a509641500 x1873929633317120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.961247:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641500 with x1873929633317120 ext(27873280->27877375) 00002000:00010000:1.0:1787119489.961252:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641500 00000100:00100000:0.0:1787119489.962467:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633317504 00000100:00100000:0.0:1787119489.962478:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633317504 00000100:00100000:0.0:1787119489.962517:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19472 00000100:00100000:0.0:1787119489.962526:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+141:32727:x1873929633317504:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119489.962582:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119489.962677:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561800/0xcaba3de8463e2970 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a66 expref: 141 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.962696:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119489.962700:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119489.962890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119489.962890:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.962903:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.962912:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119489.962961:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976286 00000100:00100000:1.0:1787119489.963059:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633317632 00000100:00100000:1.0:1787119489.963064:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633317632 00002000:00100000:1.0:1787119489.963092:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (24883200->24920063) req@ffff92a50600bb80 x1873929633317632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.963101:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600bb80 with x1873929633317632 ext(24883200->24920063) 00002000:00010000:1.0:1787119489.963105:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50600bb80 00000100:00100000:1.0:1787119489.963130:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9490 00000100:00100000:1.0:1787119489.963138:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633317632:12345-192.168.201.59@tcp:3:fsx.0 00000004:00010000:0.0:1787119489.963379:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000641fd7e8 reply state 00000000484d07da transno 4294976287 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.963388:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119489.963767:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+143:32727:x1873929633317504:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1241us (5868us total) trans 4294976287 rc 0/0 00000100:00100000:0.0:1787119489.963774:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19472 00000020:00080000:0.0:1787119489.963779:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119489.967967:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.968069:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633317760 00000100:00100000:0.0:1787119489.968079:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633317760 00002000:00100000:0.0:1787119489.968122:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (27848704->27918335) req@ffff92a506e58380 x1873929633317760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.968134:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58380 with x1873929633317760 ext(27848704->27918335) 00002000:00010000:0.0:1787119489.968139:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e58380 00000100:00100000:0.0:1787119489.968174:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9491 00000100:00100000:0.0:1787119489.968183:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633317760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.968214:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633317248:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7217us (10395us total) trans 0 rc 53248/53248 00000100:00100000:2.0:1787119489.968221:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9489 00002000:00100000:2.0:1787119489.968228:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (27275264->27328511) req@ffff92a509643100 x1873929633317248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.968235:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643100 with x1873929633317248 ext(27275264->27328511) 00002000:00010000:2.0:1787119489.968239:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643100 00000100:00100000:1.0:1787119489.970880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.971011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119489.971061:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.971073:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.971080:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119489.971189:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633317632:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8050us (8297us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119489.971198:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9490 00002000:00100000:1.0:1787119489.971209:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (24883200->24920063) req@ffff92a50600bb80 x1873929633317632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.971220:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600bb80 with x1873929633317632 ext(24883200->24920063) 00002000:00010000:1.0:1787119489.971224:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50600bb80 00000100:00100000:1.0:1787119489.971246:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633318016 00000100:00100000:1.0:1787119489.971252:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633318016 00002000:00010000:1.0:1787119489.971274:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (64395778->18446744073709551615) 00002000:00100000:1.0:1787119489.971277:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2d80 with x1873929633318016 ext(64395778->18446744073709551615) 00002000:00010000:1.0:1787119489.971286:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2d80. 00010000:00010000:3.0:1787119489.971349:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045fc00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119489.971355:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.971363:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.971378:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119489.971381:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119489.971386:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119489.971392:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2a26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.971475:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633317888 00000100:00100000:0.0:1787119489.971480:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633317888 00002000:00100000:0.0:1787119489.971501:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (1892352->1929215) req@ffff92a5069e3800 x1873929633317888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.971511:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3800 with x1873929633317888 ext(1892352->1929215) 00002000:00010000:0.0:1787119489.971514:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e3800 00000100:00100000:0.0:1787119489.971530:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9492 00000100:00100000:0.0:1787119489.971539:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633318016:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:3.0:1787119489.971642:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9493 00000100:00100000:3.0:1787119489.971650:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633317888:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:0.0:1787119489.971784:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 56586156 -> 64395778 00002000:00010000:0.0:1787119489.971787:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119489.971790:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119487 -> 1787119488 00002000:00010000:0.0:1787119489.971792:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119489.971794:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1293 -> 1933 00000100:00100000:0.0:1787119489.971820:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633318016:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 282us (949us total) trans 4294969062 rc 0/0 00000100:00100000:0.0:1787119489.971827:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9492 00002000:00010000:0.0:1787119489.971831:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (64395778->18446744073709551615) 00002000:00100000:0.0:1787119489.971834:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2d80 with x1873929633318016 ext(64395778->18446744073709551615) 00002000:00010000:0.0:1787119489.971838:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2d80. 00000100:00100000:0.0:1787119489.975495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.975537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.975600:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633317760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7416us (7640us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1787119489.975612:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9491 00002000:00100000:3.0:1787119489.975625:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (27848704->27918335) req@ffff92a506e58380 x1873929633317760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.975635:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58380 with x1873929633317760 ext(27848704->27918335) 00002000:00010000:3.0:1787119489.975641:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e58380 00000100:00100000:3.0:1787119489.975663:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633318144 00000100:00100000:3.0:1787119489.975670:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633318144 00002000:00100000:3.0:1787119489.975701:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (1847296->1851391) req@ffff92a509640a80 x1873929633318144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.975709:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640a80 with x1873929633318144 ext(1847296->1851391) 00002000:00010000:3.0:1787119489.975713:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509640a80 00000100:00100000:3.0:1787119489.975734:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9494 00000100:00100000:3.0:1787119489.975753:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633318144:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.975806:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633318272 00000100:00100000:2.0:1787119489.975810:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633318272 00000100:00100000:2.0:1787119489.975882:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19473 00000100:00100000:2.0:1787119489.975899:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+142:32727:x1873929633318272:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119489.975916:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119489.975937:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2a2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715aa5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119489.975982:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633318144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 240us (495us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119489.975988:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9494 00002000:00100000:3.0:1787119489.975994:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (1847296->1851391) req@ffff92a509640a80 x1873929633318144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.976002:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640a80 with x1873929633318144 ext(1847296->1851391) 00002000:00010000:3.0:1787119489.976005:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509640a80 00010000:00010000:2.0:1787119489.976015:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.976030:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.976043:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119489.976072:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 64395778 00000004:00200000:2.0:1787119489.976077:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119489.976097:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.976122:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2a2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aa5 expref: 144 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.976146:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aa5 expref: 143 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119489.976155:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119489.976158:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119489.976162:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e560200, rc 0) 00000100:00100000:2.0:1787119489.976198:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+143:32727:x1873929633318272:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 309us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119489.976204:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19473 00000100:00100000:1.0:1787119489.982543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119489.982706:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633317888:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11055us (11693us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119489.982718:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9493 00002000:00100000:3.0:1787119489.982733:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (1892352->1929215) req@ffff92a5069e3800 x1873929633317888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.982744:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3800 with x1873929633317888 ext(1892352->1929215) 00002000:00010000:3.0:1787119489.982751:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e3800 00000100:00100000:3.0:1787119489.982775:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633318400 00000100:00100000:3.0:1787119489.982782:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633318400 00000100:00100000:0.0:1787119489.982813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:3.0:1787119489.982814:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (1851392->1855487) req@ffff92a5069e3480 x1873929633318400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119489.982822:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3480 with x1873929633318400 ext(1851392->1855487) 00002000:00010000:3.0:1787119489.982826:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e3480 00000100:00100000:2.0:1787119489.983104:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633318528 00000100:00100000:2.0:1787119489.983110:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633318528 00002000:00100000:2.0:1787119489.983133:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (27918336->27934719) req@ffff92a509641180 x1873929633318528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.983141:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641180 with x1873929633318528 ext(27918336->27934719) 00002000:00010000:2.0:1787119489.983145:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641180 00000100:00100000:2.0:1787119489.983172:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9495 00000100:00100000:2.0:1787119489.983181:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633318400:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119489.983238:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9496 00000100:00100000:3.0:1787119489.983247:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633318528:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.983363:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633318400:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 182us (829us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119489.983370:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9495 00000100:00100000:3.0:1787119489.983372:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633318528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 127us (560us total) trans 0 rc 16384/16384 00002000:00100000:2.0:1787119489.983375:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (1851392->1855487) req@ffff92a5069e3480 x1873929633318400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/4536 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119489.983378:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9496 00002000:00100000:3.0:1787119489.983383:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (27918336->27934719) req@ffff92a509641180 x1873929633318528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/16824 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.983384:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3480 with x1873929633318400 ext(1851392->1855487) 00002000:00010000:2.0:1787119489.983388:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e3480 00002000:00100000:3.0:1787119489.983391:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641180 with x1873929633318528 ext(27918336->27934719) 00002000:00010000:3.0:1787119489.983394:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641180 00000100:00100000:0.0:1787119489.986723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119489.986915:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633318656 00000100:00100000:2.0:1787119489.986925:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633318656 00002000:00100000:2.0:1787119489.986971:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (24838144->61856377) req@ffff92a509640000 x1873929633318656/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119489.986982:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640000 with x1873929633318656 ext(24838144->61856377) 00002000:00010000:2.0:1787119489.986988:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640000 00000100:00100000:2.0:1787119489.987025:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9497 00000100:00100000:2.0:1787119489.987035:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633318656:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119489.989956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119489.990059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.990263:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633318784 00000100:00100000:1.0:1787119489.990273:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633318784 00002000:00100000:1.0:1787119489.990322:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (27275264->27328511) req@ffff92a509643480 x1873929633318784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.990334:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643480 with x1873929633318784 ext(27275264->27328511) 00002000:00010000:1.0:1787119489.990339:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643480 00000100:00100000:1.0:1787119489.990367:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633318912 00000100:00100000:1.0:1787119489.990370:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633318912 00002000:00100000:1.0:1787119489.990386:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (1826816->1892351) req@ffff92a509643800 x1873929633318912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.990394:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643800 with x1873929633318912 ext(1826816->1892351) 00002000:00010000:1.0:1787119489.990397:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643800 00000100:00100000:2.0:1787119489.990406:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9498 00000100:00100000:1.0:1787119489.990411:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9499 00000100:00100000:2.0:1787119489.990428:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633318784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119489.990946:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633318912:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119489.995788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119489.995889:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633319040 00000100:00100000:1.0:1787119489.995900:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633319040 00000100:00100000:3.0:1787119489.995937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:1.0:1787119489.995944:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (27869184->27931117) req@ffff92a506009500 x1873929633319040/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/0 e 0 to 0 dl 1787119500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.995955:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009500 with x1873929633319040 ext(27869184->27931117) 00002000:00010000:1.0:1787119489.995961:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506009500 00000100:00100000:0.0:1787119489.996021:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633319296 00000100:00100000:0.0:1787119489.996025:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633319296 00000100:00100000:0.0:1787119489.996071:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19474 00000100:00100000:0.0:1787119489.996091:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+143:32728:x1873929633319296:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119489.996138:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119489.996171:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e29ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a90 expref: 143 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.996189:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119489.996194:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119489.996400:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.996413:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119489.996423:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119489.996524:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976288 00000004:00010000:0.0:1787119489.996550:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000def82789 reply state 00000000bcdd6f8e transno 4294976289 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119489.996571:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119489.996655:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+145:32728:x1873929633319296:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 574us (717us total) trans 4294976289 rc 0/0 00000100:00100000:0.0:1787119489.996663:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19474 00000020:00080000:0.0:1787119489.996667:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119489.997023:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9500 00000100:00100000:1.0:1787119489.997035:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633319040:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119489.997810:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633318784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7392us (7859us total) trans 0 rc 53248/53248 00000100:00100000:0.0:1787119489.997820:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9498 00002000:00100000:0.0:1787119489.997828:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (27275264->27328511) req@ffff92a509643480 x1873929633318784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119489.997838:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643480 with x1873929633318784 ext(27275264->27328511) 00002000:00010000:0.0:1787119489.997843:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643480 00000100:00100000:1.0:1787119489.999068:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633318912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8645us (9002us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119489.999078:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9499 00002000:00100000:1.0:1787119489.999096:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (1826816->1892351) req@ffff92a509643800 x1873929633318912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/440 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119489.999107:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643800 with x1873929633318912 ext(1826816->1892351) 00002000:00010000:1.0:1787119489.999112:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643800 00010000:00010000:1.0:1787119489.999226:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.999235:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.999242:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.999250:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045ee00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119489.999254:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.999261:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.999276:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119489.999279:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119489.999283:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119489.999290:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2a3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.001538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.001667:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633319424 00000100:00100000:1.0:1787119490.001677:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633319424 00002000:00010000:1.0:1787119490.001714:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (9936520->18446744073709551615) 00002000:00100000:1.0:1787119490.001719:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b800 with x1873929633319424 ext(9936520->18446744073709551615) 00002000:00010000:1.0:1787119490.001732:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b800. 00000100:00100000:1.0:1787119490.001760:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9501 00000100:00100000:1.0:1787119490.001769:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633319424:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119490.002261:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 64395778 -> 9936520 00002000:00010000:1.0:1787119490.002266:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:1.0:1787119490.002268:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:1.0:1787119490.002270:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:1.0:1787119490.002272:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119490.002338:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633319424:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 568us (807us total) trans 4294969063 rc 0/0 00000100:00100000:1.0:1787119490.002345:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9501 00002000:00010000:1.0:1787119490.002349:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (9936520->18446744073709551615) 00002000:00100000:1.0:1787119490.002352:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b800 with x1873929633319424 ext(9936520->18446744073709551615) 00002000:00010000:1.0:1787119490.002356:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b800. 00000100:00100000:2.0:1787119490.005807:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.006171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.006194:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633319552 00000100:00100000:1.0:1787119490.006204:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633319552 00000100:00100000:0.0:1787119490.006219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:1.0:1787119490.006248:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (1892352->1929215) req@ffff92a506008380 x1873929633319552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.006260:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008380 with x1873929633319552 ext(1892352->1929215) 00002000:00010000:1.0:1787119490.006265:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008380 00000100:00100000:3.0:1787119490.006340:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633319808 00000100:00100000:3.0:1787119490.006344:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633319808 00000100:00100000:3.0:1787119490.006421:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19475 00000100:00100000:3.0:1787119490.006433:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+144:32728:x1873929633319808:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119490.006483:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119490.006505:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715aac expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.006605:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031800/0xcaba3de8463e2a49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.006619:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031800/0xcaba3de8463e2a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.006630:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031800/0xcaba3de8463e2a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119490.006661:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 9936520 00000004:00200000:3.0:1787119490.006665:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119490.006684:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031800/0xcaba3de8463e2a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.006709:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aac expref: 146 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.006727:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031800/0xcaba3de8463e2a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aac expref: 145 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.006736:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119490.006739:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119490.006743:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600031800, rc 0) 00000100:00100000:3.0:1787119490.006795:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+145:32728:x1873929633319808:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 364us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119490.006802:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19475 00000100:00100000:1.0:1787119490.007001:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633319680 00000100:00100000:1.0:1787119490.007006:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633319680 00002000:00100000:1.0:1787119490.007027:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (1847296->1851391) req@ffff92a519c69880 x1873929633319680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.007035:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69880 with x1873929633319680 ext(1847296->1851391) 00002000:00010000:1.0:1787119490.007039:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69880 00000100:00100000:3.0:1787119490.009482:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633319040:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 12442us (13694us total) trans 4294968832 rc 0/0 00000100:00100000:3.0:1787119490.009506:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9500 00002000:00100000:3.0:1787119490.009517:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (27869184->27931117) req@ffff92a506009500 x1873929633319040/t4294968832(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 488/448 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.009527:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009500 with x1873929633319040 ext(27869184->27931117) 00002000:00010000:3.0:1787119490.009532:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506009500 00000100:00100000:3.0:1787119490.009571:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9502 00000100:00100000:3.0:1787119490.009583:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633319552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.012807:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9503 00000100:00100000:0.0:1787119490.012828:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633319680:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.013665:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633318656:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 26628us (26948us total) trans 4294968833 rc 0/0 00000100:00100000:2.0:1787119490.013676:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9497 00002000:00100000:2.0:1787119490.013687:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (24838144->61856377) req@ffff92a509640000 x1873929633318656/t4294968833(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:525/0 lens 504/448 e 0 to 0 dl 1787119500 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.013698:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640000 with x1873929633318656 ext(24838144->61856377) 00002000:00010000:2.0:1787119490.013704:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640000 00000100:00100000:0.0:1787119490.014410:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633319680:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1586us (8186us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.014757:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9503 00002000:00100000:0.0:1787119490.014767:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (1847296->1851391) req@ffff92a519c69880 x1873929633319680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.014777:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69880 with x1873929633319680 ext(1847296->1851391) 00002000:00010000:0.0:1787119490.014781:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69880 00000100:00100000:3.0:1787119490.016295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.016360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.016459:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633320064 00000100:00100000:0.0:1787119490.016468:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633320064 00000100:00100000:0.0:1787119490.016516:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4997 00000100:00100000:0.0:1787119490.016525:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633320064:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119490.016856:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633319936 00000100:00100000:2.0:1787119490.016861:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633319936 00002000:00100000:2.0:1787119490.016888:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (6242304->6295551) req@ffff92a506e5b480 x1873929633319936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.016905:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b480 with x1873929633319936 ext(6242304->6295551) 00002000:00010000:2.0:1787119490.016910:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b480 00000100:00100000:2.0:1787119490.016937:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9504 00000100:00100000:2.0:1787119490.016944:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633319936:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.017155:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633319552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7573us (11356us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119490.017162:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9502 00002000:00100000:3.0:1787119490.017169:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (1892352->1929215) req@ffff92a506008380 x1873929633319552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.017178:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008380 with x1873929633319552 ext(1892352->1929215) 00002000:00010000:3.0:1787119490.017182:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008380 00000100:00100000:0.0:1787119490.018674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.018721:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633320192 00000100:00100000:2.0:1787119490.018729:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633320192 00000100:00100000:0.0:1787119490.018740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.018775:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4998 00000100:00100000:2.0:1787119490.018785:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633320192:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119490.018820:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633320320 00000100:00100000:1.0:1787119490.018824:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633320320 00002000:00100000:1.0:1787119490.018846:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (1851392->1855487) req@ffff92a519c68380 x1873929633320320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.018856:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68380 with x1873929633320320 ext(1851392->1855487) 00002000:00010000:1.0:1787119490.018861:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c68380 00000100:00100000:1.0:1787119490.018884:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9505 00000100:00100000:1.0:1787119490.018900:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633320320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.019071:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633320320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 179us (330us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119490.019077:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9505 00002000:00100000:1.0:1787119490.019083:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (1851392->1855487) req@ffff92a519c68380 x1873929633320320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.019091:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68380 with x1873929633320320 ext(1851392->1855487) 00002000:00010000:1.0:1787119490.019094:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c68380 00010000:00010000:0.0:1787119490.020004:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119490.027243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.027324:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633320576 00000100:00100000:3.0:1787119490.027334:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633320576 00000100:00100000:3.0:1787119490.027394:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19476 00000100:00100000:3.0:1787119490.027472:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+145:32729:x1873929633320576:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119490.027525:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119490.027551:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e2a1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a9e expref: 145 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119490.027855:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633319936:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10910us (11565us total) trans 0 rc 53248/53248 00000100:00100000:2.0:1787119490.027864:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9504 00002000:00100000:2.0:1787119490.027874:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (6242304->6295551) req@ffff92a506e5b480 x1873929633319936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.027884:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b480 with x1873929633319936 ext(6242304->6295551) 00002000:00010000:2.0:1787119490.027896:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b480 00010000:00010000:3.0:1787119490.028064:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119490.028069:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119490.028255:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.028269:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.028279:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119490.028327:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976290 00000004:00010000:3.0:1787119490.028347:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd2e6d63 reply state 000000007a72ec3b transno 4294976291 ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.028355:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119490.028405:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+147:32729:x1873929633320576:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1003us (1171us total) trans 4294976291 rc 0/0 00000100:00100000:3.0:1787119490.028411:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19476 00000020:00080000:3.0:1787119490.028424:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787119490.033297:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.033310:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.033315:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.033319:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a600030400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.033322:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.033327:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.033340:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119490.033342:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119490.033345:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.033349:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600030400/0xcaba3de8463e2a50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119490.039470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.039501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.039537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.039570:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633320704 00000100:00100000:1.0:1787119490.039579:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633320704 00000100:00100000:3.0:1787119490.039806:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633320832 00000100:00100000:3.0:1787119490.039811:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633320832 00002000:00010000:3.0:1787119490.039877:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (9936520->18446744073709551615) 00002000:00100000:3.0:1787119490.039881:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0700 with x1873929633320832 ext(9936520->18446744073709551615) 00002000:00010000:3.0:1787119490.039942:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e0700. 00000100:00100000:3.0:1787119490.039963:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633320960 00000100:00100000:3.0:1787119490.039965:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633320960 00002000:00100000:3.0:1787119490.039980:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (1826816->1892351) req@ffff92a5069e1c00 x1873929633320960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.039987:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1c00 with x1873929633320960 ext(1826816->1892351) 00002000:00010000:3.0:1787119490.039991:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e1c00 00000100:00100000:3.0:1787119490.040002:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9506 00000100:00100000:3.0:1787119490.040008:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633320832:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119490.040248:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 64395778 -> 9936520 00002000:00010000:3.0:1787119490.040252:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.040254:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.040255:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.040257:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:3.0:1787119490.040303:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633320832:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 295us (801us total) trans 4294969064 rc 0/0 00000100:00100000:3.0:1787119490.040308:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9506 00002000:00010000:3.0:1787119490.040310:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (9936520->18446744073709551615) 00002000:00100000:3.0:1787119490.040312:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0700 with x1873929633320832 ext(9936520->18446744073709551615) 00002000:00010000:3.0:1787119490.040315:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e0700. 00000100:00100000:3.0:1787119490.040329:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9507 00000100:00100000:3.0:1787119490.040333:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633320960:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:1.0:1787119490.040702:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (3031040->3035135) req@ffff92a5069e0a80 x1873929633320704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.040712:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0a80 with x1873929633320704 ext(3031040->3035135) 00002000:00010000:1.0:1787119490.040716:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e0a80 00000100:00100000:1.0:1787119490.040735:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9508 00000100:00100000:1.0:1787119490.040743:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633320704:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.041810:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633320704:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1063us (2371us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119490.041819:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9508 00002000:00100000:1.0:1787119490.041828:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (3031040->3035135) req@ffff92a5069e0a80 x1873929633320704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.041838:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0a80 with x1873929633320704 ext(3031040->3035135) 00002000:00010000:1.0:1787119490.041842:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e0a80 00000100:00100000:1.0:1787119490.044263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.044360:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633321088 00000100:00100000:3.0:1787119490.044369:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633321088 00000100:00100000:3.0:1787119490.044418:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19477 00000100:00100000:3.0:1787119490.044427:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+146:32729:x1873929633321088:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119490.044474:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119490.044496:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ab3 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.044591:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.044677:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.044689:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119490.044716:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 9936520 00000004:00200000:3.0:1787119490.044720:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119490.044739:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.044765:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031a00/0xcaba3de8463e2a57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ab3 expref: 148 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.044781:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ab3 expref: 147 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.044794:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119490.044797:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119490.044800:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a600031c00, rc 0) 00000100:00100000:3.0:1787119490.045211:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+147:32729:x1873929633321088:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 784us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119490.045220:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19477 00000100:00100000:0.0:1787119490.047236:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633320960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6891us (7688us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119490.047248:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9507 00002000:00100000:0.0:1787119490.047258:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (1826816->1892351) req@ffff92a5069e1c00 x1873929633320960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.047269:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1c00 with x1873929633320960 ext(1826816->1892351) 00002000:00010000:0.0:1787119490.047275:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e1c00 00000100:00100000:3.0:1787119490.050124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.050165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.050239:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633321216 00000100:00100000:2.0:1787119490.050249:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633321216 00002000:00100000:2.0:1787119490.050293:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (6242304->6295551) req@ffff92a506e58700 x1873929633321216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.050305:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58700 with x1873929633321216 ext(6242304->6295551) 00002000:00010000:2.0:1787119490.050311:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e58700 00000100:00100000:2.0:1787119490.050340:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633321344 00000100:00100000:2.0:1787119490.050344:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633321344 00002000:00100000:2.0:1787119490.050360:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (3035136->3039231) req@ffff92a506e59c00 x1873929633321344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.050368:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59c00 with x1873929633321344 ext(3035136->3039231) 00002000:00010000:2.0:1787119490.050371:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e59c00 00000100:00100000:2.0:1787119490.050392:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9509 00000100:00100000:2.0:1787119490.050401:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633321216:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.050704:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9510 00000100:00100000:3.0:1787119490.050714:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633321344:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.050863:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633321344:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 151us (696us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.050871:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9510 00002000:00100000:3.0:1787119490.050878:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (3035136->3039231) req@ffff92a506e59c00 x1873929633321344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.050886:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59c00 with x1873929633321344 ext(3035136->3039231) 00002000:00010000:3.0:1787119490.050904:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e59c00 00000100:00100000:3.0:1787119490.058875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.058926:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.058948:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633321472 00000100:00100000:3.0:1787119490.058956:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633321472 00002000:00100000:3.0:1787119490.058995:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (1892352->1929215) req@ffff92a506e59180 x1873929633321472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.059008:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59180 with x1873929633321472 ext(1892352->1929215) 00002000:00010000:3.0:1787119490.059012:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e59180 00000100:00100000:3.0:1787119490.059027:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633321600 00000100:00100000:3.0:1787119490.059029:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633321600 00002000:00100000:3.0:1787119490.059037:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (3010560->3076095) req@ffff92a506e5a680 x1873929633321600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.059042:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5a680 with x1873929633321600 ext(3010560->3076095) 00002000:00010000:3.0:1787119490.059044:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5a680 00000100:00100000:3.0:1787119490.059054:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9511 00000100:00100000:3.0:1787119490.059060:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633321472:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.060171:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9512 00000100:00100000:3.0:1787119490.060185:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633321600:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.063828:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633321216:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13408us (13693us total) trans 0 rc 53248/53248 00000100:00100000:2.0:1787119490.063848:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9509 00002000:00100000:2.0:1787119490.063866:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (6242304->6295551) req@ffff92a506e58700 x1873929633321216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.063877:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58700 with x1873929633321216 ext(6242304->6295551) 00002000:00010000:2.0:1787119490.063883:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e58700 00000100:00100000:3.0:1787119490.066569:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633321472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7486us (7680us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119490.066583:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9511 00002000:00100000:3.0:1787119490.066594:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (1892352->1929215) req@ffff92a506e59180 x1873929633321472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.066615:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59180 with x1873929633321472 ext(1892352->1929215) 00002000:00010000:3.0:1787119490.066622:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e59180 00000100:00100000:2.0:1787119490.069263:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633320192:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 50471us (50587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.069276:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4998 00000100:00100000:0.0:1787119490.069962:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633320064:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 53433us (53596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.069973:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4997 00000001:00080000:0.0:1787119490.070001:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968831 is committed 00000001:00080000:0.0:1787119490.070012:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968833 is committed 00000100:00100000:3.0:1787119490.071525:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633321600:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11332us (12585us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119490.071537:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9512 00002000:00100000:3.0:1787119490.071549:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (3010560->3076095) req@ffff92a506e5a680 x1873929633321600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.071571:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5a680 with x1873929633321600 ext(3010560->3076095) 00002000:00010000:3.0:1787119490.071577:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5a680 00000100:00100000:1.0:1787119490.072074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.072291:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633321728 00000100:00100000:2.0:1787119490.072299:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633321728 00002000:00100000:2.0:1787119490.072341:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (3031040->3035135) req@ffff92a5069e2680 x1873929633321728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.072352:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2680 with x1873929633321728 ext(3031040->3035135) 00002000:00010000:2.0:1787119490.072356:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2680 00000100:00100000:2.0:1787119490.072391:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9513 00000100:00100000:2.0:1787119490.072400:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633321728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.072886:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633321728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 486us (813us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.072962:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9513 00002000:00100000:2.0:1787119490.072969:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (3031040->3035135) req@ffff92a5069e2680 x1873929633321728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.072977:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2680 with x1873929633321728 ext(3031040->3035135) 00002000:00010000:2.0:1787119490.072981:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2680 00000100:00100000:3.0:1787119490.074238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.074351:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633321984 00000100:00100000:0.0:1787119490.074359:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633321984 00000100:00100000:0.0:1787119490.074579:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19478 00000100:00100000:0.0:1787119490.074590:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+147:32727:x1873929633321984:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119490.074649:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119490.074675:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aa5 expref: 147 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.074694:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119490.074700:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119490.075140:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.075155:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.075165:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119490.075216:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976292 00000004:00010000:0.0:1787119490.075241:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4073789 reply state 0000000033f8ec97 transno 4294976293 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.075250:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119490.075338:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+149:32727:x1873929633321984:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 750us (1106us total) trans 4294976293 rc 0/0 00000100:00100000:0.0:1787119490.075350:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19478 00000020:00080000:0.0:1787119490.075354:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119490.081872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.081924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.081953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.082049:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633322240 00000100:00100000:0.0:1787119490.082059:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633322240 00000100:00100000:0.0:1787119490.082115:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19479 00000100:00100000:0.0:1787119490.082123:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+149:32720:x1873929633322240:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119490.082143:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119490.082163:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e600/0xcaba3de8463e2a6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715aba expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.082245:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.082258:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.082268:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119490.082293:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 27931118 00000004:00200000:0.0:1787119490.082298:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119490.082315:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.082339:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e600/0xcaba3de8463e2a6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aba expref: 151 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.082357:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aba expref: 150 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.082369:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119490.082372:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119490.082376:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a62045ea00, rc 0) 00000100:00100000:0.0:1787119490.082427:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+150:32720:x1873929633322240:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 304us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.082434:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19479 00000100:00100000:1.0:1787119490.082648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119490.082707:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.082714:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.082720:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.082726:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045f800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119490.082729:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.082740:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.082752:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119490.082754:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119490.082758:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.082764:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2a65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.082911:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633322624 00000100:00100000:0.0:1787119490.082916:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633322624 00000100:00100000:0.0:1787119490.082952:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19480 00000100:00100000:0.0:1787119490.082961:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+149:32724:x1873929633322624:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119490.082990:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119490.083005:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e29d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715a89 expref: 149 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.083016:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119490.083020:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119490.083191:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.083201:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.083207:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119490.083258:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976294 00000004:00010000:0.0:1787119490.083283:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c60a96dc reply state 000000001c25d7fd transno 4294976295 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.083292:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119490.083349:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+151:32724:x1873929633322624:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 388us (701us total) trans 4294976295 rc 0/0 00000100:00100000:0.0:1787119490.083355:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19480 00000020:00080000:0.0:1787119490.083359:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119490.084162:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633322112 00000100:00100000:3.0:1787119490.084170:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633322112 00002000:00100000:3.0:1787119490.084206:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (3076096->3112959) req@ffff92a5069e0000 x1873929633322112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.084217:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0000 with x1873929633322112 ext(3076096->3112959) 00002000:00010000:3.0:1787119490.084222:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e0000 00000100:00100000:3.0:1787119490.084276:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633322368 00000100:00100000:3.0:1787119490.084280:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633322368 00002000:00100000:3.0:1787119490.084296:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (3035136->3039231) req@ffff92a5069e1f80 x1873929633322368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.084304:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1f80 with x1873929633322368 ext(3035136->3039231) 00002000:00010000:3.0:1787119490.084308:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e1f80 00000100:00100000:3.0:1787119490.084335:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9514 00000100:00100000:3.0:1787119490.084342:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633322112:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.084720:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9515 00000100:00100000:0.0:1787119490.084730:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633322368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.084862:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633322368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 133us (2906us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.084870:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9515 00002000:00100000:0.0:1787119490.084876:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (3035136->3039231) req@ffff92a5069e1f80 x1873929633322368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.084885:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1f80 with x1873929633322368 ext(3035136->3039231) 00002000:00010000:0.0:1787119490.084900:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e1f80 00000100:00100000:3.0:1787119490.093529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119490.093682:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.093695:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.093702:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.093709:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045f600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119490.093714:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.093722:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.093747:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119490.093750:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119490.093755:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.093761:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f600/0xcaba3de8463e2a7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.093880:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633322752 00000100:00100000:0.0:1787119490.093898:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633322752 00002000:00010000:0.0:1787119490.093935:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (9936520->18446744073709551615) 00002000:00100000:0.0:1787119490.093940:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59500 with x1873929633322752 ext(9936520->18446744073709551615) 00002000:00010000:0.0:1787119490.093949:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e59500. 00000100:00100000:0.0:1787119490.093978:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9516 00000100:00100000:0.0:1787119490.093988:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633322752:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119490.094342:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 64395778 -> 9936520 00002000:00010000:0.0:1787119490.094348:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119490.094350:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119490.094353:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119490.094355:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:0.0:1787119490.094415:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633322752:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 429us (897us total) trans 4294969065 rc 0/0 00000100:00100000:0.0:1787119490.094422:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9516 00002000:00010000:0.0:1787119490.094425:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (9936520->18446744073709551615) 00002000:00100000:0.0:1787119490.094427:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59500 with x1873929633322752 ext(9936520->18446744073709551615) 00002000:00010000:0.0:1787119490.094431:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e59500. 00000100:00100000:1.0:1787119490.095339:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633322112:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10992us (13472us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119490.095349:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9514 00002000:00100000:1.0:1787119490.095358:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (3076096->3112959) req@ffff92a5069e0000 x1873929633322112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.095369:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0000 with x1873929633322112 ext(3076096->3112959) 00002000:00010000:1.0:1787119490.095375:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e0000 00000100:00100000:3.0:1787119490.096431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.096506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.096593:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633322880 00000100:00100000:0.0:1787119490.096608:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633322880 00002000:00010000:0.0:1787119490.096638:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (38554013->18446744073709551615) 00002000:00100000:0.0:1787119490.096643:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59f80 with x1873929633322880 ext(38554013->18446744073709551615) 00002000:00010000:0.0:1787119490.096652:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59f80. 00000100:00100000:0.0:1787119490.096677:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633323008 00000100:00100000:0.0:1787119490.096681:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633323008 00002000:00100000:0.0:1787119490.096698:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (3010560->3076095) req@ffff92a506e5b100 x1873929633323008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.096708:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b100 with x1873929633323008 ext(3010560->3076095) 00002000:00010000:0.0:1787119490.096712:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b100 00000100:00100000:0.0:1787119490.096736:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9517 00000100:00100000:0.0:1787119490.096751:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633322880:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119490.097187:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 46658807 -> 38554013 00002000:00010000:0.0:1787119490.097192:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119490.097194:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119490.097196:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119490.097199:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1421 -> 1805 00000100:00100000:0.0:1787119490.097250:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633322880:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 494us (827us total) trans 4294968834 rc 0/0 00000100:00100000:0.0:1787119490.097260:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9517 00002000:00010000:0.0:1787119490.097264:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (38554013->18446744073709551615) 00002000:00100000:0.0:1787119490.097267:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59f80 with x1873929633322880 ext(38554013->18446744073709551615) 00002000:00010000:0.0:1787119490.097272:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59f80. 00000100:00100000:0.0:1787119490.097288:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9518 00000100:00100000:0.0:1787119490.097295:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633323008:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.104522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.104581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.104670:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633323136 00000100:00100000:2.0:1787119490.104681:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633323136 00000100:00100000:2.0:1787119490.104741:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633323520 00000100:00100000:2.0:1787119490.104745:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633323520 00000100:00100000:2.0:1787119490.104777:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19481 00000100:00100000:2.0:1787119490.104786:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+151:32727:x1873929633323136:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119490.104812:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119490.104835:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e2a81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ac1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.104932:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2a88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.104944:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.104954:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119490.104982:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 9936520 00000004:00200000:2.0:1787119490.104986:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119490.105006:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.105032:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e2a81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ac1 expref: 153 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.105049:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2a88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ac1 expref: 152 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.105062:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119490.105065:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119490.105068:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e560a00, rc 0) 00000100:00100000:2.0:1787119490.105120:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+152:32727:x1873929633323136:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 336us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.105127:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19481 00000100:00100000:2.0:1787119490.105144:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19482 00000100:00100000:2.0:1787119490.105149:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+151:32728:x1873929633323520:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119490.105171:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119490.105185:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031800/0xcaba3de8463e2a49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aac expref: 151 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.105196:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119490.105199:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119490.105368:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.105376:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.105383:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119490.105424:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976296 00000004:00010000:2.0:1787119490.105483:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ce9b5ff reply state 0000000071a259ae transno 4294976297 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119490.105497:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119490.105540:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+153:32728:x1873929633323520:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 389us (958us total) trans 4294976297 rc 0/0 00000100:00100000:2.0:1787119490.105546:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19482 00000020:00080000:2.0:1787119490.105560:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119490.106775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.107018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.107096:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633323648 00000100:00100000:0.0:1787119490.107105:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633323648 00002000:00100000:0.0:1787119490.107146:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (22183936->22241279) req@ffff92a506576a00 x1873929633323648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.107156:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576a00 with x1873929633323648 ext(22183936->22241279) 00002000:00010000:0.0:1787119490.107162:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506576a00 00000100:00100000:0.0:1787119490.107192:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9519 00000100:00100000:0.0:1787119490.107200:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633323648:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.109223:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633323264 00000100:00100000:2.0:1787119490.109238:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633323264 00000100:00100000:2.0:1787119490.109287:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19483 00000100:00100000:2.0:1787119490.109297:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+153:32724:x1873929633323264:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119490.109315:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119490.109336:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e2a96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ac8 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.109416:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2a9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.109429:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.109464:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119490.109491:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 38554013 00000004:00200000:2.0:1787119490.109496:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119490.109514:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.109540:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e2a96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ac8 expref: 155 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.109577:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2a9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ac8 expref: 154 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.109586:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119490.109589:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119490.109592:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e561a00, rc 0) 00000100:00100000:2.0:1787119490.109659:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+154:32724:x1873929633323264:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 363us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.109666:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19483 00000100:00100000:3.0:1787119490.110046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.110073:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633323776 00000100:00100000:3.0:1787119490.110079:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633323776 00002000:00010000:3.0:1787119490.110101:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (9219840->18446744073709551615) 00002000:00100000:3.0:1787119490.110105:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577b80 with x1873929633323776 ext(9219840->18446744073709551615) 00002000:00010000:3.0:1787119490.110114:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577b80. 00000100:00100000:3.0:1787119490.110133:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9520 00000100:00100000:3.0:1787119490.110140:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633323776:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119490.110649:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9936520 -> 9219840 00002000:00010000:3.0:1787119490.110654:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.110656:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.110659:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.110661:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:3.0:1787119490.110696:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633323776:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 556us (650us total) trans 4294969066 rc 0/0 00000100:00100000:3.0:1787119490.110704:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9520 00002000:00010000:3.0:1787119490.110707:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (9219840->18446744073709551615) 00002000:00100000:3.0:1787119490.110709:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577b80 with x1873929633323776 ext(9219840->18446744073709551615) 00002000:00010000:3.0:1787119490.110714:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577b80. 00000100:00100000:0.0:1787119490.110986:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633323648:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3786us (4216us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119490.110994:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9519 00002000:00100000:0.0:1787119490.111003:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (22183936->22241279) req@ffff92a506576a00 x1873929633323648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.111012:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576a00 with x1873929633323648 ext(22183936->22241279) 00002000:00010000:0.0:1787119490.111017:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506576a00 00010000:00010000:2.0:1787119490.111937:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.111949:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.111955:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.111961:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e560200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119490.111966:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.111973:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.111988:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119490.111991:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119490.111995:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.112002:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2a8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119490.112748:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633323008:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15446us (16234us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119490.112759:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9518 00002000:00100000:1.0:1787119490.112777:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (3010560->3076095) req@ffff92a506e5b100 x1873929633323008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.112787:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b100 with x1873929633323008 ext(3010560->3076095) 00002000:00010000:1.0:1787119490.112792:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b100 00000100:00100000:0.0:1787119490.129279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.129803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.131026:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633323904 00000100:00100000:2.0:1787119490.131041:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633323904 00002000:00100000:2.0:1787119490.131099:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (6242304->6295551) req@ffff92a519c6b800 x1873929633323904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.131147:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b800 with x1873929633323904 ext(6242304->6295551) 00002000:00010000:2.0:1787119490.131156:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6b800 00000100:00100000:2.0:1787119490.131200:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9521 00000100:00100000:2.0:1787119490.131210:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633323904:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.132006:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633324032 00000100:00100000:1.0:1787119490.132014:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633324032 00000100:00100000:1.0:1787119490.132061:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19484 00000100:00100000:1.0:1787119490.132069:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+153:32728:x1873929633324032:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119490.132089:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119490.132110:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e2aa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715acf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.132190:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e2aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.132205:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e2aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.132217:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e2aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119490.132241:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 9219840 00000004:00200000:1.0:1787119490.132245:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119490.132262:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e2aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.132288:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573600/0xcaba3de8463e2aa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715acf expref: 155 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.132304:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e2aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715acf expref: 154 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.132312:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119490.132315:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119490.132319:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e573c00, rc 0) 00000100:00100000:1.0:1787119490.132361:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+154:32728:x1873929633324032:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 292us (2558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119490.132367:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19484 00000100:00100000:3.0:1787119490.138300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.138400:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633324160 00000100:00100000:2.0:1787119490.138411:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633324160 00002000:00100000:2.0:1787119490.138633:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (16539648->16543743) req@ffff92a506574380 x1873929633324160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.138643:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506574380 with x1873929633324160 ext(16539648->16543743) 00002000:00010000:2.0:1787119490.138650:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506574380 00000100:00100000:2.0:1787119490.138684:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9522 00000100:00100000:2.0:1787119490.138695:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633324160:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.139048:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633324160:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 354us (1097us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.139057:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9522 00002000:00100000:2.0:1787119490.139064:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (16539648->16543743) req@ffff92a506574380 x1873929633324160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.139078:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506574380 with x1873929633324160 ext(16539648->16543743) 00002000:00010000:2.0:1787119490.139082:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506574380 00000100:00100000:3.0:1787119490.139371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.139413:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633324544 00000100:00100000:1.0:1787119490.139419:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633324544 00002000:00100000:1.0:1787119490.139465:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (3076096->3112959) req@ffff92a506576d80 x1873929633324544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.139474:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576d80 with x1873929633324544 ext(3076096->3112959) 00002000:00010000:1.0:1787119490.139477:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506576d80 00000100:00100000:1.0:1787119490.139499:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9523 00000100:00100000:1.0:1787119490.139506:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633324544:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.142026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.142151:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633324416 00000100:00100000:0.0:1787119490.142160:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633324416 00000100:00100000:0.0:1787119490.142207:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19485 00000100:00100000:0.0:1787119490.142216:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+154:32724:x1873929633324416:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119490.142266:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119490.142291:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2a9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ac8 expref: 154 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.142309:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119490.142313:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119490.142669:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.142683:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.142692:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119490.142737:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976298 00000004:00010000:0.0:1787119490.142770:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5bf438a reply state 00000000ceb25282 transno 4294976299 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.142779:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119490.142864:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+156:32724:x1873929633324416:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 648us (846us total) trans 4294976299 rc 0/0 00000100:00100000:0.0:1787119490.142871:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19485 00000020:00080000:0.0:1787119490.142876:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119490.152090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.152295:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633323904:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 21085us (23025us total) trans 0 rc 53248/53248 00000100:00100000:2.0:1787119490.152307:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9521 00002000:00100000:2.0:1787119490.152319:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (6242304->6295551) req@ffff92a519c6b800 x1873929633323904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.152330:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b800 with x1873929633323904 ext(6242304->6295551) 00002000:00010000:2.0:1787119490.152336:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6b800 00000100:00100000:2.0:1787119490.152359:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633324672 00000100:00100000:2.0:1787119490.152365:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633324672 00002000:00010000:2.0:1787119490.152391:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (1008584->18446744073709551615) 00002000:00100000:2.0:1787119490.152393:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577480 with x1873929633324672 ext(1008584->18446744073709551615) 00002000:00010000:2.0:1787119490.152404:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506577480. 00000100:00100000:2.0:1787119490.152434:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9524 00000100:00100000:2.0:1787119490.152477:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633324672:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119490.152997:0:19246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 38554013 -> 1008584 00002000:00010000:2.0:1787119490.153002:0:19246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.153004:0:19246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.153006:0:19246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.153008:0:19246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1805 -> 1805 00000100:00100000:2.0:1787119490.153038:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633324672:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 561us (959us total) trans 4294968835 rc 0/0 00000100:00100000:2.0:1787119490.153049:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9524 00002000:00010000:2.0:1787119490.153052:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (1008584->18446744073709551615) 00002000:00100000:2.0:1787119490.153055:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577480 with x1873929633324672 ext(1008584->18446744073709551615) 00002000:00010000:2.0:1787119490.153060:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506577480. 00010000:00010000:0.0:1787119490.153565:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.153577:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.153585:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.153591:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045e200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119490.153596:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.153612:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.153628:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119490.153631:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119490.153635:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.153640:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ab2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.158069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.159051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.159121:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633324928 00000100:00100000:2.0:1787119490.159131:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633324928 00000100:00100000:2.0:1787119490.159182:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19486 00000100:00100000:2.0:1787119490.159191:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+155:32728:x1873929633324928:12345-192.168.201.59@tcp:36:fsx.0 00000100:00100000:3.0:1787119490.159201:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633324544:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 19695us (19830us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119490.159213:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9523 00002000:00100000:3.0:1787119490.159221:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (3076096->3112959) req@ffff92a506576d80 x1873929633324544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.159231:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576d80 with x1873929633324544 ext(3076096->3112959) 00002000:00010000:3.0:1787119490.159236:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506576d80 00010000:00010000:2.0:1787119490.159242:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119490.159278:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573c00/0xcaba3de8463e2aab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715acf expref: 155 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.159295:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119490.159300:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119490.159544:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.159567:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.159577:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119490.159856:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976300 00000004:00010000:2.0:1787119490.159896:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e3fb3f3 reply state 00000000cf0832ab transno 4294976301 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119490.159906:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119490.159963:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+157:32728:x1873929633324928:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 772us (1905us total) trans 4294976301 rc 0/0 00000100:00100000:2.0:1787119490.159970:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19486 00000020:00080000:2.0:1787119490.159973:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119490.173043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.173076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119490.173124:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.173137:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.173145:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.173152:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e560200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119490.173156:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119490.173162:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633325056 00010000:00010000:0.0:1787119490.173163:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119490.173172:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633325056 00010000:00010000:0.0:1787119490.173179:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119490.173182:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119490.173186:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.173191:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2ab9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787119490.173217:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (16543744->16547839) req@ffff92a519c68700 x1873929633325056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787119490.173226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:2.0:1787119490.173227:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68700 with x1873929633325056 ext(16543744->16547839) 00000100:00100000:0.0:1787119490.173244:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633325184 00000100:00100000:0.0:1787119490.173248:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633325184 00002000:00100000:0.0:1787119490.173267:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (3031040->3035135) req@ffff92a519c69c00 x1873929633325184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.173274:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69c00 with x1873929633325184 ext(3031040->3035135) 00002000:00010000:0.0:1787119490.173279:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69c00 00000100:00100000:0.0:1787119490.173297:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633325440 00000100:00100000:0.0:1787119490.173300:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633325440 00002000:00010000:0.0:1787119490.173311:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (27931118->18446744073709551615) 00002000:00100000:0.0:1787119490.173314:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a680 with x1873929633325440 ext(27931118->18446744073709551615) 00002000:00010000:0.0:1787119490.173323:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6a680. 00000100:00100000:0.0:1787119490.173340:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9525 00000100:00100000:0.0:1787119490.173348:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633325184:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:2.0:1787119490.173626:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c68700 00000100:00100000:2.0:1787119490.173656:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9526 00000100:00100000:2.0:1787119490.173664:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633325440:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119490.174079:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9219840 -> 27931118 00002000:00010000:2.0:1787119490.174083:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.174085:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.174087:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.174089:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119490.174137:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633325440:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 473us (909us total) trans 4294969067 rc 0/0 00000100:00100000:2.0:1787119490.174144:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9526 00002000:00010000:2.0:1787119490.174148:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (27931118->18446744073709551615) 00002000:00100000:2.0:1787119490.174151:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a680 with x1873929633325440 ext(27931118->18446744073709551615) 00002000:00010000:2.0:1787119490.174155:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6a680. 00000100:00100000:2.0:1787119490.174171:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9527 00000100:00100000:2.0:1787119490.174178:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633325056:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.174318:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633325056:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 139us (15271us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.174325:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9527 00002000:00100000:2.0:1787119490.174331:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (16543744->16547839) req@ffff92a519c68700 x1873929633325056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.174340:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68700 with x1873929633325056 ext(16543744->16547839) 00002000:00010000:2.0:1787119490.174344:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c68700 00000100:00100000:0.0:1787119490.175031:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633325184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1678us (1995us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.175039:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9525 00002000:00100000:0.0:1787119490.175046:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (3031040->3035135) req@ffff92a519c69c00 x1873929633325184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.175054:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69c00 with x1873929633325184 ext(3031040->3035135) 00002000:00010000:0.0:1787119490.175057:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69c00 00000100:00100000:0.0:1787119490.175114:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633325312 00000100:00100000:0.0:1787119490.175121:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633325312 00000100:00100000:0.0:1787119490.175154:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19487 00000100:00100000:0.0:1787119490.175162:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+156:32724:x1873929633325312:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119490.175175:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119490.175195:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f200/0xcaba3de8463e2ac0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ad6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.175272:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e2ac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.175285:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e2ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.175296:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e2ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119490.175323:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 1008584 00000004:00200000:0.0:1787119490.175327:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119490.175345:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e2ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.175371:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f200/0xcaba3de8463e2ac0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ad6 expref: 158 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.175387:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e2ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ad6 expref: 157 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.175395:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119490.175399:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119490.175402:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a62045ec00, rc 0) 00000100:00100000:0.0:1787119490.175459:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+157:32724:x1873929633325312:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 278us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.175466:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19487 00000100:00100000:0.0:1787119490.176802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.176896:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633325696 00000100:00100000:3.0:1787119490.176904:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633325696 00000100:00100000:3.0:1787119490.176955:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19488 00000100:00100000:3.0:1787119490.176964:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+157:32729:x1873929633325696:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119490.177010:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119490.177033:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a600031c00/0xcaba3de8463e2a5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ab3 expref: 157 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.177050:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119490.177054:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119490.177248:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.177261:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.177270:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119490.177320:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976302 00000004:00010000:3.0:1787119490.177343:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbce16da reply state 00000000e6939602 transno 4294976303 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.177354:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119490.177419:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+159:32729:x1873929633325696:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 456us (624us total) trans 4294976303 rc 0/0 00000100:00100000:3.0:1787119490.177426:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19488 00000020:00080000:3.0:1787119490.177430:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119490.180903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.184271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.188456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119490.188511:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.188524:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.188531:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.188538:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.188542:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.188558:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.188574:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119490.188577:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119490.188581:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.188587:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2ace lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119490.191756:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633325824 00000100:00100000:1.0:1787119490.191771:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633325824 00002000:00100000:1.0:1787119490.191828:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (16519168->16584703) req@ffff92a506009180 x1873929633325824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.191841:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009180 with x1873929633325824 ext(16519168->16584703) 00002000:00010000:1.0:1787119490.191848:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506009180 00000100:00100000:2.0:1787119490.191998:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633325952 00000100:00100000:2.0:1787119490.192004:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633325952 00002000:00100000:2.0:1787119490.192027:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (3035136->3039231) req@ffff92a519c69500 x1873929633325952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.192037:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69500 with x1873929633325952 ext(3035136->3039231) 00002000:00010000:2.0:1787119490.192040:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69500 00000100:00100000:2.0:1787119490.192068:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9528 00000100:00100000:2.0:1787119490.192078:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633325824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.192354:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9529 00000100:00100000:2.0:1787119490.192363:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633325952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.193705:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633325952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1337us (9439us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.193716:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9529 00002000:00100000:2.0:1787119490.193724:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (3035136->3039231) req@ffff92a519c69500 x1873929633325952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.193751:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69500 with x1873929633325952 ext(3035136->3039231) 00002000:00010000:2.0:1787119490.193755:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69500 00000100:00100000:0.0:1787119490.194215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.194291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.199780:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633326080 00000100:00100000:1.0:1787119490.199797:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633326080 00002000:00010000:2.0:1787119490.199934:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (9219840->18446744073709551615) 00002000:00100000:2.0:1787119490.199940:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69f80 with x1873929633326080 ext(9219840->18446744073709551615) 00002000:00010000:2.0:1787119490.199951:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69f80. 00000100:00100000:2.0:1787119490.199979:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633326208 00000100:00100000:2.0:1787119490.199983:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633326208 00002000:00100000:2.0:1787119490.200006:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (27869184->27873279) req@ffff92a519c6b100 x1873929633326208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.200016:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b100 with x1873929633326208 ext(27869184->27873279) 00002000:00010000:2.0:1787119490.200021:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6b100 00000100:00100000:2.0:1787119490.200032:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633326336 00000100:00100000:2.0:1787119490.200035:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633326336 00000100:00100000:3.0:1787119490.200045:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9530 00002000:00100000:2.0:1787119490.200050:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (0->1011711) req@ffff92a519c6a300 x1873929633326336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.200058:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a300 with x1873929633326336 ext(0->1011711) 00002000:00010000:2.0:1787119490.200061:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6a300 00000100:00100000:2.0:1787119490.200074:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9531 00000100:00100000:2.0:1787119490.200080:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633326208:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.200357:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633326208:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 276us (6143us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.200365:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9531 00002000:00100000:2.0:1787119490.200371:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (27869184->27873279) req@ffff92a519c6b100 x1873929633326208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.200384:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b100 with x1873929633326208 ext(27869184->27873279) 00002000:00010000:2.0:1787119490.200387:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6b100 00000100:00100000:2.0:1787119490.200405:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9532 00000100:00100000:2.0:1787119490.200412:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633326336:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.201054:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633326080:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119490.201295:0:19245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 9936520 -> 9219840 00002000:00010000:2.0:1787119490.201299:0:19245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.201302:0:19245:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.201305:0:19245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.201307:0:19245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119490.201339:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633326080:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1285us (12910us total) trans 4294969068 rc 0/0 00000100:00100000:2.0:1787119490.201347:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9530 00002000:00010000:2.0:1787119490.201350:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (9219840->18446744073709551615) 00002000:00100000:2.0:1787119490.201353:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69f80 with x1873929633326080 ext(9219840->18446744073709551615) 00002000:00010000:2.0:1787119490.201359:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69f80. 00000100:00100000:0.0:1787119490.207873:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633325824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15787us (26981us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119490.207886:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9528 00002000:00100000:0.0:1787119490.207899:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (16519168->16584703) req@ffff92a506009180 x1873929633325824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.207916:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009180 with x1873929633325824 ext(16519168->16584703) 00002000:00010000:0.0:1787119490.207921:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506009180 00000100:00100000:1.0:1787119490.208433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.208736:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633326464 00000100:00100000:0.0:1787119490.208745:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633326464 00000100:00100000:0.0:1787119490.208793:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19489 00000100:00100000:0.0:1787119490.208802:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+158:32729:x1873929633326464:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119490.208823:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119490.208845:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ad5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715add expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.208926:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fa00/0xcaba3de8463e2adc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.208940:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fa00/0xcaba3de8463e2adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.208952:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fa00/0xcaba3de8463e2adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119490.208979:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 9219840 00000004:00200000:0.0:1787119490.208983:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119490.209001:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fa00/0xcaba3de8463e2adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.209027:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ad5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715add expref: 160 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.209046:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fa00/0xcaba3de8463e2adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715add expref: 159 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.209056:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119490.209059:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119490.209062:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a62045fa00, rc 0) 00000100:00100000:0.0:1787119490.209098:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+159:32729:x1873929633326464:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 298us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.209105:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19489 00000100:00100000:1.0:1787119490.211998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.212042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.212469:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633326720 00000100:00100000:3.0:1787119490.212479:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633326720 00002000:00100000:3.0:1787119490.212525:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (3010560->3076095) req@ffff92a5069e0e00 x1873929633326720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.212536:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0e00 with x1873929633326720 ext(3010560->3076095) 00002000:00010000:3.0:1787119490.212541:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e0e00 00000100:00100000:3.0:1787119490.212570:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633326592 00000100:00100000:3.0:1787119490.212573:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633326592 00002000:00100000:3.0:1787119490.212602:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (27873280->27877375) req@ffff92a5069e2a00 x1873929633326592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.212610:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2a00 with x1873929633326592 ext(27873280->27877375) 00002000:00010000:3.0:1787119490.212614:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2a00 00000100:00100000:3.0:1787119490.212629:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9533 00000100:00100000:3.0:1787119490.212639:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633326720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.213126:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9534 00000100:00100000:0.0:1787119490.213136:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633326592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.213312:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633326592:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 177us (1268us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.213320:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9534 00002000:00100000:0.0:1787119490.213327:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (27873280->27877375) req@ffff92a5069e2a00 x1873929633326592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.213335:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2a00 with x1873929633326592 ext(27873280->27877375) 00002000:00010000:0.0:1787119490.213338:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2a00 00000100:00100000:3.0:1787119490.215286:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633326336:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14863us (20983us total) trans 0 rc 1011712/1011712 00000100:00100000:3.0:1787119490.215300:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9532 00002000:00100000:3.0:1787119490.215313:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (0->1011711) req@ffff92a519c6a300 x1873929633326336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 1011712/1011712 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.215324:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a300 with x1873929633326336 ext(0->1011711) 00002000:00010000:3.0:1787119490.215331:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6a300 00000100:00100000:1.0:1787119490.217344:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633326720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4696us (5344us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119490.217359:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9533 00002000:00100000:1.0:1787119490.217371:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (3010560->3076095) req@ffff92a5069e0e00 x1873929633326720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.217382:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0e00 with x1873929633326720 ext(3010560->3076095) 00002000:00010000:1.0:1787119490.217387:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e0e00 00000100:00100000:3.0:1787119490.230603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.234916:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633326976 00000100:00100000:0.0:1787119490.234933:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633326976 00000100:00100000:0.0:1787119490.235004:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19490 00000100:00100000:0.0:1787119490.235013:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+159:32729:x1873929633326976:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119490.235068:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119490.235095:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fa00/0xcaba3de8463e2adc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715add expref: 159 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.235121:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119490.235127:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119490.235327:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.235339:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.235348:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119490.235395:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976304 00000004:00010000:0.0:1787119490.235420:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085917625 reply state 00000000bacf10ef transno 4294976305 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.235430:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119490.235613:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+161:32729:x1873929633326976:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 600us (5019us total) trans 4294976305 rc 0/0 00000100:00100000:0.0:1787119490.235620:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19490 00000020:00080000:0.0:1787119490.235625:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119490.240538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.241608:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633327232 00000100:00100000:3.0:1787119490.241622:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633327232 00000100:00100000:3.0:1787119490.241694:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19491 00000100:00100000:3.0:1787119490.241705:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+161:32720:x1873929633327232:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119490.241765:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119490.241794:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2a73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aba expref: 161 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.241817:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119490.241822:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119490.242052:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.242068:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.242079:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119490.242140:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976306 00000004:00010000:3.0:1787119490.242173:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6df37dc reply state 00000000d7490d74 transno 4294976307 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.242183:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787119490.249939:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.249958:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.249966:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.249977:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045e200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119490.249981:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.249988:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.250005:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119490.250008:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119490.250013:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.250019:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2ae3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119490.250825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.250870:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.250897:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633327360 00000100:00100000:1.0:1787119490.250907:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633327360 00002000:00100000:1.0:1787119490.250954:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (27848704->27918335) req@ffff92a509872680 x1873929633327360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.250965:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872680 with x1873929633327360 ext(27848704->27918335) 00002000:00010000:1.0:1787119490.250970:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872680 00000100:00100000:1.0:1787119490.250990:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633327488 00000100:00100000:1.0:1787119490.250993:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633327488 00002000:00010000:1.0:1787119490.251005:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (27931118->18446744073709551615) 00002000:00100000:1.0:1787119490.251008:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870000 with x1873929633327488 ext(27931118->18446744073709551615) 00002000:00010000:1.0:1787119490.251018:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870000. 00000100:00100000:1.0:1787119490.251035:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9535 00000100:00100000:1.0:1787119490.251044:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633327360:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.251363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.251577:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633327616 00000100:00100000:0.0:1787119490.251583:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633327616 00002000:00100000:0.0:1787119490.251628:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (3076096->3112959) req@ffff92a509871500 x1873929633327616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.251639:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871500 with x1873929633327616 ext(3076096->3112959) 00002000:00010000:0.0:1787119490.251643:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871500 00000100:00100000:0.0:1787119490.251665:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9536 00000100:00100000:0.0:1787119490.251674:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633327488:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119490.251905:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 9219840 -> 27931118 00002000:00010000:0.0:1787119490.251908:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119490.251911:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119490.251913:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:0.0:1787119490.251915:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:0.0:1787119490.251954:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633327488:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 281us (1083us total) trans 4294969069 rc 0/0 00000100:00100000:0.0:1787119490.251961:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9536 00002000:00010000:0.0:1787119490.251965:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (27931118->18446744073709551615) 00002000:00100000:0.0:1787119490.251967:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870000 with x1873929633327488 ext(27931118->18446744073709551615) 00002000:00010000:0.0:1787119490.251972:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870000. 00000100:00100000:0.0:1787119490.251989:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9537 00000100:00100000:0.0:1787119490.251996:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2373:x1873929633327616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.253193:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+162:32720:x1873929633327232:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 8711us (9887us total) trans 4294976307 rc 0/0 00000100:00100000:3.0:1787119490.253205:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19491 00000020:00080000:3.0:1787119490.253212:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787119490.263355:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.263374:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.263385:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.263392:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c65a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.263397:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.263404:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.263421:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119490.263424:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119490.263429:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.263435:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2aea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119490.269172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.270386:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633327744 00000100:00100000:2.0:1787119490.270399:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633327744 00002000:00010000:2.0:1787119490.270471:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (46658807->18446744073709551615) 00002000:00100000:2.0:1787119490.270476:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871f80 with x1873929633327744 ext(46658807->18446744073709551615) 00002000:00010000:2.0:1787119490.270490:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871f80. 00000100:00100000:2.0:1787119490.270530:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9538 00000100:00100000:2.0:1787119490.270540:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633327744:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119490.270810:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 27931118 -> 46658807 00002000:00010000:2.0:1787119490.270815:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.270817:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119487 -> 1787119488 00002000:00010000:2.0:1787119490.270819:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.270822:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1421 00000100:00100000:2.0:1787119490.271040:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633327744:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 500us (1877us total) trans 4294968836 rc 0/0 00000100:00100000:2.0:1787119490.271050:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9538 00002000:00010000:2.0:1787119490.271054:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (46658807->18446744073709551615) 00002000:00100000:2.0:1787119490.271057:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871f80 with x1873929633327744 ext(46658807->18446744073709551615) 00002000:00010000:2.0:1787119490.271063:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871f80. 00000100:00100000:0.0:1787119490.274398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.274561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.274634:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633327872 00000100:00100000:2.0:1787119490.274644:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633327872 00002000:00100000:2.0:1787119490.274692:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (54251520->54317055) req@ffff92a519c6aa00 x1873929633327872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.274705:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6aa00 with x1873929633327872 ext(54251520->54317055) 00002000:00010000:2.0:1787119490.274711:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6aa00 00000100:00100000:2.0:1787119490.274746:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633328000 00000100:00100000:2.0:1787119490.274749:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633328000 00002000:00100000:2.0:1787119490.274766:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (27869184->27873279) req@ffff92a508f6bb80 x1873929633328000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.274775:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6bb80 with x1873929633328000 ext(27869184->27873279) 00002000:00010000:2.0:1787119490.274779:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6bb80 00000100:00100000:2.0:1787119490.274802:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9539 00000100:00100000:2.0:1787119490.274812:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633327872:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.274827:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9540 00000100:00100000:1.0:1787119490.274836:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2373:x1873929633328000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.275029:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2373:x1873929633328000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 194us (468us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119490.275037:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9540 00002000:00100000:1.0:1787119490.275044:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (27869184->27873279) req@ffff92a508f6bb80 x1873929633328000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.275052:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6bb80 with x1873929633328000 ext(27869184->27873279) 00002000:00010000:1.0:1787119490.275055:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6bb80 00000100:00100000:3.0:1787119490.280033:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633327360:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 28978us (29204us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1787119490.280046:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9535 00002000:00100000:3.0:1787119490.280059:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (27848704->27918335) req@ffff92a509872680 x1873929633327360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.280070:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872680 with x1873929633327360 ext(27848704->27918335) 00002000:00010000:3.0:1787119490.280076:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872680 00000100:00100000:0.0:1787119490.281996:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633327616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 29989us (30623us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119490.282011:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9537 00002000:00100000:0.0:1787119490.282023:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (3076096->3112959) req@ffff92a509871500 x1873929633327616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.282033:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871500 with x1873929633327616 ext(3076096->3112959) 00002000:00010000:0.0:1787119490.282039:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871500 00000100:00100000:1.0:1787119490.282330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.282568:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633328128 00000100:00100000:0.0:1787119490.282577:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633328128 00002000:00100000:0.0:1787119490.282612:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (27873280->27877375) req@ffff92a509873100 x1873929633328128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.282621:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873100 with x1873929633328128 ext(27873280->27877375) 00002000:00010000:0.0:1787119490.282625:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509873100 00000100:00100000:0.0:1787119490.282659:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9541 00000100:00100000:0.0:1787119490.282668:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633328128:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.282879:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633328128:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 212us (550us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.282897:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9541 00002000:00100000:0.0:1787119490.282904:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (27873280->27877375) req@ffff92a509873100 x1873929633328128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.282912:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873100 with x1873929633328128 ext(27873280->27877375) 00002000:00010000:0.0:1787119490.282916:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509873100 00000100:00100000:3.0:1787119490.284621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.285476:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633328256 00000100:00100000:0.0:1787119490.285487:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633328256 00000100:00100000:0.0:1787119490.285539:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19492 00000100:00100000:0.0:1787119490.285560:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+161:32720:x1873929633328256:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119490.285584:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119490.285606:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f200/0xcaba3de8463e2af1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ae4 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.285695:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2af8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.285710:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.285723:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119490.286170:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 46658807 00000004:00200000:0.0:1787119490.286186:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119490.286209:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.286241:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f200/0xcaba3de8463e2af1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ae4 expref: 163 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.286273:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ae4 expref: 162 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.286283:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119490.286286:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119490.286290:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a62045f000, rc 0) 00000100:00100000:0.0:1787119490.286362:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+162:32720:x1873929633328256:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 814us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.286371:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19492 00000100:00100000:3.0:1787119490.288255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.288709:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633327872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13895us (14318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.288721:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9539 00002000:00100000:2.0:1787119490.288733:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (54251520->54317055) req@ffff92a519c6aa00 x1873929633327872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.288761:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6aa00 with x1873929633327872 ext(54251520->54317055) 00002000:00010000:2.0:1787119490.288767:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6aa00 00000100:00100000:2.0:1787119490.288790:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633328384 00000100:00100000:2.0:1787119490.288796:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633328384 00002000:00100000:2.0:1787119490.288826:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (27918336->27934719) req@ffff92a506575c00 x1873929633328384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.288836:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575c00 with x1873929633328384 ext(27918336->27934719) 00002000:00010000:2.0:1787119490.288839:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575c00 00000100:00100000:2.0:1787119490.288866:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9542 00000100:00100000:2.0:1787119490.288875:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633328384:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.289098:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633328384:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 223us (852us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787119490.289106:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9542 00002000:00100000:2.0:1787119490.289112:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (27918336->27934719) req@ffff92a506575c00 x1873929633328384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/16824 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.289120:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575c00 with x1873929633328384 ext(27918336->27934719) 00002000:00010000:2.0:1787119490.289124:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575c00 00000100:00100000:0.0:1787119490.308793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.308839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.309038:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633328768 00000100:00100000:1.0:1787119490.309050:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633328768 00000100:00100000:1.0:1787119490.309109:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19493 00000100:00100000:1.0:1787119490.309118:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+162:32727:x1873929633328768:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119490.309174:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119490.309202:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2a88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ac1 expref: 162 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.309221:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119490.309225:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119490.309643:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.309658:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.309668:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119490.309721:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976308 00000004:00010000:1.0:1787119490.309814:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abd9f798 reply state 00000000406b0d77 transno 4294976309 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119490.309823:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119490.310046:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+164:32727:x1873929633328768:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 926us (1202us total) trans 4294976309 rc 0/0 00000100:00100000:1.0:1787119490.310053:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19493 00000020:00080000:1.0:1787119490.310059:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119490.310143:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633328512 00000100:00100000:2.0:1787119490.310149:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633328512 00002000:00100000:2.0:1787119490.310183:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (27848704->27918335) req@ffff92a508f68380 x1873929633328512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.310193:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68380 with x1873929633328512 ext(27848704->27918335) 00002000:00010000:2.0:1787119490.310198:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f68380 00000100:00100000:2.0:1787119490.310225:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9543 00000100:00100000:2.0:1787119490.310232:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633328512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.315567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.316011:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633328896 00000100:00100000:1.0:1787119490.316022:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633328896 00002000:00100000:1.0:1787119490.316073:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (20979712->20983807) req@ffff92a508f6b800 x1873929633328896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.316086:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6b800 with x1873929633328896 ext(20979712->20983807) 00002000:00010000:1.0:1787119490.316093:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6b800 00000100:00100000:1.0:1787119490.316128:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9544 00000100:00100000:1.0:1787119490.316138:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633328896:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.316396:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633328896:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 258us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119490.316403:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9544 00002000:00100000:1.0:1787119490.316411:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (20979712->20983807) req@ffff92a508f6b800 x1873929633328896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.316419:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6b800 with x1873929633328896 ext(20979712->20983807) 00002000:00010000:1.0:1787119490.316422:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6b800 00000100:00100000:1.0:1787119490.318812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.318847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119490.319029:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.319042:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.319050:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.319057:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e572400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.319062:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.319070:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.319088:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119490.319091:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119490.319095:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.319101:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2aff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.319239:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633329024 00000100:00100000:0.0:1787119490.319248:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633329024 00002000:00100000:0.0:1787119490.319304:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (27869184->27931117) req@ffff92a509872300 x1873929633329024/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.319322:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872300 with x1873929633329024 ext(27869184->27931117) 00002000:00010000:0.0:1787119490.319327:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872300 00000100:00100000:0.0:1787119490.319353:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633329152 00000100:00100000:0.0:1787119490.319357:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633329152 00002000:00100000:0.0:1787119490.319375:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (4595712->4599807) req@ffff92a509870e00 x1873929633329152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.319383:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870e00 with x1873929633329152 ext(4595712->4599807) 00002000:00010000:0.0:1787119490.319387:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509870e00 00000100:00100000:0.0:1787119490.319413:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9545 00000100:00100000:0.0:1787119490.319424:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633329024:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119490.319629:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9546 00000100:00100000:3.0:1787119490.319639:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633329152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.319873:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633329152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 235us (1024us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.319881:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9546 00002000:00100000:3.0:1787119490.319902:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (4595712->4599807) req@ffff92a509870e00 x1873929633329152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.319917:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870e00 with x1873929633329152 ext(4595712->4599807) 00002000:00010000:3.0:1787119490.319921:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509870e00 00000100:00100000:1.0:1787119490.332071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.332169:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633329280 00000100:00100000:3.0:1787119490.332179:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633329280 00002000:00010000:3.0:1787119490.332220:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (9219840->18446744073709551615) 00002000:00100000:3.0:1787119490.332224:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872a00 with x1873929633329280 ext(9219840->18446744073709551615) 00002000:00010000:3.0:1787119490.332238:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872a00. 00000100:00100000:3.0:1787119490.332282:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9547 00000100:00100000:3.0:1787119490.332292:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2376:x1873929633329280:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119490.332760:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 9936520 -> 9219840 00002000:00010000:3.0:1787119490.332765:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.332767:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.332769:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.332771:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:3.0:1787119490.332829:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2376:x1873929633329280:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 537us (767us total) trans 4294969070 rc 0/0 00000100:00100000:3.0:1787119490.332836:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9547 00002000:00010000:3.0:1787119490.332840:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (9219840->18446744073709551615) 00002000:00100000:3.0:1787119490.332843:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872a00 with x1873929633329280 ext(9219840->18446744073709551615) 00002000:00010000:3.0:1787119490.332847:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872a00. 00000100:00100000:1.0:1787119490.342643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.342731:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633329408 00000100:00100000:0.0:1787119490.342750:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633329408 00002000:00100000:0.0:1787119490.342798:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (21020672->21024767) req@ffff92a509871880 x1873929633329408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.342810:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871880 with x1873929633329408 ext(21020672->21024767) 00002000:00010000:0.0:1787119490.342816:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871880 00000100:00100000:0.0:1787119490.342850:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9548 00000100:00100000:0.0:1787119490.342859:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633329408:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.343109:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633329408:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 250us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.343117:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9548 00002000:00100000:0.0:1787119490.343125:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (21020672->21024767) req@ffff92a509871880 x1873929633329408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.343139:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871880 with x1873929633329408 ext(21020672->21024767) 00002000:00010000:0.0:1787119490.343143:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871880 00000100:00100000:1.0:1787119490.359865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.359900:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633329536 00000100:00100000:1.0:1787119490.359910:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633329536 00000100:00100000:1.0:1787119490.359969:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19494 00000100:00100000:1.0:1787119490.359979:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+163:32727:x1873929633329536:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119490.360004:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119490.360026:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e2b06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715aeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.360115:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2b0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.360130:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.360143:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119490.360171:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 9219840 00000004:00200000:1.0:1787119490.360175:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119490.360194:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.360222:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e573200/0xcaba3de8463e2b06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aeb expref: 165 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.360239:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aeb expref: 164 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.360247:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119490.360250:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119490.360253:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e572400, rc 0) 00000100:00100000:2.0:1787119490.360691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.360902:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+164:32727:x1873929633329536:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 924us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119490.360911:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19494 00000100:00100000:3.0:1787119490.361178:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633329664 00000100:00100000:3.0:1787119490.361184:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633329664 00002000:00100000:3.0:1787119490.361216:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (10907648->10911743) req@ffff92a50600a300 x1873929633329664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.361233:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600a300 with x1873929633329664 ext(10907648->10911743) 00002000:00010000:3.0:1787119490.361237:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50600a300 00000100:00100000:3.0:1787119490.361327:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9549 00000100:00100000:3.0:1787119490.361340:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633329664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.361662:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2376:x1873929633328512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 51429us (52878us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1787119490.361670:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9543 00002000:00100000:2.0:1787119490.361677:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (27848704->27918335) req@ffff92a508f68380 x1873929633328512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.361685:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68380 with x1873929633328512 ext(27848704->27918335) 00002000:00010000:2.0:1787119490.361688:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f68380 00000100:00100000:3.0:1787119490.361879:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633329664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 540us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119490.361886:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9549 00002000:00100000:3.0:1787119490.361893:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (10907648->10911743) req@ffff92a50600a300 x1873929633329664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.361900:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600a300 with x1873929633329664 ext(10907648->10911743) 00002000:00010000:3.0:1787119490.361903:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50600a300 00000100:00100000:0.0:1787119490.362965:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633329024:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 43537us (44157us total) trans 4294969071 rc 0/0 00000100:00100000:0.0:1787119490.362976:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9545 00002000:00100000:0.0:1787119490.362984:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (27869184->27931117) req@ffff92a509872300 x1873929633329024/t4294969071(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/448 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.362993:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872300 with x1873929633329024 ext(27869184->27931117) 00002000:00010000:0.0:1787119490.362998:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872300 00000100:00100000:3.0:1787119490.364904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.365115:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633329792 00000100:00100000:0.0:1787119490.365124:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633329792 00002000:00100000:0.0:1787119490.365172:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (4599808->4603903) req@ffff92a506575180 x1873929633329792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.365183:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575180 with x1873929633329792 ext(4599808->4603903) 00002000:00010000:0.0:1787119490.365188:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506575180 00000100:00100000:0.0:1787119490.365220:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9550 00000100:00100000:0.0:1787119490.365229:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633329792:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.366430:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633329792:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1186us (1518us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.366592:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9550 00002000:00100000:0.0:1787119490.366604:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (4599808->4603903) req@ffff92a506575180 x1873929633329792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.366619:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575180 with x1873929633329792 ext(4599808->4603903) 00002000:00010000:0.0:1787119490.366624:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506575180 00000100:00100000:1.0:1787119490.376801:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.376853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.376895:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633329920 00000100:00100000:2.0:1787119490.376908:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633329920 00000100:00100000:3.0:1787119490.376941:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633330048 00000100:00100000:3.0:1787119490.376947:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633330048 00002000:00100000:3.0:1787119490.376994:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (27918336->27934719) req@ffff92a509872d80 x1873929633330048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.377007:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872d80 with x1873929633330048 ext(27918336->27934719) 00002000:00010000:3.0:1787119490.377014:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872d80 00000100:00100000:3.0:1787119490.377055:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9551 00000100:00100000:2.0:1787119490.377055:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 4999 00000100:00100000:3.0:1787119490.377071:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2374:x1873929633330048:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.377072:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633329920:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119490.377373:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2374:x1873929633330048:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 306us (518us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119490.377385:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9551 00002000:00100000:3.0:1787119490.377392:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (27918336->27934719) req@ffff92a509872d80 x1873929633330048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/16824 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.377400:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872d80 with x1873929633330048 ext(27918336->27934719) 00002000:00010000:3.0:1787119490.377404:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872d80 00000100:00100000:3.0:1787119490.382891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.387164:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633330176 00000100:00100000:0.0:1787119490.387178:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633330176 00002000:00100000:0.0:1787119490.387230:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (10911744->10915839) req@ffff92a506576680 x1873929633330176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.387242:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576680 with x1873929633330176 ext(10911744->10915839) 00002000:00010000:0.0:1787119490.387247:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506576680 00000100:00100000:0.0:1787119490.387276:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9552 00000100:00100000:0.0:1787119490.387286:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633330176:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.390162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.393019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.393070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.393194:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633330560 00000100:00100000:2.0:1787119490.393205:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633330560 00002000:00100000:2.0:1787119490.393250:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (4575232->4640767) req@ffff92a509873480 x1873929633330560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.393261:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873480 with x1873929633330560 ext(4575232->4640767) 00002000:00010000:2.0:1787119490.393267:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509873480 00000100:00100000:2.0:1787119490.393294:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633330688 00000100:00100000:2.0:1787119490.393298:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633330688 00002000:00100000:2.0:1787119490.393314:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (27869184->27931117) req@ffff92a509870a80 x1873929633330688/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.393323:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870a80 with x1873929633330688 ext(27869184->27931117) 00002000:00010000:2.0:1787119490.393327:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870a80 00000100:00100000:2.0:1787119490.393348:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9553 00000100:00100000:2.0:1787119490.393357:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633330560:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.393649:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9554 00000100:00100000:2.0:1787119490.393658:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2374:x1873929633330688:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119490.394700:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633330432 00000100:00100000:3.0:1787119490.394709:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633330432 00000100:00100000:3.0:1787119490.394749:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19495 00000100:00100000:3.0:1787119490.394758:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+164:32727:x1873929633330432:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119490.394802:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119490.394831:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e572400/0xcaba3de8463e2b0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715aeb expref: 164 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.394850:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119490.394856:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119490.395042:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.395056:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.395066:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119490.395306:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976310 00000004:00010000:3.0:1787119490.395332:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007ff6a0c reply state 00000000b3c455d8 transno 4294976311 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.395342:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119490.395425:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+166:32727:x1873929633330432:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 667us (5274us total) trans 4294976311 rc 0/0 00000100:00100000:3.0:1787119490.395432:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19495 00000020:00080000:3.0:1787119490.395481:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119490.397031:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633330176:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9740us (14144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.397043:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9552 00002000:00100000:0.0:1787119490.397054:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (10911744->10915839) req@ffff92a506576680 x1873929633330176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.397064:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576680 with x1873929633330176 ext(10911744->10915839) 00002000:00010000:0.0:1787119490.397070:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506576680 00000100:00100000:2.0:1787119490.403725:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633330560:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10358us (11071us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119490.403738:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9553 00002000:00100000:2.0:1787119490.403751:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (4575232->4640767) req@ffff92a509873480 x1873929633330560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.403761:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873480 with x1873929633330560 ext(4575232->4640767) 00002000:00010000:2.0:1787119490.403768:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509873480 00000100:00100000:2.0:1787119490.408413:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2374:x1873929633330688:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 14746us (15333us total) trans 4294969072 rc 0/0 00000100:00100000:2.0:1787119490.408427:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9554 00002000:00100000:2.0:1787119490.408475:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (27869184->27931117) req@ffff92a509870a80 x1873929633330688/t4294969072(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/448 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.408487:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870a80 with x1873929633330688 ext(27869184->27931117) 00002000:00010000:2.0:1787119490.408493:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870a80 00010000:00010000:2.0:1787119490.410051:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.410067:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.410081:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.410087:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c65a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119490.410092:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.410098:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.410113:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119490.410116:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119490.410120:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.410126:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2b14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119490.410812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.410858:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633330816 00000100:00100000:3.0:1787119490.410868:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633330816 00002000:00010000:3.0:1787119490.410902:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (27931118->18446744073709551615) 00002000:00100000:3.0:1787119490.410906:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870700 with x1873929633330816 ext(27931118->18446744073709551615) 00002000:00010000:3.0:1787119490.410916:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870700. 00000100:00100000:3.0:1787119490.410946:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9555 00000100:00100000:3.0:1787119490.410954:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633330816:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119490.411181:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 9219840 -> 27931118 00002000:00010000:3.0:1787119490.411185:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119488 -> 1787119489 00002000:00010000:3.0:1787119490.411188:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.411191:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119488 -> 1787119489 00002000:00010000:3.0:1787119490.411193:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1165 00000100:00100000:3.0:1787119490.411235:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2376:x1873929633330816:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 281us (427us total) trans 4294969073 rc 0/0 00000100:00100000:3.0:1787119490.411241:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9555 00002000:00010000:3.0:1787119490.411245:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (27931118->18446744073709551615) 00002000:00100000:3.0:1787119490.411248:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870700 with x1873929633330816 ext(27931118->18446744073709551615) 00002000:00010000:3.0:1787119490.411251:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870700. 00000100:00100000:1.0:1787119490.411378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.411518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.413704:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633330944 00000100:00100000:2.0:1787119490.413716:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633330944 00002000:00100000:2.0:1787119490.413761:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (10907648->57078232) req@ffff92a509871c00 x1873929633330944/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 520/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.413772:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871c00 with x1873929633330944 ext(10907648->57078232) 00002000:00010000:2.0:1787119490.413778:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871c00 00000100:00100000:2.0:1787119490.413844:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633331072 00000100:00100000:2.0:1787119490.413848:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633331072 00002000:00100000:2.0:1787119490.413877:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (4640768->4677631) req@ffff92a509871180 x1873929633331072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.413890:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871180 with x1873929633331072 ext(4640768->4677631) 00002000:00010000:2.0:1787119490.413894:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871180 00000100:00100000:1.0:1787119490.414017:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9556 00000100:00100000:1.0:1787119490.414029:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633330944:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119490.414464:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9557 00000100:00100000:3.0:1787119490.414477:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633331072:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.416435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.416616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.416700:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633331200 00000100:00100000:0.0:1787119490.416711:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633331200 00000100:00100000:0.0:1787119490.416764:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5000 00000100:00100000:0.0:1787119490.416774:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2374:x1873929633331200:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119490.416839:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633331328 00000100:00100000:0.0:1787119490.416844:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633331328 00002000:00100000:0.0:1787119490.416868:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (27869184->27873279) req@ffff92a508da4000 x1873929633331328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.416878:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633331328 ext(27869184->27873279) 00002000:00010000:0.0:1787119490.416884:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4000 00000100:00100000:0.0:1787119490.416900:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9558 00000100:00100000:0.0:1787119490.416907:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633331328:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.417116:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633331328:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 208us (498us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.417125:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9558 00002000:00100000:0.0:1787119490.417132:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (27869184->27873279) req@ffff92a508da4000 x1873929633331328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.417141:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633331328 ext(27869184->27873279) 00002000:00010000:0.0:1787119490.417144:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4000 00000100:00100000:3.0:1787119490.424334:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.424808:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633331072:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10333us (13287us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119490.424816:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9557 00002000:00100000:3.0:1787119490.424826:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (4640768->4677631) req@ffff92a509871180 x1873929633331072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.424834:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871180 with x1873929633331072 ext(4640768->4677631) 00002000:00010000:3.0:1787119490.424839:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871180 00000100:00100000:3.0:1787119490.424870:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633331456 00000100:00100000:3.0:1787119490.424877:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633331456 00002000:00100000:3.0:1787119490.424902:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (27873280->27877375) req@ffff92a506574000 x1873929633331456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.425228:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506574000 with x1873929633331456 ext(27873280->27877375) 00002000:00010000:3.0:1787119490.425231:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506574000 00000100:00100000:3.0:1787119490.425259:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9559 00000100:00100000:3.0:1787119490.425269:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633331456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.427862:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633331456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2572us (3515us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.427876:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9559 00002000:00100000:3.0:1787119490.427896:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (27873280->27877375) req@ffff92a506574000 x1873929633331456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.427971:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506574000 with x1873929633331456 ext(27873280->27877375) 00002000:00010000:3.0:1787119490.427978:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506574000 00000100:00100000:1.0:1787119490.436542:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633330944:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 22503us (25152us total) trans 4294968837 rc 0/0 00000100:00100000:1.0:1787119490.436569:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9556 00002000:00100000:1.0:1787119490.436583:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (10907648->57078232) req@ffff92a509871c00 x1873929633330944/t4294968837(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 520/456 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.436593:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871c00 with x1873929633330944 ext(10907648->57078232) 00002000:00010000:1.0:1787119490.436600:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871c00 00000100:00100000:2.0:1787119490.440740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.440985:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633331584 00000100:00100000:1.0:1787119490.440996:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633331584 00002000:00100000:1.0:1787119490.441044:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (24838144->24842239) req@ffff92a506008e00 x1873929633331584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.441062:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008e00 with x1873929633331584 ext(24838144->24842239) 00002000:00010000:1.0:1787119490.441067:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008e00 00000100:00100000:1.0:1787119490.441103:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9560 00000100:00100000:1.0:1787119490.441112:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633331584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.441343:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633331584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 231us (615us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119490.441350:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9560 00002000:00100000:1.0:1787119490.441356:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (24838144->24842239) req@ffff92a506008e00 x1873929633331584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.441363:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008e00 with x1873929633331584 ext(24838144->24842239) 00002000:00010000:1.0:1787119490.441366:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008e00 00000100:00100000:2.0:1787119490.449538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.449595:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633331712 00000100:00100000:0.0:1787119490.449606:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633331712 00002000:00100000:0.0:1787119490.449711:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (24842240->24846335) req@ffff92a506dfd180 x1873929633331712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.449723:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd180 with x1873929633331712 ext(24842240->24846335) 00002000:00010000:0.0:1787119490.449729:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfd180 00000100:00100000:0.0:1787119490.449767:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9561 00000100:00100000:0.0:1787119490.449777:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633331712:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.451410:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633331712:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 357us (602us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.451427:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9561 00002000:00100000:0.0:1787119490.452316:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (24842240->24846335) req@ffff92a506dfd180 x1873929633331712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.452331:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd180 with x1873929633331712 ext(24842240->24846335) 00002000:00010000:0.0:1787119490.452337:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfd180 00000001:00080000:1.0:1787119490.455745:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969071 is committed 00000100:00100000:0.0:1787119490.456708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.456739:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633331840 00000100:00100000:0.0:1787119490.456749:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633331840 00000100:00100000:0.0:1787119490.456808:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5001 00000100:00100000:0.0:1787119490.456818:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633331840:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119490.457118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.457298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.458479:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633329920:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 81406us (81686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119490.458491:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 4999 00000100:00100000:3.0:1787119490.458612:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633331968 00000100:00100000:3.0:1787119490.458619:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633331968 00002000:00100000:3.0:1787119490.458653:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (24817664->24883199) req@ffff92a508f68a80 x1873929633331968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.458664:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68a80 with x1873929633331968 ext(24817664->24883199) 00002000:00010000:3.0:1787119490.458670:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f68a80 00000100:00100000:3.0:1787119490.458689:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633332096 00000100:00100000:3.0:1787119490.458692:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633332096 00002000:00100000:3.0:1787119490.458707:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (27848704->27918335) req@ffff92a508f68700 x1873929633332096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.458715:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68700 with x1873929633332096 ext(27848704->27918335) 00002000:00010000:3.0:1787119490.458719:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f68700 00000100:00100000:3.0:1787119490.458746:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9562 00000100:00100000:3.0:1787119490.458755:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633331968:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.458973:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9563 00000100:00100000:3.0:1787119490.458981:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633332096:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.471716:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633331968:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12950us (14585us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119490.471731:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9562 00002000:00100000:3.0:1787119490.471742:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (24817664->24883199) req@ffff92a508f68a80 x1873929633331968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.471759:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68a80 with x1873929633331968 ext(24817664->24883199) 00002000:00010000:3.0:1787119490.471766:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f68a80 00000100:00100000:3.0:1787119490.471844:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633332096:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12864us (14546us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1787119490.471852:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9563 00002000:00100000:3.0:1787119490.471858:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (27848704->27918335) req@ffff92a508f68700 x1873929633332096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.471866:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68700 with x1873929633332096 ext(27848704->27918335) 00002000:00010000:3.0:1787119490.471870:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f68700 00000100:00100000:3.0:1787119490.474248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.476221:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633332224 00000100:00100000:0.0:1787119490.476236:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633332224 00000100:00100000:0.0:1787119490.476290:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19496 00000100:00100000:0.0:1787119490.476314:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+165:32728:x1873929633332224:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119490.476340:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119490.476362:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e600/0xcaba3de8463e2b1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715af2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.479315:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2b22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.479340:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.479352:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119490.479398:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 27931118 00000004:00200000:2.0:1787119490.479403:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119490.479425:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.479577:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e600/0xcaba3de8463e2b1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715af2 expref: 167 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.479603:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715af2 expref: 166 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.479611:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119490.479614:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119490.479618:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e561e00, rc 0) 00000100:00100000:2.0:1787119490.479695:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+166:32728:x1873929633332224:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 3395us (5457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.479705:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19496 00000100:00100000:2.0:1787119490.480593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.485998:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633332352 00000100:00100000:0.0:1787119490.486014:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633332352 00002000:00100000:0.0:1787119490.486079:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (24883200->24920063) req@ffff92a506dfe680 x1873929633332352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.486088:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfe680 with x1873929633332352 ext(24883200->24920063) 00002000:00010000:0.0:1787119490.486093:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfe680 00000100:00100000:0.0:1787119490.486127:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9564 00000100:00100000:0.0:1787119490.486135:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633332352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.489211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.489255:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633332480 00000100:00100000:3.0:1787119490.489266:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633332480 00002000:00100000:3.0:1787119490.489312:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (22183936->22241279) req@ffff92a506dfc000 x1873929633332480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.489324:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfc000 with x1873929633332480 ext(22183936->22241279) 00002000:00010000:3.0:1787119490.489330:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfc000 00000100:00100000:3.0:1787119490.489360:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9565 00000100:00100000:3.0:1787119490.489369:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633332480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.490688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.490966:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633332608 00000100:00100000:0.0:1787119490.490979:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633332608 00002000:00100000:0.0:1787119490.491018:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (27918336->27934719) req@ffff92a506575f80 x1873929633332608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.491029:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575f80 with x1873929633332608 ext(27918336->27934719) 00002000:00010000:0.0:1787119490.491034:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575f80 00000100:00100000:0.0:1787119490.491064:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9566 00000100:00100000:0.0:1787119490.491073:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633332608:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.491302:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633332608:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 229us (618us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1787119490.491309:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9566 00002000:00100000:0.0:1787119490.491315:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (27918336->27934719) req@ffff92a506575f80 x1873929633332608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/16824 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.491322:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575f80 with x1873929633332608 ext(27918336->27934719) 00002000:00010000:0.0:1787119490.491325:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575f80 00000100:00100000:0.0:1787119490.504600:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633332352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18453us (24000us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119490.504614:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9564 00002000:00100000:0.0:1787119490.504628:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (24883200->24920063) req@ffff92a506dfe680 x1873929633332352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.504639:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfe680 with x1873929633332352 ext(24883200->24920063) 00002000:00010000:0.0:1787119490.504646:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfe680 00000100:00100000:3.0:1787119490.508308:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633332480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18929us (19095us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119490.508323:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9565 00002000:00100000:3.0:1787119490.508337:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (22183936->22241279) req@ffff92a506dfc000 x1873929633332480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.508348:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfc000 with x1873929633332480 ext(22183936->22241279) 00002000:00010000:3.0:1787119490.508355:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfc000 00000001:00080000:3.0:1787119490.524203:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969072 is committed 00000001:00080000:3.0:1787119490.524224:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969073 is committed 00000100:00100000:3.0:1787119490.524344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.524391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.524425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.524557:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633332736 00000100:00100000:2.0:1787119490.524567:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633332736 00002000:00100000:2.0:1787119490.524614:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (27869184->27931117) req@ffff92a506577100 x1873929633332736/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.524625:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577100 with x1873929633332736 ext(27869184->27931117) 00002000:00010000:2.0:1787119490.524631:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577100 00000100:00100000:2.0:1787119490.524650:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633332864 00000100:00100000:2.0:1787119490.524653:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633332864 00002000:00100000:2.0:1787119490.524668:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (24838144->61856377) req@ffff92a506eddc00 x1873929633332864/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.524676:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506eddc00 with x1873929633332864 ext(24838144->61856377) 00002000:00010000:2.0:1787119490.524680:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506eddc00 00000100:00100000:2.0:1787119490.524694:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633332992 00000100:00100000:2.0:1787119490.524697:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633332992 00002000:00100000:2.0:1787119490.524710:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (16539648->16543743) req@ffff92a506edd180 x1873929633332992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.524718:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd180 with x1873929633332992 ext(16539648->16543743) 00002000:00010000:2.0:1787119490.524724:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edd180 00000100:00100000:2.0:1787119490.524744:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9567 00000100:00100000:2.0:1787119490.524753:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633332736:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119490.524901:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9568 00000100:00100000:2.0:1787119490.524910:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633332864:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119490.525016:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9569 00000100:00100000:2.0:1787119490.525024:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633332992:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.525206:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633332992:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 182us (779us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.525214:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9569 00002000:00100000:2.0:1787119490.525221:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (16539648->16543743) req@ffff92a506edd180 x1873929633332992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.525227:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd180 with x1873929633332992 ext(16539648->16543743) 00002000:00010000:2.0:1787119490.525230:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edd180 00000100:00100000:1.0:1787119490.526214:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633331200:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 109436us (109781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119490.526225:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5000 00000100:00100000:3.0:1787119490.529953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.530091:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633333120 00000100:00100000:0.0:1787119490.530103:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633333120 00002000:00100000:0.0:1787119490.530160:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (16543744->16547839) req@ffff92a506ede680 x1873929633333120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.530172:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506ede680 with x1873929633333120 ext(16543744->16547839) 00002000:00010000:0.0:1787119490.530178:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506ede680 00000100:00100000:0.0:1787119490.530209:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9570 00000100:00100000:0.0:1787119490.530219:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633333120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.530670:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633333120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 451us (725us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.530679:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9570 00002000:00100000:0.0:1787119490.530686:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (16543744->16547839) req@ffff92a506ede680 x1873929633333120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.530694:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506ede680 with x1873929633333120 ext(16543744->16547839) 00002000:00010000:0.0:1787119490.530699:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506ede680 00000100:00100000:2.0:1787119490.532986:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633332736:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 8225us (8637us total) trans 4294969074 rc 0/0 00000100:00100000:2.0:1787119490.533000:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9567 00002000:00100000:2.0:1787119490.533011:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (27869184->27931117) req@ffff92a506577100 x1873929633332736/t4294969074(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/448 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.533022:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577100 with x1873929633332736 ext(27869184->27931117) 00002000:00010000:2.0:1787119490.533028:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577100 00000100:00100000:2.0:1787119490.534328:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633332864:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9410us (9928us total) trans 4294968838 rc 0/0 00000100:00100000:2.0:1787119490.534340:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9568 00002000:00100000:2.0:1787119490.534350:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (24838144->61856377) req@ffff92a506eddc00 x1873929633332864/t4294968838(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/448 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.534359:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506eddc00 with x1873929633332864 ext(24838144->61856377) 00002000:00010000:2.0:1787119490.534365:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506eddc00 00000100:00100000:3.0:1787119490.536642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.538534:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633333248 00000100:00100000:2.0:1787119490.538558:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633333248 00000100:00100000:2.0:1787119490.538629:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19497 00000100:00100000:2.0:1787119490.538638:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+166:32729:x1873929633333248:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119490.538657:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119490.538679:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715af9 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.538754:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e2b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.538765:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e2b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.538773:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e2b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119490.538792:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 27931118 00000004:00200000:2.0:1787119490.538795:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119490.538809:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e2b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.538826:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715af9 expref: 168 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.538839:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e2b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715af9 expref: 167 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.538845:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119490.538848:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119490.538852:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e560e00, rc 0) 00000100:00100000:2.0:1787119490.538924:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+167:32729:x1873929633333248:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 286us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.538931:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19497 00000100:00100000:0.0:1787119490.539660:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633331840:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 82842us (82956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.539667:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5001 00000001:00080000:0.0:1787119490.539689:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968834 is committed 00000001:00080000:0.0:1787119490.539696:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968837 is committed 00000100:00100000:3.0:1787119490.539906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.540269:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633333376 00000100:00100000:1.0:1787119490.540277:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633333376 00002000:00100000:1.0:1787119490.540318:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (16519168->16584703) req@ffff92a506edd500 x1873929633333376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.540329:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd500 with x1873929633333376 ext(16519168->16584703) 00002000:00010000:1.0:1787119490.540334:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edd500 00000100:00100000:1.0:1787119490.540361:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9571 00000100:00100000:1.0:1787119490.540370:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633333376:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.541313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.541708:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633333504 00000100:00100000:2.0:1787119490.541716:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633333504 00000100:00100000:2.0:1787119490.542233:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5002 00000100:00100000:2.0:1787119490.542245:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633333504:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119490.544113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.544387:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633333632 00000100:00100000:1.0:1787119490.544398:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633333632 00000100:00100000:2.0:1787119490.545975:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5003 00000100:00100000:2.0:1787119490.545987:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633333632:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119490.561505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.561889:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633333376:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 21517us (21981us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119490.561902:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9571 00002000:00100000:1.0:1787119490.561918:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (16519168->16584703) req@ffff92a506edd500 x1873929633333376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.561930:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd500 with x1873929633333376 ext(16519168->16584703) 00002000:00010000:1.0:1787119490.561937:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edd500 00000100:00100000:1.0:1787119490.561964:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633333760 00000100:00100000:1.0:1787119490.561972:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633333760 00002000:00100000:1.0:1787119490.562003:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (22183936->22241279) req@ffff92a508f6a680 x1873929633333760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.562013:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6a680 with x1873929633333760 ext(22183936->22241279) 00002000:00010000:1.0:1787119490.562016:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6a680 00000100:00100000:1.0:1787119490.562037:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9572 00000100:00100000:1.0:1787119490.562046:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633333760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.574875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.577347:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633333888 00000100:00100000:2.0:1787119490.577364:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633333888 00002000:00100000:2.0:1787119490.577453:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (15896576->15904767) req@ffff92a508da5500 x1873929633333888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.577466:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5500 with x1873929633333888 ext(15896576->15904767) 00002000:00010000:2.0:1787119490.577473:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da5500 00000100:00100000:2.0:1787119490.577504:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9573 00000100:00100000:2.0:1787119490.577514:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633333888:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.577767:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633333888:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 253us (2900us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119490.577775:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9573 00002000:00100000:2.0:1787119490.577782:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (15896576->15904767) req@ffff92a508da5500 x1873929633333888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/8632 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.577798:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5500 with x1873929633333888 ext(15896576->15904767) 00002000:00010000:2.0:1787119490.577801:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da5500 00000100:00100000:0.0:1787119490.582303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.582682:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633334144 00000100:00100000:3.0:1787119490.582692:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633334144 00000100:00100000:3.0:1787119490.582754:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19498 00000100:00100000:3.0:1787119490.582764:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+167:32728:x1873929633334144:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119490.582817:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119490.582843:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2b22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715af2 expref: 167 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.582861:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119490.582866:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119490.583079:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.583094:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.583104:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119490.583173:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976312 00000004:00010000:3.0:1787119490.583201:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000badedb3e reply state 00000000aa33582e transno 4294976313 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.583211:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119490.583300:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+169:32728:x1873929633334144:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 536us (1005us total) trans 4294976313 rc 0/0 00000100:00100000:3.0:1787119490.583308:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19498 00000020:00080000:3.0:1787119490.583313:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119490.583792:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633333760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 21744us (22304us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119490.583803:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9572 00002000:00100000:0.0:1787119490.583812:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (22183936->22241279) req@ffff92a508f6a680 x1873929633333760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.583822:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6a680 with x1873929633333760 ext(22183936->22241279) 00002000:00010000:0.0:1787119490.583828:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6a680 00000100:00100000:0.0:1787119490.584723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.584796:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633334272 00000100:00100000:3.0:1787119490.584805:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633334272 00002000:00100000:3.0:1787119490.584844:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (56160256->56205311) req@ffff92a508f69500 x1873929633334272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.584856:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69500 with x1873929633334272 ext(56160256->56205311) 00002000:00010000:3.0:1787119490.584860:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f69500 00000100:00100000:3.0:1787119490.584890:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9574 00000100:00100000:3.0:1787119490.584899:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633334272:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.586477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119490.587566:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.587585:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.587592:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.587600:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c64c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.587606:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.587615:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.587635:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119490.587638:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119490.587643:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.587648:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2b37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.587683:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633334400 00000100:00100000:3.0:1787119490.587693:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633334400 00002000:00010000:3.0:1787119490.587733:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (46658807->18446744073709551615) 00002000:00100000:3.0:1787119490.587737:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69f80 with x1873929633334400 ext(46658807->18446744073709551615) 00002000:00010000:3.0:1787119490.587747:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69f80. 00000100:00100000:3.0:1787119490.587784:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9575 00000100:00100000:3.0:1787119490.587794:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633334400:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119490.588078:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 27931118 -> 46658807 00002000:00010000:3.0:1787119490.588082:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119489 00002000:00010000:3.0:1787119490.588085:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.588087:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119489 00002000:00010000:3.0:1787119490.588090:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1421 00000100:00100000:3.0:1787119490.588153:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633334400:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 359us (1683us total) trans 4294969075 rc 0/0 00000100:00100000:3.0:1787119490.588161:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9575 00002000:00010000:3.0:1787119490.588166:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (46658807->18446744073709551615) 00002000:00100000:3.0:1787119490.588168:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69f80 with x1873929633334400 ext(46658807->18446744073709551615) 00002000:00010000:3.0:1787119490.588173:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69f80. 00000100:00100000:3.0:1787119490.590208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.592644:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633334272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7736us (7918us total) trans 0 rc 45056/45056 00000100:00100000:3.0:1787119490.592658:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9574 00002000:00100000:3.0:1787119490.592673:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (56160256->56205311) req@ffff92a508f69500 x1873929633334272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.592684:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69500 with x1873929633334272 ext(56160256->56205311) 00002000:00010000:3.0:1787119490.592690:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f69500 00000100:00100000:3.0:1787119490.592717:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633334528 00000100:00100000:3.0:1787119490.592725:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633334528 00002000:00100000:3.0:1787119490.592760:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (16539648->16543743) req@ffff92a506eddf80 x1873929633334528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.592768:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506eddf80 with x1873929633334528 ext(16539648->16543743) 00002000:00010000:3.0:1787119490.592772:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506eddf80 00000100:00100000:3.0:1787119490.592796:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9576 00000100:00100000:3.0:1787119490.592807:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633334528:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.592996:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633334528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 191us (2793us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.593003:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9576 00002000:00100000:3.0:1787119490.593009:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (16539648->16543743) req@ffff92a506eddf80 x1873929633334528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.593022:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506eddf80 with x1873929633334528 ext(16539648->16543743) 00002000:00010000:3.0:1787119490.593025:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506eddf80 00000100:00100000:1.0:1787119490.594328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.594395:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633334656 00000100:00100000:3.0:1787119490.594404:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633334656 00000100:00100000:3.0:1787119490.594483:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19499 00000100:00100000:3.0:1787119490.594493:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+168:32728:x1873929633334656:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119490.594513:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119490.594536:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2b3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b00 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.594635:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2b45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.594650:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.594661:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119490.594688:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 46658807 00000004:00200000:3.0:1787119490.594693:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119490.594714:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.594752:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2b3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b00 expref: 170 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.594770:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2b45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b00 expref: 169 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.594780:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119490.594783:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119490.594786:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c65800, rc 0) 00000100:00100000:3.0:1787119490.594836:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+169:32728:x1873929633334656:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 344us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119490.594843:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19499 00000001:00080000:0.0:1787119490.596530:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968838 is committed 00000100:00100000:2.0:1787119490.596860:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633333504:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 54612us (55546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.596873:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5002 00000100:00100000:2.0:1787119490.597171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.597581:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633334784 00000100:00100000:3.0:1787119490.597590:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633334784 00002000:00100000:3.0:1787119490.597632:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (16543744->16547839) req@ffff92a506dfd500 x1873929633334784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.597642:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd500 with x1873929633334784 ext(16543744->16547839) 00002000:00010000:3.0:1787119490.597648:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfd500 00000100:00100000:3.0:1787119490.597685:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9577 00000100:00100000:3.0:1787119490.597696:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633334784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.597928:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633334784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 234us (757us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.597935:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9577 00002000:00100000:3.0:1787119490.597942:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (16543744->16547839) req@ffff92a506dfd500 x1873929633334784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.597950:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd500 with x1873929633334784 ext(16543744->16547839) 00002000:00010000:3.0:1787119490.597953:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfd500 00000001:00080000:3.0:1787119490.600025:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969074 is committed 00000100:00100000:0.0:1787119490.600622:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633333632:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 54632us (56513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.600634:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5003 00000100:00100000:3.0:1787119490.606538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.606725:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633334912 00000100:00100000:0.0:1787119490.606733:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633334912 00002000:00100000:0.0:1787119490.606777:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (56528896->56532991) req@ffff92a506edf100 x1873929633334912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.606786:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edf100 with x1873929633334912 ext(56528896->56532991) 00002000:00010000:0.0:1787119490.606790:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edf100 00000100:00100000:0.0:1787119490.606817:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9578 00000100:00100000:0.0:1787119490.606824:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633334912:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.607123:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633334912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 296us (593us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.607140:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9578 00002000:00100000:0.0:1787119490.607147:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (56528896->56532991) req@ffff92a506edf100 x1873929633334912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.607159:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edf100 with x1873929633334912 ext(56528896->56532991) 00002000:00010000:0.0:1787119490.607163:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edf100 00000100:00100000:1.0:1787119490.613013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.613105:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633335168 00000100:00100000:2.0:1787119490.613115:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633335168 00000100:00100000:2.0:1787119490.613180:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19500 00000100:00100000:2.0:1787119490.613189:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+169:32720:x1873929633335168:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119490.613246:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119490.613283:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2af8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ae4 expref: 169 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.613304:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119490.613308:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119490.613572:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.613587:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.613597:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119490.613646:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976314 00000004:00010000:2.0:1787119490.613670:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4e7c1bb reply state 0000000083f2a09c transno 4294976315 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119490.613680:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119490.613765:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+171:32720:x1873929633335168:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 577us (762us total) trans 4294976315 rc 0/0 00000100:00100000:2.0:1787119490.613772:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19500 00000020:00080000:2.0:1787119490.613777:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119490.615181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.615263:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633335296 00000100:00100000:3.0:1787119490.615271:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633335296 00000100:00100000:3.0:1787119490.615324:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19501 00000100:00100000:3.0:1787119490.615333:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+171:32727:x1873929633335296:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119490.615351:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119490.615368:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b07 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.615487:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2b5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.615501:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.615512:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119490.615553:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 27931118 00000004:00200000:3.0:1787119490.615558:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119490.615577:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.615601:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b07 expref: 173 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.615617:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2b5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b07 expref: 172 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.615625:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119490.615627:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119490.615631:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c64400, rc 0) 00000100:00100000:3.0:1787119490.615676:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+172:32727:x1873929633335296:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 345us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119490.615683:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19501 00010000:00010000:2.0:1787119490.617748:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.617765:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.617772:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.617778:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e561a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119490.617783:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.617790:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.617807:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119490.617810:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119490.617814:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.617820:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.621650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.621677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.621698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.621712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.621777:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633335424 00000100:00100000:1.0:1787119490.621785:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633335424 00002000:00100000:1.0:1787119490.621825:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (16519168->16584703) req@ffff92a508f6a300 x1873929633335424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.621833:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6a300 with x1873929633335424 ext(16519168->16584703) 00002000:00010000:1.0:1787119490.621840:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6a300 00000100:00100000:1.0:1787119490.621866:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633335552 00000100:00100000:1.0:1787119490.621870:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633335552 00002000:00100000:1.0:1787119490.621887:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (56545280->56549375) req@ffff92a508f68e00 x1873929633335552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.621895:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68e00 with x1873929633335552 ext(56545280->56549375) 00002000:00010000:1.0:1787119490.621899:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f68e00 00000100:00100000:1.0:1787119490.621913:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633335680 00000100:00100000:1.0:1787119490.621916:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633335680 00002000:00010000:1.0:1787119490.621929:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (38554013->18446744073709551615) 00002000:00100000:1.0:1787119490.621932:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6aa00 with x1873929633335680 ext(38554013->18446744073709551615) 00002000:00010000:1.0:1787119490.621941:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6aa00. 00000100:00100000:1.0:1787119490.621952:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633335808 00000100:00100000:1.0:1787119490.621955:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633335808 00002000:00100000:1.0:1787119490.621968:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (4595712->4599807) req@ffff92a508f69880 x1873929633335808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.621976:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69880 with x1873929633335808 ext(4595712->4599807) 00002000:00010000:1.0:1787119490.621979:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69880 00000100:00100000:1.0:1787119490.621997:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9579 00000100:00100000:1.0:1787119490.622005:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633335424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.622251:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9580 00000100:00100000:1.0:1787119490.622260:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633335552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.622375:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633335552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 116us (696us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119490.622381:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9580 00002000:00100000:1.0:1787119490.622386:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (56545280->56549375) req@ffff92a508f68e00 x1873929633335552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.622391:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68e00 with x1873929633335552 ext(56545280->56549375) 00002000:00010000:1.0:1787119490.622393:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f68e00 00000100:00100000:1.0:1787119490.622407:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9581 00000100:00100000:1.0:1787119490.622410:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633335680:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119490.622704:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 46658807 -> 38554013 00002000:00010000:1.0:1787119490.622707:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119489 00002000:00010000:1.0:1787119490.622709:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:1.0:1787119490.622710:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119489 00002000:00010000:1.0:1787119490.622712:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1421 -> 1805 00000100:00100000:1.0:1787119490.622733:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633335680:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 322us (1034us total) trans 4294968839 rc 0/0 00000100:00100000:1.0:1787119490.622737:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9581 00002000:00010000:1.0:1787119490.622739:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (38554013->18446744073709551615) 00002000:00100000:1.0:1787119490.622741:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6aa00 with x1873929633335680 ext(38554013->18446744073709551615) 00002000:00010000:1.0:1787119490.622744:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6aa00. 00000100:00100000:1.0:1787119490.622754:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9582 00000100:00100000:1.0:1787119490.622758:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633335808:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.622833:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633335808:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 74us (1119us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119490.622837:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9582 00002000:00100000:1.0:1787119490.622840:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (4595712->4599807) req@ffff92a508f69880 x1873929633335808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.622852:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69880 with x1873929633335808 ext(4595712->4599807) 00002000:00010000:1.0:1787119490.622855:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69880 00000100:00100000:0.0:1787119490.629362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.629692:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633335936 00000100:00100000:1.0:1787119490.629704:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633335936 00002000:00100000:1.0:1787119490.629759:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (22183936->22241279) req@ffff92a519cdd180 x1873929633335936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.629770:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd180 with x1873929633335936 ext(22183936->22241279) 00002000:00010000:1.0:1787119490.629776:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd180 00000100:00100000:1.0:1787119490.629809:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9583 00000100:00100000:1.0:1787119490.629818:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633335936:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.635160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.635271:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633336064 00000100:00100000:2.0:1787119490.635281:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633336064 00002000:00100000:2.0:1787119490.635326:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (4599808->4603903) req@ffff92a519cde680 x1873929633336064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.635335:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cde680 with x1873929633336064 ext(4599808->4603903) 00002000:00010000:2.0:1787119490.635340:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cde680 00000100:00100000:2.0:1787119490.635363:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9584 00000100:00100000:2.0:1787119490.635369:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633336064:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.635634:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633336064:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 263us (484us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.635643:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9584 00002000:00100000:2.0:1787119490.635651:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (4599808->4603903) req@ffff92a519cde680 x1873929633336064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.635658:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cde680 with x1873929633336064 ext(4599808->4603903) 00002000:00010000:2.0:1787119490.635662:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cde680 00000100:00100000:3.0:1787119490.636352:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633335936:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6530us (6997us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119490.636361:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9583 00002000:00100000:3.0:1787119490.636368:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (22183936->22241279) req@ffff92a519cdd180 x1873929633335936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.636376:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd180 with x1873929633335936 ext(22183936->22241279) 00002000:00010000:3.0:1787119490.636380:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd180 00000100:00100000:1.0:1787119490.636392:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633335424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14388us (14751us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119490.636400:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9579 00002000:00100000:1.0:1787119490.636405:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (16519168->16584703) req@ffff92a508f6a300 x1873929633335424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.636420:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6a300 with x1873929633335424 ext(16519168->16584703) 00002000:00010000:1.0:1787119490.636424:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6a300 00000100:00100000:0.0:1787119490.636821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.636882:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633336192 00000100:00100000:3.0:1787119490.636889:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633336192 00000100:00100000:3.0:1787119490.636930:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19502 00000100:00100000:3.0:1787119490.636939:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+171:32720:x1873929633336192:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119490.636957:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119490.636977:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b0e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.637049:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2b68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.637060:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.637068:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119490.637089:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 38554013 00000004:00200000:3.0:1787119490.637093:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119490.637105:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.637124:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b0e expref: 173 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.637146:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b0e expref: 172 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.637152:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119490.637154:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119490.637157:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c65000, rc 0) 00000100:00100000:3.0:1787119490.637185:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+172:32720:x1873929633336192:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 249us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119490.637189:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19502 00000100:00100000:0.0:1787119490.641526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.641596:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633336320 00000100:00100000:2.0:1787119490.641607:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633336320 00002000:00100000:2.0:1787119490.641659:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (4575232->4640767) req@ffff92a519cdd500 x1873929633336320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.641670:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd500 with x1873929633336320 ext(4575232->4640767) 00002000:00010000:2.0:1787119490.641676:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd500 00000100:00100000:2.0:1787119490.641765:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9585 00000100:00100000:2.0:1787119490.641777:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633336320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.649759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.650143:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633336320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8366us (8626us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119490.650155:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9585 00002000:00100000:3.0:1787119490.650167:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (4575232->4640767) req@ffff92a519cdd500 x1873929633336320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.650177:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd500 with x1873929633336320 ext(4575232->4640767) 00002000:00010000:3.0:1787119490.650184:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd500 00000100:00100000:3.0:1787119490.650212:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633336448 00000100:00100000:3.0:1787119490.650219:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633336448 00002000:00100000:3.0:1787119490.650270:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (16539648->16543743) req@ffff92a519cddf80 x1873929633336448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.650279:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cddf80 with x1873929633336448 ext(16539648->16543743) 00002000:00010000:3.0:1787119490.650282:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cddf80 00000100:00100000:2.0:1787119490.651623:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9586 00000100:00100000:2.0:1787119490.651641:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633336448:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.651945:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633336448:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 311us (2195us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.651952:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9586 00002000:00100000:2.0:1787119490.651959:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (16539648->16543743) req@ffff92a519cddf80 x1873929633336448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.651969:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cddf80 with x1873929633336448 ext(16539648->16543743) 00002000:00010000:2.0:1787119490.651974:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cddf80 00000100:00100000:0.0:1787119490.662721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.662805:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633336704 00000100:00100000:2.0:1787119490.662813:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633336704 00000100:00100000:2.0:1787119490.662878:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19503 00000100:00100000:2.0:1787119490.662889:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+172:32720:x1873929633336704:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119490.662953:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119490.662984:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2b68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b0e expref: 172 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.663003:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119490.663007:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119490.663198:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.663209:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.663216:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119490.663270:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976316 00000004:00010000:2.0:1787119490.663298:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011fabbb8 reply state 00000000f55619bd transno 4294976317 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119490.663307:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119490.663393:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+174:32720:x1873929633336704:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 506us (686us total) trans 4294976317 rc 0/0 00000100:00100000:2.0:1787119490.663399:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19503 00000020:00080000:2.0:1787119490.663403:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119490.668620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.668637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.668648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.668668:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633337216 00000100:00100000:0.0:1787119490.668677:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633337216 00002000:00100000:0.0:1787119490.668723:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (54800384->54861823) req@ffff92a519cdce00 x1873929633337216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.668732:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdce00 with x1873929633337216 ext(54800384->54861823) 00002000:00010000:0.0:1787119490.668736:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdce00 00000100:00100000:0.0:1787119490.668751:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633336832 00000100:00100000:0.0:1787119490.668753:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633336832 00002000:00100000:0.0:1787119490.668766:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (4640768->4677631) req@ffff92a519cdea00 x1873929633336832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.668776:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdea00 with x1873929633336832 ext(4640768->4677631) 00002000:00010000:0.0:1787119490.668778:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdea00 00000100:00100000:0.0:1787119490.668787:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9587 00000100:00100000:0.0:1787119490.668793:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633337216:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.669056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119490.669927:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.669941:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.669949:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.669956:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63e561a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.669961:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.669968:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.669984:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119490.669988:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119490.669992:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.669998:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561a00/0xcaba3de8463e2b6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.670032:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633337344 00000100:00100000:3.0:1787119490.670040:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633337344 00002000:00100000:3.0:1787119490.670076:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (16543744->16547839) req@ffff92a519cdd880 x1873929633337344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.670085:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd880 with x1873929633337344 ext(16543744->16547839) 00002000:00010000:3.0:1787119490.670090:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd880 00000100:00100000:3.0:1787119490.670168:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9588 00000100:00100000:3.0:1787119490.670178:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633336832:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.670398:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9589 00000100:00100000:3.0:1787119490.670406:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633337344:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.670630:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633337344:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 225us (1573us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.670635:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9589 00002000:00100000:3.0:1787119490.670640:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (16543744->16547839) req@ffff92a519cdd880 x1873929633337344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.670646:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd880 with x1873929633337344 ext(16543744->16547839) 00002000:00010000:3.0:1787119490.670648:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd880 00000100:00100000:3.0:1787119490.670672:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633337088 00000100:00100000:3.0:1787119490.670676:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633337088 00000100:00100000:3.0:1787119490.670708:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19504 00000100:00100000:3.0:1787119490.670714:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+173:32729:x1873929633337088:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119490.670750:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119490.670767:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560e00/0xcaba3de8463e2b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715af9 expref: 173 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.670776:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119490.670779:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119490.670955:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.670965:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.670972:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119490.671016:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976318 00000004:00010000:3.0:1787119490.671035:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bc716a2 reply state 000000000af9f6fc transno 4294976319 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.671041:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119490.671081:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+175:32729:x1873929633337088:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 368us (2470us total) trans 4294976319 rc 0/0 00000100:00100000:3.0:1787119490.671086:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19504 00000020:00080000:3.0:1787119490.671088:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119490.671511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119490.672806:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.672820:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.672827:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.672834:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c64200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.672839:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.672852:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.673045:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633337216:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4247us (4401us total) trans 0 rc 61440/61440 00000100:00100000:0.0:1787119490.673060:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9587 00010000:00010000:3.0:1787119490.673066:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119490.673072:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00100000:0.0:1787119490.673072:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (54800384->54861823) req@ffff92a519cdce00 x1873929633337216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787119490.673080:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787119490.673091:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdce00 with x1873929633337216 ext(54800384->54861823) 00010000:00010000:3.0:1787119490.673094:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2b76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119490.673098:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdce00 00000100:00100000:0.0:1787119490.673127:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633337472 00000100:00100000:0.0:1787119490.673134:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633337472 00002000:00010000:0.0:1787119490.673159:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (1008584->18446744073709551615) 00002000:00100000:0.0:1787119490.673162:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdfb80 with x1873929633337472 ext(1008584->18446744073709551615) 00002000:00010000:0.0:1787119490.673172:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdfb80. 00000100:00100000:2.0:1787119490.673859:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9590 00000100:00100000:2.0:1787119490.673886:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633337472:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119490.674163:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 38554013 -> 1008584 00002000:00010000:2.0:1787119490.674167:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:2.0:1787119490.674169:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.674171:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:2.0:1787119490.674173:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1805 -> 1805 00000100:00100000:2.0:1787119490.674225:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633337472:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 346us (2715us total) trans 4294968840 rc 0/0 00000100:00100000:2.0:1787119490.674230:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9590 00002000:00010000:2.0:1787119490.674233:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (1008584->18446744073709551615) 00002000:00100000:2.0:1787119490.674235:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdfb80 with x1873929633337472 ext(1008584->18446744073709551615) 00002000:00010000:2.0:1787119490.674239:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdfb80. 00000100:00100000:3.0:1787119490.679975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.680096:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633337600 00000100:00100000:2.0:1787119490.680106:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633337600 00002000:00010000:2.0:1787119490.680141:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (46658807->18446744073709551615) 00002000:00100000:2.0:1787119490.680146:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506ede300 with x1873929633337600 ext(46658807->18446744073709551615) 00002000:00010000:2.0:1787119490.680157:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506ede300. 00000100:00100000:2.0:1787119490.680190:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9591 00000100:00100000:2.0:1787119490.680198:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633337600:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119490.680503:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 27931118 -> 46658807 00002000:00010000:2.0:1787119490.680507:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119488 -> 1787119489 00002000:00010000:2.0:1787119490.680509:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.680511:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119488 -> 1787119489 00002000:00010000:2.0:1787119490.680513:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1421 00000100:00100000:2.0:1787119490.680577:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633337600:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 378us (610us total) trans 4294969076 rc 0/0 00000100:00100000:2.0:1787119490.680584:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9591 00002000:00010000:2.0:1787119490.680587:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (46658807->18446744073709551615) 00002000:00100000:2.0:1787119490.680600:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506ede300 with x1873929633337600 ext(46658807->18446744073709551615) 00002000:00010000:2.0:1787119490.680605:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506ede300. 00000100:00100000:0.0:1787119490.681643:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633336832:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11460us (12986us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119490.681654:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9588 00002000:00100000:0.0:1787119490.681665:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (4640768->4677631) req@ffff92a519cdea00 x1873929633336832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.681682:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdea00 with x1873929633336832 ext(4640768->4677631) 00002000:00010000:0.0:1787119490.681687:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdea00 00000100:00100000:3.0:1787119490.692243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.692298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.692328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.692360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.692403:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633337856 00000100:00100000:1.0:1787119490.692419:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633337856 00002000:00100000:1.0:1787119490.692507:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (16519168->16584703) req@ffff92a506edea00 x1873929633337856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.692517:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edea00 with x1873929633337856 ext(16519168->16584703) 00002000:00010000:1.0:1787119490.692523:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edea00 00000100:00100000:1.0:1787119490.692554:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633337984 00000100:00100000:1.0:1787119490.692557:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633337984 00002000:00100000:1.0:1787119490.692575:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (22253568->22257663) req@ffff92a506edd880 x1873929633337984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.692583:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd880 with x1873929633337984 ext(22253568->22257663) 00002000:00010000:1.0:1787119490.692587:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edd880 00000100:00100000:1.0:1787119490.692712:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633338112 00000100:00100000:1.0:1787119490.692716:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633338112 00002000:00100000:1.0:1787119490.692738:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (24838144->24842239) req@ffff92a506edfb80 x1873929633338112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.692746:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edfb80 with x1873929633338112 ext(24838144->24842239) 00002000:00010000:1.0:1787119490.692750:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edfb80 00000100:00100000:1.0:1787119490.692767:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9592 00000100:00100000:1.0:1787119490.692777:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633337856:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.693382:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9593 00000100:00100000:0.0:1787119490.693392:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633337984:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.693762:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633337984:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 372us (1432us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.693769:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9593 00002000:00100000:0.0:1787119490.693775:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (22253568->22257663) req@ffff92a506edd880 x1873929633337984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.693782:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd880 with x1873929633337984 ext(22253568->22257663) 00002000:00010000:0.0:1787119490.693785:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edd880 00000100:00100000:0.0:1787119490.693800:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9594 00000100:00100000:0.0:1787119490.693805:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633338112:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.694038:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633338112:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 231us (1676us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.694043:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9594 00002000:00100000:0.0:1787119490.694047:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (24838144->24842239) req@ffff92a506edfb80 x1873929633338112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.694053:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edfb80 with x1873929633338112 ext(24838144->24842239) 00002000:00010000:0.0:1787119490.694055:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edfb80 00000100:00100000:2.0:1787119490.694122:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633337728 00000100:00100000:2.0:1787119490.694127:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633337728 00000100:00100000:2.0:1787119490.694170:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19505 00000100:00100000:2.0:1787119490.694178:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+174:32720:x1873929633337728:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119490.694194:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119490.694212:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2b7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b15 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.694293:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e2b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.694308:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e2b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.694319:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e2b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119490.694340:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 1008584 00000004:00200000:2.0:1787119490.694343:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119490.694356:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e2b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.694375:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561e00/0xcaba3de8463e2b7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b15 expref: 176 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.694387:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e2b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b15 expref: 175 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.694393:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119490.694395:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119490.694397:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e560600, rc 0) 00000100:00100000:2.0:1787119490.694425:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+175:32720:x1873929633337728:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 249us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.694429:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19505 00000100:00100000:1.0:1787119490.697790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.698018:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633338240 00000100:00100000:2.0:1787119490.698029:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633338240 00000100:00100000:2.0:1787119490.698092:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19506 00000100:00100000:2.0:1787119490.698102:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+175:32729:x1873929633338240:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119490.698123:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119490.698144:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2b8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b1c expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.698231:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2b92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.698968:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.698985:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119490.699017:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 46658807 00000004:00200000:2.0:1787119490.699021:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119490.699039:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.699071:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560a00/0xcaba3de8463e2b8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b1c expref: 177 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.699089:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2b92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b1c expref: 176 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.699098:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119490.699101:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119490.699105:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e561400, rc 0) 00000100:00100000:2.0:1787119490.699170:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+176:32729:x1873929633338240:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1069us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.699179:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19506 00000100:00100000:1.0:1787119490.704004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.704070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.704148:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633337856:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11369us (11845us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119490.704159:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9592 00002000:00100000:3.0:1787119490.704171:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (16519168->16584703) req@ffff92a506edea00 x1873929633337856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.704182:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edea00 with x1873929633337856 ext(16519168->16584703) 00002000:00010000:3.0:1787119490.704188:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edea00 00000100:00100000:3.0:1787119490.704213:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633338368 00000100:00100000:3.0:1787119490.704219:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633338368 00002000:00100000:3.0:1787119490.704251:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (22257664->22261759) req@ffff92a508da4e00 x1873929633338368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.704264:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4e00 with x1873929633338368 ext(22257664->22261759) 00002000:00010000:3.0:1787119490.704268:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da4e00 00000100:00100000:0.0:1787119490.704280:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633338496 00000100:00100000:0.0:1787119490.704286:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633338496 00000100:00100000:3.0:1787119490.704297:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9595 00000100:00100000:3.0:1787119490.704307:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633338368:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:0.0:1787119490.704315:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (24842240->24846335) req@ffff92a508da6a00 x1873929633338496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.704326:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6a00 with x1873929633338496 ext(24842240->24846335) 00002000:00010000:0.0:1787119490.704330:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6a00 00000100:00100000:0.0:1787119490.704348:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9596 00000100:00100000:0.0:1787119490.704357:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633338496:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.704568:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633338368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 261us (573us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.704576:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9595 00002000:00100000:3.0:1787119490.704582:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (22257664->22261759) req@ffff92a508da4e00 x1873929633338368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.704589:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4e00 with x1873929633338368 ext(22257664->22261759) 00002000:00010000:3.0:1787119490.704600:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da4e00 00000100:00100000:0.0:1787119490.704640:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633338496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 283us (570us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.704650:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9596 00002000:00100000:0.0:1787119490.704656:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (24842240->24846335) req@ffff92a508da6a00 x1873929633338496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.704666:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6a00 with x1873929633338496 ext(24842240->24846335) 00002000:00010000:0.0:1787119490.704670:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6a00 00000100:00100000:1.0:1787119490.723216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.723598:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633338624 00000100:00100000:2.0:1787119490.723609:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633338624 00002000:00100000:2.0:1787119490.723739:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (24817664->24883199) req@ffff92a508da5880 x1873929633338624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.723751:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633338624 ext(24817664->24883199) 00002000:00010000:2.0:1787119490.723758:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5880 00000100:00100000:2.0:1787119490.724215:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9597 00000100:00100000:2.0:1787119490.724228:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633338624:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.724434:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.724585:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633338752 00000100:00100000:1.0:1787119490.724602:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633338752 00002000:00100000:1.0:1787119490.724637:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (0->1011711) req@ffff92a506edc380 x1873929633338752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.724648:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edc380 with x1873929633338752 ext(0->1011711) 00002000:00010000:1.0:1787119490.724653:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edc380 00000100:00100000:1.0:1787119490.724683:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9598 00000100:00100000:1.0:1787119490.724692:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633338752:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.732333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.732775:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633339136 00000100:00100000:0.0:1787119490.732788:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633339136 00000100:00100000:3.0:1787119490.733669:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19507 00000100:00100000:3.0:1787119490.733685:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+176:32727:x1873929633339136:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119490.733743:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119490.733774:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2b5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b07 expref: 176 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.733794:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119490.733800:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119490.734028:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.734047:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.734057:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119490.734116:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976320 00000004:00010000:3.0:1787119490.734143:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e156c26 reply state 00000000bd231c30 transno 4294976321 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.734153:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119490.734249:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+178:32727:x1873929633339136:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 567us (1924us total) trans 4294976321 rc 0/0 00000100:00100000:3.0:1787119490.734257:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19507 00000020:00080000:3.0:1787119490.734263:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119490.738883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.739028:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633338880 00000100:00100000:3.0:1787119490.739035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.739041:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633338880 00002000:00100000:0.0:1787119490.739093:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (22233088->22298623) req@ffff92a508da7b80 x1873929633338880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.739104:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7b80 with x1873929633338880 ext(22233088->22298623) 00002000:00010000:0.0:1787119490.739110:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da7b80 00000100:00100000:0.0:1787119490.739203:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633339264 00000100:00100000:0.0:1787119490.739207:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633339264 00002000:00100000:0.0:1787119490.739228:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (4595712->4599807) req@ffff92a506edf800 x1873929633339264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.739243:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edf800 with x1873929633339264 ext(4595712->4599807) 00002000:00010000:0.0:1787119490.739248:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edf800 00000100:00100000:3.0:1787119490.742666:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9599 00000100:00100000:3.0:1787119490.742689:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633338880:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119490.743189:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.743202:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.743210:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.743217:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c64e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.743222:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.743230:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.743247:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119490.743250:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119490.743255:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.743262:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2b99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.743311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.743332:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633339392 00000100:00100000:3.0:1787119490.743340:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633339392 00002000:00010000:3.0:1787119490.743368:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (46658807->18446744073709551615) 00002000:00100000:3.0:1787119490.743372:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edf480 with x1873929633339392 ext(46658807->18446744073709551615) 00002000:00010000:3.0:1787119490.743382:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edf480. 00000100:00100000:3.0:1787119490.743409:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9600 00000100:00100000:3.0:1787119490.743418:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633339264:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.745101:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633338624:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20866us (21885us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119490.745114:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9597 00002000:00100000:2.0:1787119490.745126:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (24817664->24883199) req@ffff92a508da5880 x1873929633338624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.745160:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633338624 ext(24817664->24883199) 00002000:00010000:2.0:1787119490.745165:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5880 00000100:00100000:2.0:1787119490.745194:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9601 00000100:00100000:2.0:1787119490.745205:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633339392:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119490.745523:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 27931118 -> 46658807 00002000:00010000:2.0:1787119490.745527:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:2.0:1787119490.745530:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:2.0:1787119490.745532:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:2.0:1787119490.745535:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1165 -> 1421 00000100:00100000:2.0:1787119490.745574:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633339392:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 372us (2263us total) trans 4294969077 rc 0/0 00000100:00100000:2.0:1787119490.745581:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9601 00002000:00010000:2.0:1787119490.745584:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (46658807->18446744073709551615) 00002000:00100000:2.0:1787119490.745587:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edf480 with x1873929633339392 ext(46658807->18446744073709551615) 00002000:00010000:2.0:1787119490.745594:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edf480. 00000100:00100000:1.0:1787119490.747187:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633338752:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22488us (22747us total) trans 0 rc 1011712/1011712 00000100:00100000:1.0:1787119490.747200:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9598 00002000:00100000:1.0:1787119490.747211:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (0->1011711) req@ffff92a506edc380 x1873929633338752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 1011712/1011712 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.747222:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edc380 with x1873929633338752 ext(0->1011711) 00002000:00010000:1.0:1787119490.747227:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edc380 00000100:00100000:3.0:1787119490.747689:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633339264:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4270us (8655us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.747697:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9600 00002000:00100000:3.0:1787119490.747704:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (4595712->4599807) req@ffff92a506edf800 x1873929633339264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.747712:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edf800 with x1873929633339264 ext(4595712->4599807) 00002000:00010000:3.0:1787119490.747717:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edf800 00000100:00100000:3.0:1787119490.755234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.755284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.755313:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633339648 00000100:00100000:3.0:1787119490.755323:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633339648 00002000:00100000:3.0:1787119490.755369:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (4599808->4603903) req@ffff92a506edc700 x1873929633339648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.755380:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edc700 with x1873929633339648 ext(4599808->4603903) 00002000:00010000:3.0:1787119490.755386:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edc700 00000100:00100000:3.0:1787119490.755424:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9602 00000100:00100000:3.0:1787119490.755435:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633339648:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.756865:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633339648:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1425us (1574us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.756877:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9602 00002000:00100000:3.0:1787119490.756887:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (4599808->4603903) req@ffff92a506edc700 x1873929633339648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.756898:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edc700 with x1873929633339648 ext(4599808->4603903) 00002000:00010000:3.0:1787119490.756903:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edc700 00000100:00100000:0.0:1787119490.757198:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633339520 00000100:00100000:0.0:1787119490.757207:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633339520 00000100:00100000:0.0:1787119490.757264:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19508 00000100:00100000:0.0:1787119490.757274:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+177:32727:x1873929633339520:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119490.757291:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119490.757311:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e000/0xcaba3de8463e2ba0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b23 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.757393:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2ba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.757418:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.757430:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119490.757479:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 46658807 00000004:00200000:0.0:1787119490.757483:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119490.757499:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.757549:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e000/0xcaba3de8463e2ba0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b23 expref: 179 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.757569:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b23 expref: 178 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.757578:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119490.757581:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119490.757584:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a62045fc00, rc 0) 00000100:00100000:2.0:1787119490.759266:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633338880:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16566us (20373us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119490.759281:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9599 00002000:00100000:2.0:1787119490.759296:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (22233088->22298623) req@ffff92a508da7b80 x1873929633338880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.759308:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7b80 with x1873929633338880 ext(22233088->22298623) 00002000:00010000:2.0:1787119490.759314:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da7b80 00000100:00100000:0.0:1787119490.759956:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+178:32727:x1873929633339520:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 2679us (4727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.759966:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19508 00000100:00100000:2.0:1787119490.761042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.761145:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633339776 00000100:00100000:0.0:1787119490.761155:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633339776 00002000:00100000:0.0:1787119490.761208:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (24883200->24920063) req@ffff92a506dfdf80 x1873929633339776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.761220:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfdf80 with x1873929633339776 ext(24883200->24920063) 00002000:00010000:0.0:1787119490.761226:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfdf80 00000100:00100000:0.0:1787119490.761264:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9603 00000100:00100000:0.0:1787119490.761275:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633339776:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.768382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.768958:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633339904 00000100:00100000:1.0:1787119490.768973:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633339904 00002000:00100000:1.0:1787119490.769042:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (4575232->4640767) req@ffff92a506dff100 x1873929633339904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.769054:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dff100 with x1873929633339904 ext(4575232->4640767) 00002000:00010000:1.0:1787119490.769062:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dff100 00000100:00100000:1.0:1787119490.769209:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9604 00000100:00100000:1.0:1787119490.769221:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633339904:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.771051:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633339776:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9763us (10002us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119490.771068:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9603 00002000:00100000:3.0:1787119490.771081:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (24883200->24920063) req@ffff92a506dfdf80 x1873929633339776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.771092:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfdf80 with x1873929633339776 ext(24883200->24920063) 00002000:00010000:3.0:1787119490.771098:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfdf80 00000100:00100000:2.0:1787119490.778146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.778270:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633340160 00000100:00100000:1.0:1787119490.778282:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633340160 00000100:00100000:1.0:1787119490.778347:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19509 00000100:00100000:1.0:1787119490.778356:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+178:32724:x1873929633340160:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119490.778903:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119490.778936:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ec00/0xcaba3de8463e2ac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ad6 expref: 178 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.779146:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119490.779152:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119490.780101:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.780122:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119490.780133:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119490.780220:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976322 00000004:00010000:1.0:1787119490.780271:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f768550b reply state 000000005fe7800f transno 4294976323 ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119490.780283:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119490.781157:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633339904:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11930us (12778us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119490.781170:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9604 00002000:00100000:0.0:1787119490.781184:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (4575232->4640767) req@ffff92a506dff100 x1873929633339904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.781195:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dff100 with x1873929633339904 ext(4575232->4640767) 00002000:00010000:0.0:1787119490.781201:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dff100 00000100:00100000:1.0:1787119490.783905:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+180:32724:x1873929633340160:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2047us (2268us total) trans 4294976323 rc 0/0 00000100:00100000:1.0:1787119490.783920:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19509 00000020:00080000:1.0:1787119490.783929:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119490.786233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.787109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.788123:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633340288 00000100:00100000:3.0:1787119490.788138:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633340288 00002000:00100000:3.0:1787119490.788198:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (4595712->4599807) req@ffff92a506dfce00 x1873929633340288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.788210:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfce00 with x1873929633340288 ext(4595712->4599807) 00002000:00010000:3.0:1787119490.788216:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfce00 00000100:00100000:0.0:1787119490.788264:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633340416 00000100:00100000:0.0:1787119490.788268:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633340416 00002000:00100000:0.0:1787119490.788291:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (24838144->61856377) req@ffff92a506dfea00 x1873929633340416/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.788300:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfea00 with x1873929633340416 ext(24838144->61856377) 00002000:00010000:0.0:1787119490.788304:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfea00 00000100:00100000:0.0:1787119490.788332:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9605 00000100:00100000:0.0:1787119490.788342:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633340288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.789075:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633340288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 732us (2855us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.789084:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9605 00002000:00100000:0.0:1787119490.789092:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (4595712->4599807) req@ffff92a506dfce00 x1873929633340288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.789101:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfce00 with x1873929633340288 ext(4595712->4599807) 00002000:00010000:0.0:1787119490.789105:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfce00 00000100:00100000:0.0:1787119490.789126:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9606 00000100:00100000:0.0:1787119490.789133:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633340416:12345-192.168.201.59@tcp:4:fsx.0 00010000:00010000:3.0:1787119490.790812:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.790831:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.790838:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.790856:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a610f7d200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.790862:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.790870:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.790886:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119490.790890:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119490.790895:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.790901:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2bae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.791335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.792792:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633340544 00000100:00100000:1.0:1787119490.792807:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633340544 00002000:00010000:1.0:1787119490.792863:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (22177220->18446744073709551615) 00002000:00100000:1.0:1787119490.792869:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdc380 with x1873929633340544 ext(22177220->18446744073709551615) 00002000:00010000:1.0:1787119490.792882:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdc380. 00000100:00100000:1.0:1787119490.792915:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9607 00000100:00100000:1.0:1787119490.792925:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633340544:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119490.795131:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1008584 -> 22177220 00002000:00010000:1.0:1787119490.795142:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119488 -> 1787119489 00002000:00010000:1.0:1787119490.795144:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:1.0:1787119490.795147:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119488 -> 1787119489 00002000:00010000:1.0:1787119490.795149:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1805 -> 1037 00000100:00100000:1.0:1787119490.795233:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633340544:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 2305us (3898us total) trans 4294968841 rc 0/0 00000100:00100000:1.0:1787119490.795244:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9607 00002000:00010000:1.0:1787119490.796068:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (22177220->18446744073709551615) 00002000:00100000:1.0:1787119490.796075:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdc380 with x1873929633340544 ext(22177220->18446744073709551615) 00002000:00010000:1.0:1787119490.796085:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdc380. 00000100:00100000:0.0:1787119490.802179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.803058:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633340672 00000100:00100000:1.0:1787119490.803071:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633340672 00002000:00100000:1.0:1787119490.803124:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (4599808->4603903) req@ffff92a519cded80 x1873929633340672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.803137:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cded80 with x1873929633340672 ext(4599808->4603903) 00002000:00010000:1.0:1787119490.803143:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cded80 00000100:00100000:1.0:1787119490.803169:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9608 00000100:00100000:1.0:1787119490.803179:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633340672:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.804362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.805396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.806638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.807213:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633341056 00000100:00100000:0.0:1787119490.807225:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633341056 00000100:00100000:3.0:1787119490.807348:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633340800 00000100:00100000:3.0:1787119490.807355:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633340800 00002000:00100000:3.0:1787119490.807395:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (54251520->54317055) req@ffff92a519cdf800 x1873929633340800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.807419:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf800 with x1873929633340800 ext(54251520->54317055) 00002000:00010000:3.0:1787119490.807425:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdf800 00000100:00100000:1.0:1787119490.807622:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633340672:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4442us (5451us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119490.807631:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9608 00002000:00100000:1.0:1787119490.807638:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (4599808->4603903) req@ffff92a519cded80 x1873929633340672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119490.807883:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633340928 00000100:00100000:3.0:1787119490.807888:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633340928 00002000:00100000:3.0:1787119490.807908:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (4640768->4677631) req@ffff92a519cdf480 x1873929633340928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.807917:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf480 with x1873929633340928 ext(4640768->4677631) 00002000:00010000:3.0:1787119490.807920:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf480 00000100:00100000:0.0:1787119490.807995:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19510 00000100:00100000:0.0:1787119490.808006:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+179:32724:x1873929633341056:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119490.808027:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119490.808051:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b2a expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.808133:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2bbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.808146:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.808157:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119490.808181:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 22177220 00000004:00200000:0.0:1787119490.808185:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119490.808218:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.808243:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b2a expref: 181 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.808273:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b2a expref: 180 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.808282:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119490.808284:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119490.808288:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a62045e200, rc 0) 00002000:00100000:1.0:1787119490.808428:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cded80 with x1873929633340672 ext(4599808->4603903) 00002000:00010000:1.0:1787119490.808433:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cded80 00000100:00100000:1.0:1787119490.808482:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9609 00000100:00100000:1.0:1787119490.808493:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633340800:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.810328:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9610 00000100:00100000:3.0:1787119490.810347:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633340928:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.810838:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+180:32724:x1873929633341056:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 2831us (4202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.811035:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19510 00000100:00100000:2.0:1787119490.812640:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633340416:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 23497us (25526us total) trans 4294969078 rc 0/0 00000100:00100000:2.0:1787119490.813071:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9606 00002000:00100000:2.0:1787119490.813085:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (24838144->61856377) req@ffff92a506dfea00 x1873929633340416/t4294969078(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/448 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.813095:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfea00 with x1873929633340416 ext(24838144->61856377) 00002000:00010000:2.0:1787119490.813102:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfea00 00000100:00100000:2.0:1787119490.826587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.826884:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633341184 00000100:00100000:0.0:1787119490.826905:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633341184 00002000:00100000:0.0:1787119490.827355:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (4575232->4640767) req@ffff92a506dfd880 x1873929633341184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.827367:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd880 with x1873929633341184 ext(4575232->4640767) 00002000:00010000:0.0:1787119490.827374:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfd880 00000100:00100000:0.0:1787119490.827409:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9611 00000100:00100000:0.0:1787119490.827422:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633341184:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.828521:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633340800:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20023us (26265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119490.828533:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9609 00002000:00100000:1.0:1787119490.828553:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (54251520->54317055) req@ffff92a519cdf800 x1873929633340800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.828563:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf800 with x1873929633340800 ext(54251520->54317055) 00002000:00010000:1.0:1787119490.828569:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdf800 00000100:00100000:2.0:1787119490.832780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.833218:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633341312 00000100:00100000:1.0:1787119490.833229:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633341312 00000100:00100000:1.0:1787119490.833292:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5004 00000100:00100000:1.0:1787119490.833301:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633341312:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119490.833816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.833990:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633340928:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 23648us (28600us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119490.834000:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9610 00002000:00100000:0.0:1787119490.834009:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (4640768->4677631) req@ffff92a519cdf480 x1873929633340928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.834020:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf480 with x1873929633340928 ext(4640768->4677631) 00002000:00010000:0.0:1787119490.834025:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf480 00000100:00100000:0.0:1787119490.834050:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633341568 00000100:00100000:0.0:1787119490.834053:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633341568 00000100:00100000:0.0:1787119490.834079:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19511 00000100:00100000:0.0:1787119490.834085:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+180:32724:x1873929633341568:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119490.834121:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119490.834145:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045e200/0xcaba3de8463e2bbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b2a expref: 180 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.834168:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119490.834173:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119490.834337:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.834350:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.834360:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119490.834405:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976324 00000004:00010000:0.0:1787119490.834425:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5877170 reply state 000000004c0d2438 transno 4294976325 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.834434:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119490.834526:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+182:32724:x1873929633341568:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 441us (1682us total) trans 4294976325 rc 0/0 00000100:00100000:0.0:1787119490.834533:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19511 00000020:00080000:0.0:1787119490.834537:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119490.839131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119490.839604:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.839618:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.839625:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.839631:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045ea00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119490.839637:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.839644:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.839662:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119490.839665:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119490.839669:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119490.839675:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ea00/0xcaba3de8463e2bc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119490.839721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.839832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.840207:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633341696 00000100:00100000:0.0:1787119490.840219:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633341696 00002000:00100000:0.0:1787119490.840384:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (20979712->20983807) req@ffff92a509232680 x1873929633341696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.840396:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232680 with x1873929633341696 ext(20979712->20983807) 00002000:00010000:0.0:1787119490.840408:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509232680 00000100:00100000:0.0:1787119490.840629:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633341824 00000100:00100000:0.0:1787119490.840634:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633341824 00002000:00010000:0.0:1787119490.840803:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (45345609->18446744073709551615) 00002000:00100000:0.0:1787119490.840807:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633341824 ext(45345609->18446744073709551615) 00002000:00010000:0.0:1787119490.840816:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230000. 00000100:00100000:0.0:1787119490.840835:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633341952 00000100:00100000:0.0:1787119490.840839:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633341952 00002000:00100000:0.0:1787119490.840856:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (24838144->24842239) req@ffff92a509231500 x1873929633341952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.840865:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633341952 ext(24838144->24842239) 00002000:00010000:0.0:1787119490.840869:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231500 00000100:00100000:0.0:1787119490.840888:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9612 00000100:00100000:0.0:1787119490.840897:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633341696:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.840946:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9613 00000100:00100000:3.0:1787119490.840956:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633341824:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:0.0:1787119490.841196:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633341696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 299us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.841205:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9612 00002000:00100000:0.0:1787119490.841214:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (20979712->20983807) req@ffff92a509232680 x1873929633341696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.841221:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232680 with x1873929633341696 ext(20979712->20983807) 00002000:00010000:0.0:1787119490.841226:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509232680 00002000:00010000:3.0:1787119490.841235:0:19245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 22177220 -> 45345609 00002000:00010000:3.0:1787119490.841240:0:19245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:3.0:1787119490.841243:0:19245:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119488 00002000:00010000:3.0:1787119490.841246:0:19245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:3.0:1787119490.841249:0:19245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1037 -> 1037 00000100:00100000:3.0:1787119490.841275:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633341824:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 320us (1553us total) trans 4294968842 rc 0/0 00000100:00100000:3.0:1787119490.841282:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9613 00002000:00010000:3.0:1787119490.841286:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (45345609->18446744073709551615) 00002000:00100000:3.0:1787119490.841289:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633341824 ext(45345609->18446744073709551615) 00002000:00010000:3.0:1787119490.841294:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230000. 00000100:00100000:3.0:1787119490.841308:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9614 00000100:00100000:3.0:1787119490.841315:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633341952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.841474:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633341952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 158us (1641us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119490.841480:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9614 00002000:00100000:3.0:1787119490.841487:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (24838144->24842239) req@ffff92a509231500 x1873929633341952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.841496:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633341952 ext(24838144->24842239) 00002000:00010000:3.0:1787119490.841500:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231500 00000100:00100000:0.0:1787119490.841736:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633341184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14317us (15159us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119490.841743:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9611 00002000:00100000:0.0:1787119490.841750:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (4575232->4640767) req@ffff92a506dfd880 x1873929633341184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.841758:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd880 with x1873929633341184 ext(4575232->4640767) 00002000:00010000:0.0:1787119490.841762:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfd880 00000100:00100000:3.0:1787119490.850209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.850246:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633342080 00000100:00100000:3.0:1787119490.850256:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633342080 00002000:00100000:3.0:1787119490.850302:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (21020672->21024767) req@ffff92a509231f80 x1873929633342080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.850314:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231f80 with x1873929633342080 ext(21020672->21024767) 00002000:00010000:3.0:1787119490.850320:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509231f80 00000100:00100000:3.0:1787119490.850360:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9615 00000100:00100000:3.0:1787119490.850371:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633342080:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.850628:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633342080:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 257us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119490.850635:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9615 00002000:00100000:3.0:1787119490.850642:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (21020672->21024767) req@ffff92a509231f80 x1873929633342080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.850650:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231f80 with x1873929633342080 ext(21020672->21024767) 00002000:00010000:3.0:1787119490.850653:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509231f80 00000100:00100000:3.0:1787119490.854640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.855017:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633342336 00000100:00100000:3.0:1787119490.855029:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633342336 00002000:00100000:3.0:1787119490.855957:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (4640768->4677631) req@ffff92a509233100 x1873929633342336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.855971:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233100 with x1873929633342336 ext(4640768->4677631) 00002000:00010000:3.0:1787119490.855979:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233100 00000100:00100000:3.0:1787119490.856016:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9616 00000100:00100000:3.0:1787119490.856034:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633342336:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.856085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.856141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.856645:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633342208 00000100:00100000:3.0:1787119490.856652:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633342208 00002000:00100000:3.0:1787119490.856688:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (24842240->24846335) req@ffff92a519cdc700 x1873929633342208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.856699:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdc700 with x1873929633342208 ext(24842240->24846335) 00002000:00010000:3.0:1787119490.856703:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdc700 00000100:00100000:2.0:1787119490.857126:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9617 00000100:00100000:2.0:1787119490.857138:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633342208:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.857327:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633342208:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 192us (1243us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.857336:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9617 00002000:00100000:2.0:1787119490.857343:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (24842240->24846335) req@ffff92a519cdc700 x1873929633342208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.857351:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdc700 with x1873929633342208 ext(24842240->24846335) 00002000:00010000:2.0:1787119490.857355:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdc700 00000100:00100000:2.0:1787119490.857381:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633342464 00000100:00100000:2.0:1787119490.857385:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633342464 00000100:00100000:2.0:1787119490.857427:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19512 00000100:00100000:2.0:1787119490.857434:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+181:32724:x1873929633342464:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119490.860219:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119490.860255:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2bca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b31 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.860341:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2bd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.860355:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.860366:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119490.860392:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 45345609 00000004:00200000:2.0:1787119490.860397:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119490.860429:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.860483:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560200/0xcaba3de8463e2bca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b31 expref: 183 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.860501:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b31 expref: 182 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119490.860509:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119490.860513:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119490.860516:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63e561000, rc 0) 00000100:00100000:2.0:1787119490.860590:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+182:32724:x1873929633342464:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 3156us (4448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.860598:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19512 00000100:00100000:0.0:1787119490.868356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.871069:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633342336:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15033us (16430us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119490.871084:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9616 00002000:00100000:0.0:1787119490.871097:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (4640768->4677631) req@ffff92a509233100 x1873929633342336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.871107:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233100 with x1873929633342336 ext(4640768->4677631) 00002000:00010000:0.0:1787119490.871114:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233100 00000100:00100000:0.0:1787119490.871142:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633342592 00000100:00100000:0.0:1787119490.871149:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633342592 00002000:00100000:0.0:1787119490.871187:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (10907648->10911743) req@ffff92a511453800 x1873929633342592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.871195:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511453800 with x1873929633342592 ext(10907648->10911743) 00002000:00010000:0.0:1787119490.871199:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511453800 00000100:00100000:3.0:1787119490.873024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.874230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.874292:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633342720 00000100:00100000:2.0:1787119490.874302:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633342720 00002000:00100000:2.0:1787119490.874348:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (24227840->24240127) req@ffff92a509232300 x1873929633342720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.874359:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232300 with x1873929633342720 ext(24227840->24240127) 00002000:00010000:2.0:1787119490.874365:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509232300 00000100:00100000:2.0:1787119490.874393:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9618 00000100:00100000:2.0:1787119490.874404:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633342592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.874701:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633342592:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 298us (6468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.874709:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9618 00002000:00100000:2.0:1787119490.874716:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (10907648->10911743) req@ffff92a511453800 x1873929633342592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.874725:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511453800 with x1873929633342592 ext(10907648->10911743) 00002000:00010000:2.0:1787119490.874730:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511453800 00000100:00100000:2.0:1787119490.874746:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9619 00000100:00100000:2.0:1787119490.874752:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633342720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.874853:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633342720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 99us (1837us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119490.874859:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9619 00002000:00100000:2.0:1787119490.874865:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (24227840->24240127) req@ffff92a509232300 x1873929633342720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/12728 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.874873:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232300 with x1873929633342720 ext(24227840->24240127) 00002000:00010000:2.0:1787119490.874877:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509232300 00000100:00100000:3.0:1787119490.886630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.886903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.886992:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633342848 00000100:00100000:0.0:1787119490.887002:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633342848 00002000:00100000:0.0:1787119490.887048:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (24817664->24883199) req@ffff92a509230e00 x1873929633342848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.887059:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230e00 with x1873929633342848 ext(24817664->24883199) 00002000:00010000:0.0:1787119490.887065:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230e00 00000100:00100000:0.0:1787119490.887089:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633342976 00000100:00100000:0.0:1787119490.887093:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633342976 00002000:00100000:0.0:1787119490.887107:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (24838144->24842239) req@ffff92a6358edc50 x1873929633342976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.887114:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358edc50 with x1873929633342976 ext(24838144->24842239) 00002000:00010000:0.0:1787119490.887118:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6358edc50 00000100:00100000:0.0:1787119490.887131:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633343104 00000100:00100000:0.0:1787119490.887133:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633343104 00002000:00100000:0.0:1787119490.887147:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (10911744->10915839) req@ffff92a509232a00 x1873929633343104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.887153:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633343104 ext(10911744->10915839) 00002000:00010000:0.0:1787119490.887157:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509232a00 00000100:00100000:0.0:1787119490.887174:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9620 00000100:00100000:0.0:1787119490.887183:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633342848:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.887792:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9621 00000100:00100000:0.0:1787119490.887801:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6358edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633342976:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.887939:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6358edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633342976:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 139us (1320us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119490.887946:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9621 00002000:00100000:0.0:1787119490.887953:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (24838144->24842239) req@ffff92a6358edc50 x1873929633342976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.887961:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358edc50 with x1873929633342976 ext(24838144->24842239) 00002000:00010000:0.0:1787119490.887965:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6358edc50 00000100:00100000:0.0:1787119490.887983:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9622 00000100:00100000:0.0:1787119490.887991:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633343104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119490.888123:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633343104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 132us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.888130:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9622 00002000:00100000:0.0:1787119490.888135:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (10911744->10915839) req@ffff92a509232a00 x1873929633343104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.888143:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633343104 ext(10911744->10915839) 00002000:00010000:0.0:1787119490.888148:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509232a00 00000100:00100000:1.0:1787119490.889104:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.889142:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633343232 00000100:00100000:1.0:1787119490.889150:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633343232 00002000:00100000:1.0:1787119490.889185:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (36225024->36229119) req@ffff92a508da4380 x1873929633343232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.889194:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4380 with x1873929633343232 ext(36225024->36229119) 00002000:00010000:1.0:1787119490.889199:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da4380 00000100:00100000:1.0:1787119490.889233:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9623 00000100:00100000:1.0:1787119490.889258:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633343232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.889426:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633343232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 183us (327us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119490.889434:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9623 00002000:00100000:1.0:1787119490.889472:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (36225024->36229119) req@ffff92a508da4380 x1873929633343232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.889480:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4380 with x1873929633343232 ext(36225024->36229119) 00002000:00010000:1.0:1787119490.889484:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da4380 00000100:00100000:1.0:1787119490.902980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.903169:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633343360 00000100:00100000:2.0:1787119490.903180:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633343360 00002000:00100000:2.0:1787119490.903237:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (10907648->57078232) req@ffff92a508da6d80 x1873929633343360/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 520/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.903262:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6d80 with x1873929633343360 ext(10907648->57078232) 00002000:00010000:2.0:1787119490.903269:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da6d80 00000100:00100000:2.0:1787119490.903301:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9624 00000100:00100000:2.0:1787119490.903314:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633343360:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119490.903559:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633342848:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16374us (29331us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119490.903569:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9620 00002000:00100000:0.0:1787119490.903576:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (24817664->24883199) req@ffff92a509230e00 x1873929633342848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119490.903585:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230e00 with x1873929633342848 ext(24817664->24883199) 00002000:00010000:0.0:1787119490.903589:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230e00 00000100:00100000:2.0:1787119490.928721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.928823:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633343488 00000100:00100000:2.0:1787119490.928834:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633343488 00002000:00100000:2.0:1787119490.928883:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (24842240->24846335) req@ffff92a506dfed80 x1873929633343488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.928895:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfed80 with x1873929633343488 ext(24842240->24846335) 00002000:00010000:2.0:1787119490.928902:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfed80 00000100:00100000:2.0:1787119490.928929:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9625 00000100:00100000:2.0:1787119490.928938:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633343488:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.929169:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633343488:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 231us (457us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119490.929177:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9625 00002000:00100000:2.0:1787119490.929183:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (24842240->24846335) req@ffff92a506dfed80 x1873929633343488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.929191:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfed80 with x1873929633343488 ext(24842240->24846335) 00002000:00010000:2.0:1787119490.929195:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfed80 00000100:00100000:2.0:1787119490.929242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.937577:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633343616 00000100:00100000:1.0:1787119490.937591:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633343616 00002000:00100000:1.0:1787119490.937662:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (36229120->36233215) req@ffff92a506dff800 x1873929633343616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.937681:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dff800 with x1873929633343616 ext(36229120->36233215) 00002000:00010000:1.0:1787119490.937688:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dff800 00000100:00100000:1.0:1787119490.937733:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9626 00000100:00100000:1.0:1787119490.937745:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633343616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.938175:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633343616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 430us (8930us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119490.938183:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9626 00002000:00100000:1.0:1787119490.938190:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (36229120->36233215) req@ffff92a506dff800 x1873929633343616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/4536 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.938199:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dff800 with x1873929633343616 ext(36229120->36233215) 00002000:00010000:1.0:1787119490.938203:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dff800 00000100:00100000:1.0:1787119490.938316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.938341:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633343744 00000100:00100000:1.0:1787119490.938346:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633343744 00002000:00100000:1.0:1787119490.938363:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (24883200->24920063) req@ffff92a508da7800 x1873929633343744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.938372:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7800 with x1873929633343744 ext(24883200->24920063) 00002000:00010000:1.0:1787119490.938376:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7800 00000100:00100000:1.0:1787119490.938391:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9627 00000100:00100000:1.0:1787119490.938398:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633343744:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119490.938604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119490.941486:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633343872 00000100:00100000:3.0:1787119490.941502:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633343872 00002000:00100000:3.0:1787119490.941572:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (24817664->24883199) req@ffff92a508da7480 x1873929633343872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.941584:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7480 with x1873929633343872 ext(24817664->24883199) 00002000:00010000:3.0:1787119490.941592:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7480 00000100:00100000:3.0:1787119490.941713:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9628 00000100:00100000:3.0:1787119490.941725:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633343872:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119490.944764:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633343360:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 41441us (41784us total) trans 4294968843 rc 0/0 00000100:00100000:2.0:1787119490.944778:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9624 00002000:00100000:2.0:1787119490.944791:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (10907648->57078232) req@ffff92a508da6d80 x1873929633343360/t4294968843(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 520/456 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.944803:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6d80 with x1873929633343360 ext(10907648->57078232) 00002000:00010000:2.0:1787119490.944809:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da6d80 00000100:00100000:1.0:1787119490.957128:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633343744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18719us (18801us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119490.957142:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9627 00002000:00100000:1.0:1787119490.957156:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (24883200->24920063) req@ffff92a508da7800 x1873929633343744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.957167:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7800 with x1873929633343744 ext(24883200->24920063) 00002000:00010000:1.0:1787119490.957173:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7800 00000100:00100000:0.0:1787119490.957702:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633341312:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 124398us (124927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.957712:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5004 00000001:00080000:3.0:1787119490.958412:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969078 is committed 00000100:00100000:0.0:1787119490.958976:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119490.959021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.959117:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633344128 00000100:00100000:1.0:1787119490.959127:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633344128 00000100:00100000:1.0:1787119490.959176:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5005 00000100:00100000:1.0:1787119490.959185:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633344128:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119490.959276:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633344000 00000100:00100000:2.0:1787119490.959281:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633344000 00002000:00100000:2.0:1787119490.959304:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (36204544->36270079) req@ffff92a511453800 x1873929633344000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.959316:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511453800 with x1873929633344000 ext(36204544->36270079) 00002000:00010000:2.0:1787119490.959321:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511453800 00000100:00100000:2.0:1787119490.959338:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9629 00000100:00100000:2.0:1787119490.959345:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633344000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119490.960103:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633343872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18376us (21495us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119490.960113:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9628 00002000:00100000:3.0:1787119490.960122:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (24817664->24883199) req@ffff92a508da7480 x1873929633343872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119490.960132:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7480 with x1873929633343872 ext(24817664->24883199) 00002000:00010000:3.0:1787119490.960136:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7480 00000100:00100000:1.0:1787119490.978504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.978548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.978573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.978835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.978877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.978907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.978934:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633345024 00000100:00100000:1.0:1787119490.978942:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633345024 00002000:00100000:1.0:1787119490.978988:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (24838144->61856377) req@ffff92a508da4000 x1873929633345024/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.979000:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633345024 ext(24838144->61856377) 00002000:00010000:1.0:1787119490.979006:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4000 00000100:00100000:1.0:1787119490.979035:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9630 00000100:00100000:1.0:1787119490.979044:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633345024:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119490.979934:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633344896 00000100:00100000:2.0:1787119490.979945:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633344896 00000100:00100000:1.0:1787119490.979988:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633344768 00000100:00100000:1.0:1787119490.979994:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633344768 00000100:00100000:2.0:1787119490.980004:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 572 00000100:00100000:2.0:1787119490.980015:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633344896:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119490.980042:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 573 00000100:00100000:1.0:1787119490.980053:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633344768:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119490.980082:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633344896:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 67us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119490.980090:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 572 00000100:00100000:1.0:1787119490.980098:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633344768:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 46us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119490.980107:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 573 00000100:00080000:2.0:1787119490.980116:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787119490.980122:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119490.980830:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633344256 00000100:00100000:0.0:1787119490.980837:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633344256 00000100:00100000:0.0:1787119490.980879:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 512 00000100:00100000:0.0:1787119490.980887:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633344256:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119490.980924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633344256:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 38us (2431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.980931:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 512 00000100:00100000:0.0:1787119490.980962:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633344384 00000100:00100000:0.0:1787119490.980966:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633344384 00000100:00100000:0.0:1787119490.980995:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633344640 00000100:00100000:0.0:1787119490.980998:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633344640 00000100:00100000:0.0:1787119490.981018:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 675 00000100:00100000:0.0:1787119490.981025:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2373:x1873929633344384:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119490.981051:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2373:x1873929633344384:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 27us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119490.981057:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 675 00000100:00100000:0.0:1787119490.981068:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19513 00000100:00100000:0.0:1787119490.981074:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+182:32728:x1873929633344640:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119490.981111:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119490.981138:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2b45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b00 expref: 182 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.981156:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119490.981160:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119490.981352:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.981366:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.981376:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119490.981429:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976326 00000004:00010000:0.0:1787119490.984337:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098ce2130 reply state 000000002b575cc5 transno 4294976327 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119490.984362:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119490.984886:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+184:32728:x1873929633344640:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 3805us (6306us total) trans 4294976327 rc 0/0 00000100:00100000:0.0:1787119490.984896:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19513 00000020:00080000:0.0:1787119490.984902:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119490.986343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119490.990056:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633344000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 30698us (31072us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119490.990071:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9629 00002000:00100000:2.0:1787119490.990085:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (36204544->36270079) req@ffff92a511453800 x1873929633344000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.990095:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511453800 with x1873929633344000 ext(36204544->36270079) 00002000:00010000:2.0:1787119490.990101:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511453800 00000100:00100000:2.0:1787119490.990125:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633345152 00000100:00100000:2.0:1787119490.990132:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633345152 00002000:00100000:2.0:1787119490.990161:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (24883200->24920063) req@ffff92a506dff480 x1873929633345152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/0 e 0 to 0 dl 1787119501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119490.990170:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dff480 with x1873929633345152 ext(24883200->24920063) 00002000:00010000:2.0:1787119490.990174:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dff480 00000100:00100000:2.0:1787119490.990198:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9631 00000100:00100000:2.0:1787119490.990207:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633345152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00080000:0.0:1787119490.990339:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787119490.991004:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.991017:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.991024:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.991031:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045f800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119490.991036:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.991043:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.991060:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119490.991063:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119490.991067:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119490.991074:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f800/0xcaba3de8463e2bd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119490.993050:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633345024:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 13995us (14130us total) trans 4294969079 rc 0/0 00000100:00100000:1.0:1787119490.993066:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9630 00002000:00100000:1.0:1787119490.993080:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (24838144->61856377) req@ffff92a508da4000 x1873929633345024/t4294969079(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 504/448 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119490.993090:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633345024 ext(24838144->61856377) 00002000:00010000:1.0:1787119490.993096:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4000 00000100:00100000:3.0:1787119490.993169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119490.994104:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633345280 00000100:00100000:1.0:1787119490.994115:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633345280 00002000:00010000:1.0:1787119490.994149:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (38554013->18446744073709551615) 00002000:00100000:1.0:1787119490.994154:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633345280 ext(38554013->18446744073709551615) 00002000:00010000:1.0:1787119490.994165:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231880. 00000100:00100000:1.0:1787119490.994202:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9632 00000100:00100000:1.0:1787119490.994215:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633345280:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119490.994592:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 46658807 -> 38554013 00002000:00010000:1.0:1787119490.994597:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119490.994599:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119489 00002000:00010000:1.0:1787119490.994601:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119490.994604:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1421 -> 1805 00000100:00100000:1.0:1787119490.994670:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633345280:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 458us (1501us total) trans 4294969080 rc 0/0 00000100:00100000:1.0:1787119490.994678:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9632 00002000:00010000:1.0:1787119490.994681:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (38554013->18446744073709551615) 00002000:00100000:1.0:1787119490.994684:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633345280 ext(38554013->18446744073709551615) 00002000:00010000:1.0:1787119490.994688:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231880. 00000100:00100000:3.0:1787119491.004235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.005225:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633345408 00000100:00100000:1.0:1787119491.005237:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633345408 00002000:00100000:1.0:1787119491.005306:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (36270080->36306943) req@ffff92a509233b80 x1873929633345408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.005319:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233b80 with x1873929633345408 ext(36270080->36306943) 00002000:00010000:1.0:1787119491.005325:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509233b80 00000100:00100000:1.0:1787119491.005353:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9633 00000100:00100000:1.0:1787119491.005364:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633345408:12345-192.168.201.59@tcp:3:fsx.0 00000100:00080000:3.0:1787119491.005794:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787119491.006973:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633345152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16760us (20630us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119491.006987:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9631 00002000:00100000:2.0:1787119491.006998:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (24883200->24920063) req@ffff92a506dff480 x1873929633345152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:526/0 lens 488/440 e 0 to 0 dl 1787119501 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.007009:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dff480 with x1873929633345152 ext(24883200->24920063) 00002000:00010000:2.0:1787119491.007014:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dff480 00000100:00100000:0.0:1787119491.014101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.014146:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633345536 00000100:00100000:0.0:1787119491.014158:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633345536 00000100:00100000:0.0:1787119491.014230:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5006 00000100:00100000:0.0:1787119491.014242:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633345536:12345-192.168.201.59@tcp:16:fsx.0 00000100:00080000:0.0:1787119491.014304:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119491.014370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.015139:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633345664 00000100:00100000:1.0:1787119491.015148:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633345664 00000100:00100000:1.0:1787119491.015194:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19514 00000100:00100000:1.0:1787119491.015203:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+183:32728:x1873929633345664:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119491.015220:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119491.015241:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7cc00/0xcaba3de8463e2bdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b38 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.015319:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d000/0xcaba3de8463e2be6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.015333:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d000/0xcaba3de8463e2be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.015343:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d000/0xcaba3de8463e2be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119491.015367:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 38554013 00000004:00200000:1.0:1787119491.015371:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119491.015388:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d000/0xcaba3de8463e2be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.015424:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7cc00/0xcaba3de8463e2bdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b38 expref: 185 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.015472:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d000/0xcaba3de8463e2be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b38 expref: 184 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.015481:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119491.015484:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119491.015488:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a610f7d000, rc 0) 00000100:00100000:1.0:1787119491.015557:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+184:32728:x1873929633345664:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 353us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.015566:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19514 00000100:00080000:0.0:1787119491.015924:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119491.025755:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633345408:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20381us (21521us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119491.025770:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9633 00002000:00100000:1.0:1787119491.025785:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (36270080->36306943) req@ffff92a509233b80 x1873929633345408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.025796:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233b80 with x1873929633345408 ext(36270080->36306943) 00002000:00010000:1.0:1787119491.025803:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509233b80 00010000:00010000:0.0:1787119491.044755:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119491.045327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.045517:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633345792 00000100:00100000:3.0:1787119491.045526:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633345792 00002000:00100000:3.0:1787119491.045597:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (24838144->61856377) req@ffff92a511451c00 x1873929633345792/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.045780:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511451c00 with x1873929633345792 ext(24838144->61856377) 00002000:00010000:3.0:1787119491.045787:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511451c00 00000100:00100000:3.0:1787119491.045816:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9634 00000100:00100000:3.0:1787119491.045827:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633345792:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119491.056636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.057073:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633345920 00000100:00100000:1.0:1787119491.057080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.057086:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633345920 00002000:00100000:3.0:1787119491.057208:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (16412672->16437247) req@ffff92a508da5500 x1873929633345920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.057230:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5500 with x1873929633345920 ext(16412672->16437247) 00002000:00010000:3.0:1787119491.057373:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da5500 00000100:00100000:3.0:1787119491.057405:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9635 00000100:00100000:3.0:1787119491.057416:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633345920:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.057906:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633346176 00000100:00100000:0.0:1787119491.057919:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633346176 00000100:00100000:0.0:1787119491.057959:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19515 00000100:00100000:0.0:1787119491.057966:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+184:32728:x1873929633346176:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119491.058010:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119491.058045:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d000/0xcaba3de8463e2be6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b38 expref: 184 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.058068:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119491.058073:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119491.058510:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.058526:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.058551:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119491.058829:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976328 00000004:00010000:0.0:1787119491.058861:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099d4a05c reply state 0000000058ab3b54 transno 4294976329 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119491.058870:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119491.059132:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+186:32728:x1873929633346176:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1155us (2044us total) trans 4294976329 rc 0/0 00000100:00100000:0.0:1787119491.059141:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19515 00000020:00080000:0.0:1787119491.059147:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119491.065985:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633345792:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 20149us (20654us total) trans 4294969081 rc 0/0 00000100:00100000:1.0:1787119491.065999:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9634 00002000:00100000:1.0:1787119491.066011:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (24838144->61856377) req@ffff92a511451c00 x1873929633345792/t4294969081(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/448 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.066021:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511451c00 with x1873929633345792 ext(24838144->61856377) 00002000:00010000:1.0:1787119491.066027:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511451c00 00010000:00010000:3.0:1787119491.068507:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.068525:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.068533:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.068552:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045f000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.068558:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.068566:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.068593:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119491.068597:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119491.068601:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.068618:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045f000/0xcaba3de8463e2bed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119491.070013:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633344128:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 110818us (110982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.070030:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5005 00000100:00100000:2.0:1787119491.071204:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633345920:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13782us (14571us total) trans 0 rc 24576/24576 00000100:00100000:2.0:1787119491.071217:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9635 00002000:00100000:2.0:1787119491.071230:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (16412672->16437247) req@ffff92a508da5500 x1873929633345920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.071352:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5500 with x1873929633345920 ext(16412672->16437247) 00002000:00010000:2.0:1787119491.071360:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da5500 00000001:00080000:2.0:1787119491.071527:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968841 is committed 00000001:00080000:2.0:1787119491.071552:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968843 is committed 00000100:00100000:1.0:1787119491.072093:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.072212:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633346304 00000100:00100000:2.0:1787119491.072221:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633346304 00000100:00100000:2.0:1787119491.072403:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5007 00000100:00100000:2.0:1787119491.072414:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633346304:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119491.075623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.075845:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633346432 00000100:00100000:1.0:1787119491.075857:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633346432 00002000:00100000:1.0:1787119491.075909:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (24756224->24760319) req@ffff92a509230380 x1873929633346432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.075921:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230380 with x1873929633346432 ext(24756224->24760319) 00002000:00010000:1.0:1787119491.075927:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230380 00000100:00100000:1.0:1787119491.075961:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9636 00000100:00100000:1.0:1787119491.075970:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633346432:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.076235:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633346432:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 265us (619us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119491.076242:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9636 00002000:00100000:1.0:1787119491.076249:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (24756224->24760319) req@ffff92a509230380 x1873929633346432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.076256:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230380 with x1873929633346432 ext(24756224->24760319) 00002000:00010000:1.0:1787119491.076259:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230380 00000100:00100000:1.0:1787119491.078699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.080141:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633346560 00000100:00100000:3.0:1787119491.080158:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633346560 00002000:00010000:3.0:1787119491.080201:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (1008584->18446744073709551615) 00002000:00100000:3.0:1787119491.080208:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633346560 ext(1008584->18446744073709551615) 00002000:00010000:3.0:1787119491.080222:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5880. 00000100:00100000:3.0:1787119491.080250:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9637 00000100:00100000:3.0:1787119491.080260:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633346560:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119491.080903:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 38554013 -> 1008584 00002000:00010000:3.0:1787119491.080909:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:3.0:1787119491.080912:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119489 -> 1787119489 00002000:00010000:3.0:1787119491.080914:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:3.0:1787119491.080917:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1805 -> 1677 00000100:00100000:3.0:1787119491.081001:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633346560:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 740us (2309us total) trans 4294969082 rc 0/0 00000100:00100000:3.0:1787119491.081011:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9637 00002000:00010000:3.0:1787119491.081015:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (1008584->18446744073709551615) 00002000:00100000:3.0:1787119491.081019:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633346560 ext(1008584->18446744073709551615) 00002000:00010000:3.0:1787119491.081024:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5880. 00000100:00100000:2.0:1787119491.094183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.094246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.094363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.094417:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633346816 00000100:00100000:3.0:1787119491.094426:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633346816 00000100:00100000:3.0:1787119491.094499:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19516 00000100:00100000:3.0:1787119491.094508:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+185:32728:x1873929633346816:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119491.094531:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119491.094563:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2bf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.094879:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2bfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.094895:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.094908:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119491.094938:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 1008584 00000004:00200000:3.0:1787119491.094943:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119491.094961:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.095000:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2bf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b3f expref: 187 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.095019:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2bfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b3f expref: 186 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.095028:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119491.095031:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119491.095035:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c65000, rc 0) 00000100:00100000:3.0:1787119491.098178:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+186:32728:x1873929633346816:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 3659us (3920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.098192:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19516 00000100:00100000:0.0:1787119491.099364:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633346688 00000100:00100000:0.0:1787119491.099379:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633346688 00002000:00100000:0.0:1787119491.099427:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (24768512->24772607) req@ffff92a506dfca80 x1873929633346688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.099437:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfca80 with x1873929633346688 ext(24768512->24772607) 00002000:00010000:0.0:1787119491.099456:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfca80 00000100:00100000:0.0:1787119491.099490:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633346944 00000100:00100000:0.0:1787119491.099493:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633346944 00002000:00100000:0.0:1787119491.099511:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (15896576->15904767) req@ffff92a506dfdc00 x1873929633346944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.099520:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfdc00 with x1873929633346944 ext(15896576->15904767) 00002000:00010000:0.0:1787119491.099523:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfdc00 00000100:00100000:0.0:1787119491.099551:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9638 00000100:00100000:0.0:1787119491.099560:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633346688:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.100712:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9639 00000100:00100000:1.0:1787119491.100728:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633346944:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.100907:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633346688:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1346us (6733us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.100915:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9638 00002000:00100000:0.0:1787119491.100922:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (24768512->24772607) req@ffff92a506dfca80 x1873929633346688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.100937:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfca80 with x1873929633346688 ext(24768512->24772607) 00002000:00010000:0.0:1787119491.100942:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfca80 00000100:00100000:1.0:1787119491.105511:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633346944:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4776us (11136us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1787119491.105527:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9639 00002000:00100000:1.0:1787119491.105553:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (15896576->15904767) req@ffff92a506dfdc00 x1873929633346944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/8632 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.105564:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfdc00 with x1873929633346944 ext(15896576->15904767) 00000100:00100000:0.0:1787119491.106634:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633345536:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 92388us (92535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119491.106792:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5006 00000001:00080000:0.0:1787119491.106833:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969080 is committed 00002000:00010000:1.0:1787119491.107172:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfdc00 00000100:00100000:2.0:1787119491.109297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.109615:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633347072 00000100:00100000:2.0:1787119491.109625:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633347072 00002000:00100000:2.0:1787119491.109686:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (0->1011711) req@ffff92a506dfd180 x1873929633347072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.109698:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd180 with x1873929633347072 ext(0->1011711) 00002000:00010000:2.0:1787119491.109704:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfd180 00000100:00100000:2.0:1787119491.109867:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9640 00000100:00100000:2.0:1787119491.109877:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633347072:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.120699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.121777:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633347200 00000100:00100000:1.0:1787119491.121788:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633347200 00002000:00100000:1.0:1787119491.121838:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (31031296->31076351) req@ffff92a506dfe680 x1873929633347200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.121852:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfe680 with x1873929633347200 ext(31031296->31076351) 00002000:00010000:1.0:1787119491.121858:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfe680 00000100:00100000:1.0:1787119491.121897:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9641 00000100:00100000:1.0:1787119491.121908:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633347200:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.135519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.135587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.135798:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633347584 00000100:00100000:0.0:1787119491.135808:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633347584 00002000:00100000:0.0:1787119491.135858:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (56160256->56205311) req@ffff92a509233800 x1873929633347584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.135870:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233800 with x1873929633347584 ext(56160256->56205311) 00002000:00010000:0.0:1787119491.135875:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509233800 00000100:00100000:0.0:1787119491.135913:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9642 00000100:00100000:0.0:1787119491.135923:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633347584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.136252:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633347456 00000100:00100000:1.0:1787119491.136259:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633347456 00000100:00100000:1.0:1787119491.136301:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19517 00000100:00100000:1.0:1787119491.136309:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+186:32729:x1873929633347456:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119491.136353:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119491.136385:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561400/0xcaba3de8463e2b92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b1c expref: 186 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.136404:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119491.136409:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119491.136676:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.136689:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.136699:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119491.136746:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976330 00000004:00010000:1.0:1787119491.136771:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079312401 reply state 00000000a4e5cbc9 transno 4294976331 ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119491.136781:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119491.136860:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+188:32729:x1873929633347456:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 551us (1349us total) trans 4294976331 rc 0/0 00000100:00100000:1.0:1787119491.136868:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19517 00000020:00080000:1.0:1787119491.136873:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119491.140919:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633347072:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 31034us (31623us total) trans 0 rc 1011712/1011712 00000100:00100000:2.0:1787119491.140934:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9640 00002000:00100000:2.0:1787119491.140948:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (0->1011711) req@ffff92a506dfd180 x1873929633347072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 1011712/1011712 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.140959:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd180 with x1873929633347072 ext(0->1011711) 00002000:00010000:2.0:1787119491.140966:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfd180 00000100:00100000:0.0:1787119491.161466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119491.161663:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119491.161672:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633347200:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 39762us (40980us total) trans 0 rc 45056/45056 00010000:00010000:3.0:1787119491.161678:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119491.161686:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9641 00010000:00010000:3.0:1787119491.161690:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.161698:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a610f7d200 already unused, calling callback (ffffffffc20804f0) 00002000:00100000:1.0:1787119491.161701:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (31031296->31076351) req@ffff92a506dfe680 x1873929633347200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787119491.161705:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1787119491.161722:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfe680 with x1873929633347200 ext(31031296->31076351) 00002000:00010000:1.0:1787119491.161727:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfe680 00010000:00010000:3.0:1787119491.161735:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119491.161753:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633347712 00010000:00010000:3.0:1787119491.161754:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119491.161759:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787119491.161762:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633347712 00010000:00010000:3.0:1787119491.161764:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.161772:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d200/0xcaba3de8463e2c02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119491.161793:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (38554013->18446744073709551615) 00002000:00100000:1.0:1787119491.161798:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511451180 with x1873929633347712 ext(38554013->18446744073709551615) 00002000:00010000:1.0:1787119491.161809:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511451180. 00000100:00100000:1.0:1787119491.162166:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9643 00000100:00100000:1.0:1787119491.162175:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633347712:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119491.162531:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 46658807 -> 38554013 00002000:00010000:1.0:1787119491.162547:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.162549:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119488 -> 1787119489 00002000:00010000:1.0:1787119491.162551:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.162554:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1421 -> 1805 00000100:00100000:2.0:1787119491.162747:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633347584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 26824us (27158us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1787119491.162755:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9642 00002000:00100000:2.0:1787119491.162762:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (56160256->56205311) req@ffff92a509233800 x1873929633347584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.162771:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233800 with x1873929633347584 ext(56160256->56205311) 00002000:00010000:2.0:1787119491.162776:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509233800 00000100:00100000:1.0:1787119491.164366:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633347712:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 2183us (2925us total) trans 4294969083 rc 0/0 00000100:00100000:1.0:1787119491.164379:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9643 00002000:00010000:1.0:1787119491.164384:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (38554013->18446744073709551615) 00002000:00100000:1.0:1787119491.164388:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511451180 with x1873929633347712 ext(38554013->18446744073709551615) 00002000:00010000:1.0:1787119491.164399:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511451180. 00000100:00100000:0.0:1787119491.182697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.182813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.183892:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633347968 00000100:00100000:2.0:1787119491.183909:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633347968 00000100:00100000:2.0:1787119491.183994:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19518 00000100:00100000:2.0:1787119491.184005:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+187:32729:x1873929633347968:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119491.184035:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119491.184064:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b46 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.184160:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2c10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.184176:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.184188:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119491.184218:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 38554013 00000004:00200000:2.0:1787119491.184222:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119491.184243:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.184271:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b46 expref: 189 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.184289:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2c10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b46 expref: 188 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.184297:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119491.184301:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119491.184304:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1600, rc 0) 00000100:00100000:2.0:1787119491.184381:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+188:32729:x1873929633347968:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 377us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119491.184389:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19518 00000100:00100000:3.0:1787119491.186023:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633347840 00000100:00100000:3.0:1787119491.186039:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633347840 00002000:00100000:3.0:1787119491.186094:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (56528896->56532991) req@ffff92a511452680 x1873929633347840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.186106:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511452680 with x1873929633347840 ext(56528896->56532991) 00002000:00010000:3.0:1787119491.186111:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511452680 00000100:00100000:3.0:1787119491.186144:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9644 00000100:00100000:3.0:1787119491.186154:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633347840:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.186391:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633347840:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 238us (3703us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.186629:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9644 00002000:00100000:3.0:1787119491.186637:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (56528896->56532991) req@ffff92a511452680 x1873929633347840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.187974:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511452680 with x1873929633347840 ext(56528896->56532991) 00002000:00010000:3.0:1787119491.187982:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511452680 00000001:00080000:1.0:1787119491.189389:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969081 is committed 00000100:00100000:2.0:1787119491.190048:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633346304:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 117631us (117953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119491.190060:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5007 00000001:00080000:0.0:1787119491.191060:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969082 is committed 00000100:00100000:2.0:1787119491.193632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.193845:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633348096 00000100:00100000:1.0:1787119491.193855:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633348096 00002000:00100000:1.0:1787119491.193908:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (56545280->56549375) req@ffff92a506dfc000 x1873929633348096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.193920:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfc000 with x1873929633348096 ext(56545280->56549375) 00002000:00010000:1.0:1787119491.193926:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfc000 00000100:00100000:1.0:1787119491.193968:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9645 00000100:00100000:1.0:1787119491.193978:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633348096:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.194414:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633348096:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 435us (788us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119491.194422:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9645 00002000:00100000:1.0:1787119491.194428:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (56545280->56549375) req@ffff92a506dfc000 x1873929633348096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.194484:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfc000 with x1873929633348096 ext(56545280->56549375) 00002000:00010000:1.0:1787119491.194490:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfc000 00000100:00100000:1.0:1787119491.200975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.201077:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633348352 00000100:00100000:3.0:1787119491.201089:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633348352 00000100:00100000:3.0:1787119491.201194:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19519 00000100:00100000:3.0:1787119491.201205:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+188:32727:x1873929633348352:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119491.201260:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119491.201290:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045fc00/0xcaba3de8463e2ba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b23 expref: 188 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.201309:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119491.201314:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119491.202983:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.203009:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.203022:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119491.203127:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976332 00000004:00010000:3.0:1787119491.203161:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce899287 reply state 000000007ef1ecc8 transno 4294976333 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119491.203172:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119491.203314:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+190:32727:x1873929633348352:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2106us (2346us total) trans 4294976333 rc 0/0 00000100:00100000:3.0:1787119491.203324:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19519 00000020:00080000:3.0:1787119491.203331:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119491.213029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.213088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.216679:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633348480 00000100:00100000:1.0:1787119491.216698:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633348480 00002000:00100000:1.0:1787119491.216786:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (21684224->21688319) req@ffff92a511451500 x1873929633348480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.216797:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511451500 with x1873929633348480 ext(21684224->21688319) 00002000:00010000:1.0:1787119491.216803:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511451500 00000100:00100000:1.0:1787119491.216842:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633348608 00000100:00100000:1.0:1787119491.216846:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633348608 00002000:00010000:1.0:1787119491.216861:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (38554013->18446744073709551615) 00002000:00100000:1.0:1787119491.216864:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511451f80 with x1873929633348608 ext(38554013->18446744073709551615) 00002000:00010000:1.0:1787119491.216874:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511451f80. 00000100:00100000:1.0:1787119491.216899:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9646 00000100:00100000:1.0:1787119491.216907:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633348480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.217226:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633348480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 318us (4206us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119491.217235:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9646 00002000:00100000:1.0:1787119491.217243:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (21684224->21688319) req@ffff92a511451500 x1873929633348480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.217251:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511451500 with x1873929633348480 ext(21684224->21688319) 00002000:00010000:1.0:1787119491.217255:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511451500 00000100:00100000:1.0:1787119491.217277:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9647 00000100:00100000:1.0:1787119491.217285:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633348608:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119491.217960:0:19246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 46658807 -> 38554013 00002000:00010000:1.0:1787119491.217966:0:19246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.217969:0:19246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119488 -> 1787119489 00002000:00010000:1.0:1787119491.217972:0:19246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.217974:0:19246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1421 -> 1805 00000100:00100000:1.0:1787119491.218012:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633348608:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 727us (4923us total) trans 4294969084 rc 0/0 00000100:00100000:1.0:1787119491.218020:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9647 00002000:00010000:1.0:1787119491.218023:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (38554013->18446744073709551615) 00002000:00100000:1.0:1787119491.218026:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511451f80 with x1873929633348608 ext(38554013->18446744073709551615) 00002000:00010000:1.0:1787119491.218031:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511451f80. 00010000:00010000:3.0:1787119491.220104:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.220123:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.220132:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.220140:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c65a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.220145:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.220153:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.220175:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119491.220179:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119491.220183:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.220190:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119491.220509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.220935:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633348736 00000100:00100000:3.0:1787119491.220949:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633348736 00002000:00100000:3.0:1787119491.221005:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (54800384->54861823) req@ffff92a511453100 x1873929633348736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.221017:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511453100 with x1873929633348736 ext(54800384->54861823) 00002000:00010000:3.0:1787119491.221023:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511453100 00000100:00100000:3.0:1787119491.221101:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9648 00000100:00100000:3.0:1787119491.221115:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633348736:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.227497:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633348736:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6374us (6983us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1787119491.227510:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9648 00002000:00100000:2.0:1787119491.227523:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (54800384->54861823) req@ffff92a511453100 x1873929633348736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.227548:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511453100 with x1873929633348736 ext(54800384->54861823) 00002000:00010000:2.0:1787119491.227554:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511453100 00000100:00100000:3.0:1787119491.232915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.233084:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633348864 00000100:00100000:1.0:1787119491.233096:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633348864 00000100:00100000:1.0:1787119491.233161:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19520 00000100:00100000:1.0:1787119491.233172:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+189:32727:x1873929633348864:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119491.233194:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119491.233216:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d000/0xcaba3de8463e2c1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b4d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.233299:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7da00/0xcaba3de8463e2c25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.233314:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7da00/0xcaba3de8463e2c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.233325:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7da00/0xcaba3de8463e2c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119491.233354:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 38554013 00000004:00200000:1.0:1787119491.233358:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119491.233378:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7da00/0xcaba3de8463e2c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.233408:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7d000/0xcaba3de8463e2c1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b4d expref: 191 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.233429:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7da00/0xcaba3de8463e2c25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b4d expref: 190 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.233478:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119491.233482:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119491.233485:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a610f7da00, rc 0) 00000100:00100000:1.0:1787119491.233556:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+190:32727:x1873929633348864:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 385us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.233564:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19520 00000100:00100000:0.0:1787119491.234973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.235285:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633348992 00000100:00100000:3.0:1787119491.235295:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633348992 00002000:00100000:3.0:1787119491.235339:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (21688320->21692415) req@ffff92a511452300 x1873929633348992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.235351:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511452300 with x1873929633348992 ext(21688320->21692415) 00002000:00010000:3.0:1787119491.235356:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511452300 00000100:00100000:3.0:1787119491.235390:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9649 00000100:00100000:3.0:1787119491.235410:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633348992:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.236051:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633348992:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 649us (1082us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.236063:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9649 00002000:00100000:0.0:1787119491.236071:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (21688320->21692415) req@ffff92a511452300 x1873929633348992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.236079:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511452300 with x1873929633348992 ext(21688320->21692415) 00002000:00010000:0.0:1787119491.236083:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511452300 00000100:00100000:3.0:1787119491.239227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.239778:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633349120 00000100:00100000:1.0:1787119491.239790:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633349120 00002000:00100000:1.0:1787119491.239840:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (22253568->22257663) req@ffff92a509230a80 x1873929633349120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.239851:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633349120 ext(22253568->22257663) 00002000:00010000:1.0:1787119491.239857:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230a80 00000100:00100000:1.0:1787119491.239883:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9650 00000100:00100000:1.0:1787119491.239893:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633349120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.240132:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633349120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 240us (914us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119491.240139:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9650 00002000:00100000:1.0:1787119491.240147:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (22253568->22257663) req@ffff92a509230a80 x1873929633349120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.240161:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633349120 ext(22253568->22257663) 00002000:00010000:1.0:1787119491.240165:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230a80 00000100:00100000:3.0:1787119491.254781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.255067:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633349376 00000100:00100000:2.0:1787119491.255077:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633349376 00000100:00100000:2.0:1787119491.255142:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19521 00000100:00100000:2.0:1787119491.255153:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+190:32729:x1873929633349376:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119491.255208:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119491.255237:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2c10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b46 expref: 190 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.255257:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119491.255262:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119491.256087:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.256104:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.256115:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119491.256169:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976334 00000004:00010000:2.0:1787119491.256196:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a45f1af reply state 00000000d6efa036 transno 4294976335 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119491.256205:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119491.256356:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+192:32729:x1873929633349376:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1203us (1583us total) trans 4294976335 rc 0/0 00000100:00100000:2.0:1787119491.256365:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19521 00000020:00080000:2.0:1787119491.256371:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119491.265096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.266241:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.266622:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633349632 00000100:00100000:2.0:1787119491.266632:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633349632 00000100:00100000:0.0:1787119491.268377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.269050:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633349504 00000100:00100000:3.0:1787119491.269062:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633349504 00002000:00100000:3.0:1787119491.269113:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (22257664->22261759) req@ffff92a509231c00 x1873929633349504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.269132:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633349504 ext(22257664->22261759) 00002000:00010000:3.0:1787119491.269139:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509231c00 00000100:00100000:3.0:1787119491.269166:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633349760 00000100:00100000:3.0:1787119491.269170:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633349760 00002000:00100000:3.0:1787119491.269187:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (21663744->21729279) req@ffff92a511450e00 x1873929633349760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.269195:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511450e00 with x1873929633349760 ext(21663744->21729279) 00002000:00010000:3.0:1787119491.269199:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511450e00 00000100:00100000:3.0:1787119491.269218:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9651 00000100:00100000:3.0:1787119491.269227:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633349504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.269469:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9652 00000100:00100000:1.0:1787119491.269480:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633349760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.275332:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633349504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5495us (8487us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119491.275347:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9651 00002000:00100000:2.0:1787119491.275359:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (22257664->22261759) req@ffff92a509231c00 x1873929633349504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.275369:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633349504 ext(22257664->22261759) 00002000:00010000:2.0:1787119491.275375:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509231c00 00000100:00100000:0.0:1787119491.275863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.275921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.275947:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633350144 00000100:00100000:0.0:1787119491.275955:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633350144 00000100:00100000:0.0:1787119491.276015:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19522 00000100:00100000:0.0:1787119491.276025:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+192:32727:x1873929633350144:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119491.276082:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119491.276109:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7da00/0xcaba3de8463e2c25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b4d expref: 192 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.276128:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119491.276133:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119491.276332:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.276347:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.276357:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119491.276434:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976336 00000100:00100000:2.0:1787119491.276881:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633349888 00000100:00100000:2.0:1787119491.276888:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633349888 00002000:00010000:2.0:1787119491.276913:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (1008584->18446744073709551615) 00002000:00100000:2.0:1787119491.276917:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511452a00 with x1873929633349888 ext(1008584->18446744073709551615) 00002000:00010000:2.0:1787119491.276927:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511452a00. 00000100:00100000:2.0:1787119491.276950:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9653 00000100:00100000:2.0:1787119491.276958:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633349888:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119491.277234:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 38554013 -> 1008584 00002000:00010000:2.0:1787119491.277238:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:2.0:1787119491.277240:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119489 -> 1787119489 00002000:00010000:2.0:1787119491.277242:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:2.0:1787119491.277244:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1805 -> 1805 00000100:00100000:2.0:1787119491.277304:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633349888:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 346us (1442us total) trans 4294969085 rc 0/0 00000100:00100000:2.0:1787119491.277312:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9653 00002000:00010000:2.0:1787119491.277316:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (1008584->18446744073709551615) 00002000:00100000:2.0:1787119491.277318:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511452a00 with x1873929633349888 ext(1008584->18446744073709551615) 00002000:00010000:2.0:1787119491.277323:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511452a00. 00000004:00010000:0.0:1787119491.277930:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9bad56f reply state 0000000037c5e18f transno 4294976337 ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119491.277939:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119491.278011:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+194:32727:x1873929633350144:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1989us (2091us total) trans 4294976337 rc 0/0 00000100:00100000:0.0:1787119491.278016:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19522 00000020:00080000:0.0:1787119491.278019:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00100000:0.0:1787119491.278050:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (54251520->54317055) req@ffff92a63403a680 x1873929633349632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.278057:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a680 with x1873929633349632 ext(54251520->54317055) 00002000:00010000:0.0:1787119491.278060:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403a680 00000100:00100000:0.0:1787119491.278078:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9654 00000100:00100000:0.0:1787119491.278084:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633349632:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119491.281338:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.281352:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.281357:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.281361:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.281365:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.281369:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.281382:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119491.281384:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119491.281387:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.281391:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2c2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119491.281685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.281743:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633350272 00000100:00100000:1.0:1787119491.281752:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633350272 00002000:00100000:1.0:1787119491.281794:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (22233088->22298623) req@ffff92a506dfd500 x1873929633350272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.281804:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd500 with x1873929633350272 ext(22233088->22298623) 00002000:00010000:1.0:1787119491.281809:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfd500 00000100:00100000:1.0:1787119491.281839:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9655 00000100:00100000:1.0:1787119491.281849:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633350272:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119491.284824:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.284840:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.284847:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.284853:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a62045ee00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.284857:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.284864:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119491.284875:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633349760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15393us (16504us total) trans 0 rc 57344/57344 00010000:00010000:3.0:1787119491.284879:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119491.284882:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787119491.284884:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9652 00010000:00010000:3.0:1787119491.284885:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.284891:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a62045ee00/0xcaba3de8463e2c33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1787119491.284896:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (21663744->21729279) req@ffff92a511450e00 x1873929633349760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.284905:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511450e00 with x1873929633349760 ext(21663744->21729279) 00002000:00010000:1.0:1787119491.284909:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511450e00 00000100:00100000:1.0:1787119491.285042:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633349632:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6957us (19958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.285054:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9654 00002000:00100000:1.0:1787119491.285060:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (54251520->54317055) req@ffff92a63403a680 x1873929633349632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.285068:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a680 with x1873929633349632 ext(54251520->54317055) 00002000:00010000:1.0:1787119491.285071:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403a680 00000100:00100000:3.0:1787119491.288232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.288286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.288542:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633350272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6680us (6845us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119491.288553:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9655 00002000:00100000:1.0:1787119491.288567:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (22233088->22298623) req@ffff92a506dfd500 x1873929633350272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.288576:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd500 with x1873929633350272 ext(22233088->22298623) 00002000:00010000:1.0:1787119491.288582:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfd500 00000100:00100000:1.0:1787119491.288619:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633350400 00000100:00100000:1.0:1787119491.288625:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633350400 00002000:00010000:1.0:1787119491.288654:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (1008584->18446744073709551615) 00002000:00100000:1.0:1787119491.288658:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633350400 ext(1008584->18446744073709551615) 00002000:00010000:1.0:1787119491.288668:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231180. 00000100:00100000:1.0:1787119491.288688:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9656 00000100:00100000:1.0:1787119491.288696:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633350400:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119491.289013:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 38554013 -> 1008584 00002000:00010000:1.0:1787119491.289017:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.289019:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.289021:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.289024:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1805 -> 1805 00000100:00100000:1.0:1787119491.289051:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633350400:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 355us (828us total) trans 4294969086 rc 0/0 00000100:00100000:1.0:1787119491.289058:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9656 00002000:00010000:1.0:1787119491.289061:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (1008584->18446744073709551615) 00002000:00100000:1.0:1787119491.289064:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633350400 ext(1008584->18446744073709551615) 00002000:00010000:1.0:1787119491.289069:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231180. 00000100:00100000:2.0:1787119491.289408:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633350528 00000100:00100000:2.0:1787119491.289414:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633350528 00000100:00100000:2.0:1787119491.289485:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19523 00000100:00100000:2.0:1787119491.289494:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+192:32729:x1873929633350528:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119491.289511:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119491.289530:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2c3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.289772:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2c41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.289787:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.289797:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119491.289824:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 1008584 00000004:00200000:2.0:1787119491.289828:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119491.289845:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.289872:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2c3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b54 expref: 194 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.289890:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b54 expref: 193 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.289898:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119491.289901:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119491.289905:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00000100:00100000:2.0:1787119491.289990:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+193:32729:x1873929633350528:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 496us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119491.289997:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19523 00000100:00100000:3.0:1787119491.292972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.293069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.293191:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633350656 00000100:00100000:1.0:1787119491.293202:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633350656 00002000:00100000:1.0:1787119491.293263:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (20979712->20983807) req@ffff92a509230000 x1873929633350656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.293274:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633350656 ext(20979712->20983807) 00002000:00010000:1.0:1787119491.293279:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230000 00000100:00100000:1.0:1787119491.293307:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633350784 00000100:00100000:1.0:1787119491.293311:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633350784 00002000:00100000:1.0:1787119491.293327:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (21729280->21766143) req@ffff92a509231500 x1873929633350784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.293335:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633350784 ext(21729280->21766143) 00002000:00010000:1.0:1787119491.293338:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509231500 00000100:00100000:1.0:1787119491.293417:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9657 00000100:00100000:1.0:1787119491.293428:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633350656:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.293721:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633350656:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 293us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.293728:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9657 00002000:00100000:1.0:1787119491.293735:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (20979712->20983807) req@ffff92a509230000 x1873929633350656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.293743:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633350656 ext(20979712->20983807) 00002000:00010000:1.0:1787119491.293747:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230000 00000100:00100000:1.0:1787119491.293763:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9658 00000100:00100000:1.0:1787119491.293771:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633350784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.298107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.298824:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633351040 00000100:00100000:1.0:1787119491.298836:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633351040 00000100:00100000:1.0:1787119491.298901:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19524 00000100:00100000:1.0:1787119491.298911:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+193:32720:x1873929633351040:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119491.298968:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119491.298996:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e560600/0xcaba3de8463e2b84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b15 expref: 193 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.299014:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119491.299020:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119491.299222:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.299236:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.299247:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119491.299303:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976338 00000004:00010000:1.0:1787119491.299331:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d58a3d0 reply state 00000000215cbaf9 transno 4294976339 ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119491.299348:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119491.299435:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+195:32720:x1873929633351040:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 525us (1337us total) trans 4294976339 rc 0/0 00000100:00100000:1.0:1787119491.299466:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19524 00000020:00080000:1.0:1787119491.299471:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119491.300020:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633350784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6248us (6949us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119491.300030:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9658 00002000:00100000:2.0:1787119491.300040:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (21729280->21766143) req@ffff92a509231500 x1873929633350784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.300056:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633350784 ext(21729280->21766143) 00002000:00010000:2.0:1787119491.300060:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509231500 00000100:00100000:0.0:1787119491.300429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.300541:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633351168 00000100:00100000:2.0:1787119491.300548:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633351168 00000100:00100000:2.0:1787119491.300581:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19525 00000100:00100000:2.0:1787119491.300589:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+195:32727:x1873929633351168:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119491.300603:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119491.300688:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2c4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b5b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.300757:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.300768:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.300778:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119491.300799:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 1008584 00000004:00200000:2.0:1787119491.300804:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119491.300820:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.300843:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2c4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b5b expref: 197 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.300858:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b5b expref: 196 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.300868:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119491.300871:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119491.300874:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:2.0:1787119491.300914:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+196:32727:x1873929633351168:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 324us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119491.300920:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19525 00000100:00100000:0.0:1787119491.305733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.307069:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633351296 00000100:00100000:2.0:1787119491.307084:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633351296 00002000:00100000:2.0:1787119491.307149:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (21020672->21024767) req@ffff92a511450380 x1873929633351296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.307160:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511450380 with x1873929633351296 ext(21020672->21024767) 00002000:00010000:2.0:1787119491.307166:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511450380 00000100:00100000:2.0:1787119491.307195:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9659 00000100:00100000:2.0:1787119491.307204:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633351296:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.307484:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633351296:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 279us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119491.307492:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9659 00002000:00100000:2.0:1787119491.307499:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (21020672->21024767) req@ffff92a511450380 x1873929633351296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.307507:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511450380 with x1873929633351296 ext(21020672->21024767) 00002000:00010000:2.0:1787119491.307510:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511450380 00000100:00100000:3.0:1787119491.311365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.313978:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633351424 00000100:00100000:0.0:1787119491.313995:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633351424 00002000:00100000:0.0:1787119491.314053:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (0->1011711) req@ffff92a509233100 x1873929633351424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.314065:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233100 with x1873929633351424 ext(0->1011711) 00002000:00010000:0.0:1787119491.314071:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233100 00000100:00100000:0.0:1787119491.314114:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9660 00000100:00100000:0.0:1787119491.314124:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633351424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.315918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.316099:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633351552 00000100:00100000:1.0:1787119491.316108:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633351552 00002000:00010000:1.0:1787119491.316144:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (22177220->18446744073709551615) 00002000:00100000:1.0:1787119491.316149:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfdf80 with x1873929633351552 ext(22177220->18446744073709551615) 00002000:00010000:1.0:1787119491.316161:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfdf80. 00000100:00100000:1.0:1787119491.316185:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9661 00000100:00100000:1.0:1787119491.316195:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633351552:12345-192.168.201.59@tcp:10:fsx.0 00010000:00010000:3.0:1787119491.316552:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.316564:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.316571:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.316578:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a610f7c000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.316582:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.316589:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119491.316597:0:19245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 1008584 -> 22177220 00002000:00010000:1.0:1787119491.316600:0:19245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.316602:0:19245:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119488 -> 1787119489 00010000:00010000:3.0:1787119491.316603:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119491.316606:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119491.316610:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.316617:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a610f7c000/0xcaba3de8463e2c48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119491.316814:0:19245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.316817:0:19245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1805 -> 1037 00000100:00100000:1.0:1787119491.316886:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633351552:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 691us (975us total) trans 4294968844 rc 0/0 00000100:00100000:1.0:1787119491.316894:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9661 00002000:00010000:1.0:1787119491.316898:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (22177220->18446744073709551615) 00002000:00100000:1.0:1787119491.316900:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfdf80 with x1873929633351552 ext(22177220->18446744073709551615) 00002000:00010000:1.0:1787119491.316905:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dfdf80. 00000100:00100000:2.0:1787119491.327930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.327973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.328033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.328054:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633351680 00000100:00100000:0.0:1787119491.328065:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633351680 00002000:00100000:0.0:1787119491.328115:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (16404480->16408575) req@ffff92a506dff100 x1873929633351680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.328126:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dff100 with x1873929633351680 ext(16404480->16408575) 00002000:00010000:0.0:1787119491.328132:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dff100 00000100:00100000:0.0:1787119491.328161:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633351808 00000100:00100000:0.0:1787119491.328164:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633351808 00002000:00100000:0.0:1787119491.328181:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (10907648->10911743) req@ffff92a506dfce00 x1873929633351808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.328189:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfce00 with x1873929633351808 ext(10907648->10911743) 00002000:00010000:0.0:1787119491.328193:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfce00 00000100:00100000:0.0:1787119491.328213:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9662 00000100:00100000:0.0:1787119491.328223:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633351680:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.328267:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9663 00000100:00100000:1.0:1787119491.328276:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633351808:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.328495:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633351680:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 273us (575us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.328503:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9662 00002000:00100000:0.0:1787119491.328510:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (16404480->16408575) req@ffff92a506dff100 x1873929633351680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.328518:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dff100 with x1873929633351680 ext(16404480->16408575) 00002000:00010000:0.0:1787119491.328521:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506dff100 00000100:00100000:3.0:1787119491.328638:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633351936 00000100:00100000:3.0:1787119491.328644:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633351936 00000100:00100000:3.0:1787119491.328684:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19526 00000100:00100000:3.0:1787119491.328691:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+195:32720:x1873929633351936:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119491.328706:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119491.328726:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b62 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.328808:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2c64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.328822:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.328833:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119491.328859:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 22177220 00000004:00200000:3.0:1787119491.328862:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119491.328877:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.328904:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b62 expref: 197 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.328923:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b62 expref: 196 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.328931:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119491.328934:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119491.328936:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c64e00, rc 0) 00000100:00100000:1.0:1787119491.332905:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633351808:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4617us (4918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.332921:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9663 00002000:00100000:1.0:1787119491.332935:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (10907648->10911743) req@ffff92a506dfce00 x1873929633351808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.332945:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfce00 with x1873929633351808 ext(10907648->10911743) 00002000:00010000:1.0:1787119491.332951:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfce00 00000100:00100000:3.0:1787119491.334219:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+196:32720:x1873929633351936:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 5519us (6176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.334235:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19526 00000100:00100000:3.0:1787119491.336829:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633351424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22699us (25466us total) trans 0 rc 1011712/1011712 00000100:00100000:3.0:1787119491.336842:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9660 00002000:00100000:3.0:1787119491.336855:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (0->1011711) req@ffff92a509233100 x1873929633351424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 1011712/1011712 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.336867:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233100 with x1873929633351424 ext(0->1011711) 00002000:00010000:3.0:1787119491.336874:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233100 00000100:00100000:2.0:1787119491.345386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.345643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.345826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.345847:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633352064 00000100:00100000:0.0:1787119491.345857:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633352064 00002000:00100000:0.0:1787119491.345907:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (0->1011711) req@ffff92a506dfd880 x1873929633352064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.345931:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd880 with x1873929633352064 ext(0->1011711) 00002000:00010000:0.0:1787119491.345937:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfd880 00000100:00100000:0.0:1787119491.345968:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633352192 00000100:00100000:0.0:1787119491.345972:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633352192 00002000:00100000:0.0:1787119491.345990:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (16408576->16412671) req@ffff92a6068bd500 x1873929633352192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.345998:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd500 with x1873929633352192 ext(16408576->16412671) 00002000:00010000:0.0:1787119491.346002:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd500 00000100:00100000:0.0:1787119491.346022:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9664 00000100:00100000:0.0:1787119491.346031:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633352064:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.346820:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9665 00000100:00100000:0.0:1787119491.346830:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633352192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.346981:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633352192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 152us (1338us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.346989:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9665 00002000:00100000:0.0:1787119491.346996:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (16408576->16412671) req@ffff92a6068bd500 x1873929633352192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.347006:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd500 with x1873929633352192 ext(16408576->16412671) 00002000:00010000:0.0:1787119491.347010:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd500 00000100:00100000:1.0:1787119491.350462:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633352320 00000100:00100000:1.0:1787119491.350479:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633352320 00002000:00100000:1.0:1787119491.350550:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (10911744->10915839) req@ffff92a6068bf480 x1873929633352320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.350561:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633352320 ext(10911744->10915839) 00002000:00010000:1.0:1787119491.350569:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf480 00000100:00100000:1.0:1787119491.350605:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9666 00000100:00100000:1.0:1787119491.350616:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633352320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.351095:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633352320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 479us (5268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.351103:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9666 00002000:00100000:1.0:1787119491.351110:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (10911744->10915839) req@ffff92a6068bf480 x1873929633352320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.351118:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633352320 ext(10911744->10915839) 00002000:00010000:1.0:1787119491.351121:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf480 00000100:00100000:1.0:1787119491.358237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.358330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.358473:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633352448 00000100:00100000:0.0:1787119491.358485:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633352448 00002000:00100000:0.0:1787119491.358542:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (10907648->57078232) req@ffff92a63403ad80 x1873929633352448/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.358560:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403ad80 with x1873929633352448 ext(10907648->57078232) 00002000:00010000:0.0:1787119491.358566:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403ad80 00000100:00100000:0.0:1787119491.358601:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9667 00000100:00100000:0.0:1787119491.358611:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633352448:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119491.364693:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633352704 00000100:00100000:3.0:1787119491.364710:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633352704 00000100:00100000:3.0:1787119491.364792:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19527 00000100:00100000:3.0:1787119491.364803:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+196:32720:x1873929633352704:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119491.364864:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119491.364895:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2c64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b62 expref: 196 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.364917:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119491.364923:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119491.365133:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.365148:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.365157:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119491.365210:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976340 00000004:00010000:3.0:1787119491.365236:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0f59426 reply state 00000000c5a38498 transno 4294976341 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119491.365245:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119491.371660:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+198:32720:x1873929633352704:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 6846us (13316us total) trans 4294976341 rc 0/0 00000100:00100000:3.0:1787119491.371673:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19527 00000020:00080000:3.0:1787119491.371681:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787119491.381997:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.382016:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.382024:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.382031:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c64c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.382036:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.382045:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.382065:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119491.382069:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119491.382074:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.382086:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119491.382954:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633352064:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 36916us (37569us total) trans 0 rc 1011712/1011712 00000100:00100000:3.0:1787119491.382966:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9664 00002000:00100000:3.0:1787119491.382982:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (0->1011711) req@ffff92a506dfd880 x1873929633352064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 1011712/1011712 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.382993:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dfd880 with x1873929633352064 ext(0->1011711) 00002000:00010000:3.0:1787119491.382998:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dfd880 00000100:00100000:3.0:1787119491.383062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.383543:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633352832 00000100:00100000:2.0:1787119491.383552:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633352832 00002000:00100000:2.0:1787119491.383595:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (54251520->54317055) req@ffff92a509232300 x1873929633352832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.383604:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232300 with x1873929633352832 ext(54251520->54317055) 00002000:00010000:2.0:1787119491.383607:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509232300 00000100:00100000:2.0:1787119491.383637:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9668 00000100:00100000:2.0:1787119491.383646:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633352832:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.385144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.385332:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633352960 00000100:00100000:1.0:1787119491.385340:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633352960 00002000:00010000:1.0:1787119491.385373:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (45345609->18446744073709551615) 00002000:00100000:1.0:1787119491.385378:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bea00 with x1873929633352960 ext(45345609->18446744073709551615) 00002000:00010000:1.0:1787119491.385390:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bea00. 00000100:00100000:1.0:1787119491.385434:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9669 00000100:00100000:1.0:1787119491.385465:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633352960:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119491.385691:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 22177220 -> 45345609 00002000:00010000:1.0:1787119491.385695:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119489 -> 1787119490 00002000:00010000:1.0:1787119491.385698:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.385700:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119489 -> 1787119490 00002000:00010000:1.0:1787119491.385702:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1037 -> 1037 00000100:00100000:1.0:1787119491.385767:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633352960:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 304us (631us total) trans 4294968845 rc 0/0 00000100:00100000:1.0:1787119491.385775:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9669 00002000:00010000:1.0:1787119491.385779:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (45345609->18446744073709551615) 00002000:00100000:1.0:1787119491.385782:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bea00 with x1873929633352960 ext(45345609->18446744073709551615) 00002000:00010000:1.0:1787119491.385786:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bea00. 00000100:00100000:1.0:1787119491.387125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.387359:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633352832:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3711us (4294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.387368:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9668 00002000:00100000:3.0:1787119491.387379:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (54251520->54317055) req@ffff92a509232300 x1873929633352832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.387389:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232300 with x1873929633352832 ext(54251520->54317055) 00002000:00010000:3.0:1787119491.387395:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509232300 00000100:00100000:3.0:1787119491.387424:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633353088 00000100:00100000:3.0:1787119491.387431:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633353088 00002000:00100000:3.0:1787119491.387483:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (16437248->16474111) req@ffff92a63403b800 x1873929633353088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.387492:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633353088 ext(16437248->16474111) 00002000:00010000:3.0:1787119491.387496:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403b800 00000100:00100000:2.0:1787119491.389174:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9670 00000100:00100000:2.0:1787119491.389195:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633353088:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.389496:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633352448:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 30883us (31267us total) trans 4294969087 rc 0/0 00000100:00100000:0.0:1787119491.389505:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9667 00002000:00100000:0.0:1787119491.389513:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (10907648->57078232) req@ffff92a63403ad80 x1873929633352448/t4294969087(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/456 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.389524:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403ad80 with x1873929633352448 ext(10907648->57078232) 00002000:00010000:0.0:1787119491.389538:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403ad80 00000100:00100000:2.0:1787119491.390274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.391608:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633353216 00000100:00100000:0.0:1787119491.391620:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633353216 00000100:00100000:0.0:1787119491.391686:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19528 00000100:00100000:0.0:1787119491.391697:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+197:32720:x1873929633353216:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119491.391729:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119491.391751:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2c72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.391837:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2c79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.391850:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2c79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.391865:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2c79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119491.391892:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 45345609 00000004:00200000:0.0:1787119491.391895:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119491.391915:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2c79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.391940:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2c72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b69 expref: 199 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.391957:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2c79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b69 expref: 198 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.391965:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119491.391968:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119491.391971:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa600, rc 0) 00000100:00100000:0.0:1787119491.392029:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+198:32720:x1873929633353216:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 334us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119491.392035:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19528 00000100:00100000:0.0:1787119491.396065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.396131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.396197:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633353472 00000100:00100000:3.0:1787119491.396208:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633353472 00002000:00100000:3.0:1787119491.396253:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (20979712->20983807) req@ffff92a508ffe300 x1873929633353472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.396264:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633353472 ext(20979712->20983807) 00002000:00010000:3.0:1787119491.396270:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffe300 00000100:00100000:3.0:1787119491.396305:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9671 00000100:00100000:3.0:1787119491.396315:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633353472:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.396606:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633353472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 291us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.396613:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9671 00002000:00100000:3.0:1787119491.396620:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (20979712->20983807) req@ffff92a508ffe300 x1873929633353472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.396628:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633353472 ext(20979712->20983807) 00002000:00010000:3.0:1787119491.396632:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffe300 00000100:00100000:1.0:1787119491.396852:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633353344 00000100:00100000:1.0:1787119491.396856:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633353344 00000100:00100000:1.0:1787119491.396897:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5008 00000100:00100000:1.0:1787119491.396906:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633353344:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119491.405064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.405212:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633353600 00000100:00100000:2.0:1787119491.405223:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633353600 00002000:00100000:2.0:1787119491.405271:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (24227840->24240127) req@ffff92a508ffea00 x1873929633353600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.405282:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffea00 with x1873929633353600 ext(24227840->24240127) 00002000:00010000:2.0:1787119491.405288:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffea00 00000100:00100000:2.0:1787119491.405319:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9672 00000100:00100000:2.0:1787119491.405328:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633353600:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.405687:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633353600:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 358us (632us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119491.405695:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9672 00002000:00100000:2.0:1787119491.405702:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (24227840->24240127) req@ffff92a508ffea00 x1873929633353600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/12728 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.405710:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffea00 with x1873929633353600 ext(24227840->24240127) 00002000:00010000:2.0:1787119491.405714:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffea00 00000100:00100000:1.0:1787119491.406939:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633353088:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17743us (19813us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119491.406953:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9670 00002000:00100000:1.0:1787119491.406963:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (16437248->16474111) req@ffff92a63403b800 x1873929633353088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.406972:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633353088 ext(16437248->16474111) 00002000:00010000:1.0:1787119491.406978:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403b800 00000100:00100000:0.0:1787119491.412755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.412802:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633353728 00000100:00100000:0.0:1787119491.412812:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633353728 00002000:00100000:0.0:1787119491.412863:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (21020672->21024767) req@ffff92a508ffce00 x1873929633353728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.412880:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffce00 with x1873929633353728 ext(21020672->21024767) 00002000:00010000:0.0:1787119491.412885:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffce00 00000100:00100000:0.0:1787119491.412916:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9673 00000100:00100000:0.0:1787119491.412925:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633353728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.413142:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633353728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 217us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119491.413150:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9673 00002000:00100000:0.0:1787119491.413156:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (21020672->21024767) req@ffff92a508ffce00 x1873929633353728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.413164:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffce00 with x1873929633353728 ext(21020672->21024767) 00002000:00010000:0.0:1787119491.413168:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffce00 00000100:00100000:1.0:1787119491.420040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.420080:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633353856 00000100:00100000:1.0:1787119491.420090:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633353856 00002000:00100000:1.0:1787119491.420141:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (36225024->36229119) req@ffff92a634039180 x1873929633353856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.420153:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633353856 ext(36225024->36229119) 00002000:00010000:1.0:1787119491.420159:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634039180 00000100:00100000:1.0:1787119491.420186:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9674 00000100:00100000:1.0:1787119491.420198:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633353856:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.425884:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633353856:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5674us (5842us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119491.425903:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9674 00002000:00100000:1.0:1787119491.425920:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (36225024->36229119) req@ffff92a634039180 x1873929633353856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.425931:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633353856 ext(36225024->36229119) 00002000:00010000:1.0:1787119491.425937:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634039180 00000100:00100000:1.0:1787119491.433884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.433909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.433986:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633354112 00000100:00100000:3.0:1787119491.433999:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633354112 00002000:00100000:3.0:1787119491.434052:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (16404480->54219438) req@ffff92a63403a300 x1873929633354112/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.434063:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a300 with x1873929633354112 ext(16404480->54219438) 00002000:00010000:3.0:1787119491.434070:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403a300 00000100:00100000:3.0:1787119491.434101:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633353984 00000100:00100000:3.0:1787119491.434104:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633353984 00002000:00100000:3.0:1787119491.434121:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (10907648->10911743) req@ffff92a634038700 x1873929633353984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.434133:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038700 with x1873929633353984 ext(10907648->10911743) 00002000:00010000:3.0:1787119491.434137:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038700 00000100:00100000:3.0:1787119491.434151:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9675 00000100:00100000:3.0:1787119491.434159:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633354112:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119491.434418:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9676 00000100:00100000:1.0:1787119491.434429:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633353984:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.434664:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633353984:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 236us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.434672:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9676 00002000:00100000:1.0:1787119491.434679:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (10907648->10911743) req@ffff92a634038700 x1873929633353984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.434687:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038700 with x1873929633353984 ext(10907648->10911743) 00002000:00010000:1.0:1787119491.434690:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038700 00000100:00100000:0.0:1787119491.445915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.445956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.445985:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633354240 00000100:00100000:0.0:1787119491.445995:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633354240 00002000:00100000:0.0:1787119491.446046:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (36229120->36233215) req@ffff92a508ffca80 x1873929633354240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.446059:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffca80 with x1873929633354240 ext(36229120->36233215) 00002000:00010000:0.0:1787119491.446066:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffca80 00000100:00100000:0.0:1787119491.446093:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633354368 00000100:00100000:0.0:1787119491.446096:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633354368 00002000:00100000:0.0:1787119491.446113:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (10911744->10915839) req@ffff92a508ffdf80 x1873929633354368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.446127:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdf80 with x1873929633354368 ext(10911744->10915839) 00002000:00010000:0.0:1787119491.446132:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffdf80 00000100:00100000:0.0:1787119491.446154:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9677 00000100:00100000:0.0:1787119491.446165:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633354240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.446460:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633354240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 274us (534us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.446470:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9677 00002000:00100000:0.0:1787119491.446477:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (36229120->36233215) req@ffff92a508ffca80 x1873929633354240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.446484:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffca80 with x1873929633354240 ext(36229120->36233215) 00002000:00010000:0.0:1787119491.446487:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffca80 00000100:00100000:0.0:1787119491.446504:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9678 00000100:00100000:0.0:1787119491.446511:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633354368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.446628:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633354368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 117us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119491.446634:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9678 00002000:00100000:0.0:1787119491.446639:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (10911744->10915839) req@ffff92a508ffdf80 x1873929633354368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.446647:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdf80 with x1873929633354368 ext(10911744->10915839) 00002000:00010000:0.0:1787119491.446650:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffdf80 00000100:00100000:0.0:1787119491.454286:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633354112:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 20113us (20398us total) trans 4294968846 rc 0/0 00000100:00100000:0.0:1787119491.454306:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9675 00002000:00100000:0.0:1787119491.454320:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (16404480->54219438) req@ffff92a63403a300 x1873929633354112/t4294968846(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/456 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.454330:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a300 with x1873929633354112 ext(16404480->54219438) 00002000:00010000:0.0:1787119491.454337:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403a300 00000100:00100000:0.0:1787119491.454459:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.455635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.455663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.456083:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633354624 00000100:00100000:1.0:1787119491.456094:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633354624 00002000:00100000:1.0:1787119491.456144:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (36204544->36270079) req@ffff92a508ffdc00 x1873929633354624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.456154:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdc00 with x1873929633354624 ext(36204544->36270079) 00002000:00010000:1.0:1787119491.456159:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffdc00 00000100:00100000:1.0:1787119491.456188:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633354752 00000100:00100000:1.0:1787119491.456191:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633354752 00002000:00100000:1.0:1787119491.456211:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (10907648->57078232) req@ffff92a509230e00 x1873929633354752/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.456218:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230e00 with x1873929633354752 ext(10907648->57078232) 00002000:00010000:1.0:1787119491.456222:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230e00 00000100:00100000:1.0:1787119491.456237:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633354496 00000100:00100000:1.0:1787119491.456240:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633354496 00002000:00100000:1.0:1787119491.456254:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (54251520->54317055) req@ffff92a63eb2ad80 x1873929633354496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.456268:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633354496 ext(54251520->54317055) 00002000:00010000:1.0:1787119491.456271:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ad80 00000100:00100000:1.0:1787119491.456291:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9679 00000100:00100000:1.0:1787119491.456300:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633354624:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.456644:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9680 00000100:00100000:1.0:1787119491.456652:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633354752:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119491.456872:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9681 00000100:00100000:3.0:1787119491.456883:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633354496:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.465331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.467858:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633354496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10966us (12183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.467874:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9681 00002000:00100000:1.0:1787119491.467886:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (54251520->54317055) req@ffff92a63eb2ad80 x1873929633354496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.467896:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633354496 ext(54251520->54317055) 00002000:00010000:1.0:1787119491.467902:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ad80 00000100:00100000:1.0:1787119491.467995:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633354624:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11696us (13558us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119491.468002:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9679 00002000:00100000:1.0:1787119491.468008:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (36204544->36270079) req@ffff92a508ffdc00 x1873929633354624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.468016:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdc00 with x1873929633354624 ext(36204544->36270079) 00002000:00010000:1.0:1787119491.468019:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffdc00 00000100:00100000:1.0:1787119491.468655:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633354752:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 12001us (13024us total) trans 4294969088 rc 0/0 00000100:00100000:1.0:1787119491.468667:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9680 00002000:00100000:1.0:1787119491.468674:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (10907648->57078232) req@ffff92a509230e00 x1873929633354752/t4294969088(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/456 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.468682:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230e00 with x1873929633354752 ext(10907648->57078232) 00002000:00010000:1.0:1787119491.468687:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230e00 00000100:00100000:1.0:1787119491.468713:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633354880 00000100:00100000:1.0:1787119491.468722:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633354880 00000100:00100000:1.0:1787119491.468762:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5009 00000100:00100000:1.0:1787119491.468770:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633354880:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119491.473567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.473758:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633355008 00000100:00100000:1.0:1787119491.473770:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633355008 00000100:00100000:1.0:1787119491.473828:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5010 00000100:00100000:1.0:1787119491.473837:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633355008:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119491.488407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.488470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.488496:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633355136 00000100:00100000:1.0:1787119491.488506:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633355136 00002000:00100000:1.0:1787119491.488563:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (36270080->36306943) req@ffff92a63403bb80 x1873929633355136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.488575:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633355136 ext(36270080->36306943) 00002000:00010000:1.0:1787119491.488581:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403bb80 00000100:00100000:1.0:1787119491.488606:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633355264 00000100:00100000:1.0:1787119491.488610:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633355264 00002000:00100000:1.0:1787119491.488627:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (20979712->20983807) req@ffff92a63403aa00 x1873929633355264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.488641:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403aa00 with x1873929633355264 ext(20979712->20983807) 00002000:00010000:1.0:1787119491.488644:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403aa00 00000100:00100000:1.0:1787119491.488663:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9682 00000100:00100000:1.0:1787119491.488672:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633355136:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.489147:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9683 00000100:00100000:1.0:1787119491.489155:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633355264:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.489287:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633355264:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 132us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.489295:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9683 00002000:00100000:1.0:1787119491.489301:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (20979712->20983807) req@ffff92a63403aa00 x1873929633355264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.489309:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403aa00 with x1873929633355264 ext(20979712->20983807) 00002000:00010000:1.0:1787119491.489312:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403aa00 00000100:00100000:1.0:1787119491.494259:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633355136:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5576us (5857us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119491.494273:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9682 00002000:00100000:1.0:1787119491.494285:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (36270080->36306943) req@ffff92a63403bb80 x1873929633355136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.494296:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633355136 ext(36270080->36306943) 00002000:00010000:1.0:1787119491.494302:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63403bb80 00000100:00100000:2.0:1787119491.495196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.495290:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633355392 00000100:00100000:3.0:1787119491.495299:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633355392 00002000:00100000:3.0:1787119491.495338:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (21020672->21024767) req@ffff92a6068bdf80 x1873929633355392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.495349:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bdf80 with x1873929633355392 ext(21020672->21024767) 00002000:00010000:3.0:1787119491.495354:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bdf80 00000100:00100000:3.0:1787119491.495400:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9684 00000100:00100000:3.0:1787119491.495410:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633355392:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.496539:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633355392:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1113us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.496552:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9684 00002000:00100000:3.0:1787119491.496561:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (21020672->21024767) req@ffff92a6068bdf80 x1873929633355392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.496579:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bdf80 with x1873929633355392 ext(21020672->21024767) 00002000:00010000:3.0:1787119491.496583:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bdf80 00000001:00080000:3.0:1787119491.496857:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969087 is committed 00000100:00100000:1.0:1787119491.504067:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633353344:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 107150us (108000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.504085:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5008 00000100:00100000:2.0:1787119491.516100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.516174:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633355648 00000100:00100000:3.0:1787119491.516183:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633355648 00002000:00100000:3.0:1787119491.516226:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (16412672->16437247) req@ffff92a6068bd880 x1873929633355648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.516237:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd880 with x1873929633355648 ext(16412672->16437247) 00002000:00010000:3.0:1787119491.516243:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd880 00000100:00100000:3.0:1787119491.516272:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9685 00000100:00100000:3.0:1787119491.516280:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633355648:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.527643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.527746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.532945:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633355648:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16656us (16843us total) trans 0 rc 24576/24576 00000100:00100000:3.0:1787119491.532958:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9685 00002000:00100000:3.0:1787119491.532970:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (16412672->16437247) req@ffff92a6068bd880 x1873929633355648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.532980:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd880 with x1873929633355648 ext(16412672->16437247) 00002000:00010000:3.0:1787119491.532985:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd880 00000100:00100000:0.0:1787119491.537235:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633355520 00000100:00100000:0.0:1787119491.537250:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633355520 00002000:00100000:0.0:1787119491.537326:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (15896576->15904767) req@ffff92a63eb28380 x1873929633355520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.537336:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633355520 ext(15896576->15904767) 00002000:00010000:0.0:1787119491.537342:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28380 00000100:00100000:0.0:1787119491.537499:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633355776 00000100:00100000:0.0:1787119491.537505:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633355776 00002000:00100000:0.0:1787119491.537521:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (10907648->10911743) req@ffff92a63eb28a80 x1873929633355776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.537539:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633355776 ext(10907648->10911743) 00002000:00010000:0.0:1787119491.537543:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28a80 00000100:00100000:3.0:1787119491.537820:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9686 00000100:00100000:3.0:1787119491.537831:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633355520:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.538097:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633355520:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 266us (10462us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1787119491.538105:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9686 00002000:00100000:3.0:1787119491.538111:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (15896576->15904767) req@ffff92a63eb28380 x1873929633355520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/8632 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.538120:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633355520 ext(15896576->15904767) 00002000:00010000:3.0:1787119491.538123:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28380 00000100:00100000:3.0:1787119491.538142:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9687 00000100:00100000:3.0:1787119491.538149:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633355776:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.538248:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633355776:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 99us (10502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.538255:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9687 00002000:00100000:3.0:1787119491.538260:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (10907648->10911743) req@ffff92a63eb28a80 x1873929633355776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.538267:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633355776 ext(10907648->10911743) 00002000:00010000:3.0:1787119491.538270:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28a80 00000100:00100000:2.0:1787119491.538378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.538559:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633355904 00000100:00100000:2.0:1787119491.538564:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633355904 00002000:00100000:2.0:1787119491.538590:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (24756224->24760319) req@ffff92a6068bf800 x1873929633355904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.538598:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf800 with x1873929633355904 ext(24756224->24760319) 00002000:00010000:2.0:1787119491.538603:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bf800 00000100:00100000:2.0:1787119491.538622:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9688 00000100:00100000:2.0:1787119491.538629:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633355904:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.538758:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633355904:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 128us (379us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119491.538764:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9688 00002000:00100000:2.0:1787119491.538770:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (24756224->24760319) req@ffff92a6068bf800 x1873929633355904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.538784:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf800 with x1873929633355904 ext(24756224->24760319) 00002000:00010000:2.0:1787119491.538787:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bf800 00000100:00100000:3.0:1787119491.548934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.548972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.548989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.549015:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633356032 00000100:00100000:3.0:1787119491.549024:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633356032 00002000:00100000:3.0:1787119491.549070:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (56160256->56205311) req@ffff92a63eb29500 x1873929633356032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.549082:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633356032 ext(56160256->56205311) 00002000:00010000:3.0:1787119491.549088:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29500 00000100:00100000:3.0:1787119491.549110:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633356160 00000100:00100000:3.0:1787119491.549113:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633356160 00002000:00100000:3.0:1787119491.549125:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (10911744->10915839) req@ffff92a63eb2b480 x1873929633356160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.549132:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b480 with x1873929633356160 ext(10911744->10915839) 00002000:00010000:3.0:1787119491.549135:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b480 00000100:00100000:3.0:1787119491.549144:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633356288 00000100:00100000:3.0:1787119491.549146:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633356288 00002000:00100000:3.0:1787119491.549160:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (24768512->24772607) req@ffff92a63eb28000 x1873929633356288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.549167:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28000 with x1873929633356288 ext(24768512->24772607) 00002000:00010000:3.0:1787119491.549169:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb28000 00000100:00100000:3.0:1787119491.549182:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9689 00000100:00100000:3.0:1787119491.549189:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633356032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.549422:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9690 00000100:00100000:3.0:1787119491.549430:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633356160:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.549592:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633356160:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 162us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.549600:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9690 00002000:00100000:3.0:1787119491.549607:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (10911744->10915839) req@ffff92a63eb2b480 x1873929633356160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.549614:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b480 with x1873929633356160 ext(10911744->10915839) 00002000:00010000:3.0:1787119491.549618:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b480 00000100:00100000:3.0:1787119491.549636:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9691 00000100:00100000:3.0:1787119491.549643:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633356288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.549735:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633356288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 92us (744us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.549741:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9691 00002000:00100000:3.0:1787119491.549746:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (24768512->24772607) req@ffff92a63eb28000 x1873929633356288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.549753:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28000 with x1873929633356288 ext(24768512->24772607) 00002000:00010000:3.0:1787119491.549756:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb28000 00000100:00100000:3.0:1787119491.560163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.560301:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633356032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11110us (11376us total) trans 0 rc 45056/45056 00000100:00100000:3.0:1787119491.560312:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9689 00002000:00100000:3.0:1787119491.560324:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (56160256->56205311) req@ffff92a63eb29500 x1873929633356032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.560333:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633356032 ext(56160256->56205311) 00002000:00010000:3.0:1787119491.560339:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29500 00000100:00100000:3.0:1787119491.560361:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633356416 00000100:00100000:3.0:1787119491.560367:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633356416 00002000:00100000:3.0:1787119491.560411:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (10907648->57078232) req@ffff92a63eb28e00 x1873929633356416/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.560419:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28e00 with x1873929633356416 ext(10907648->57078232) 00002000:00010000:3.0:1787119491.560422:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28e00 00000100:00100000:3.0:1787119491.560472:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9692 00000100:00100000:3.0:1787119491.560481:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633356416:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119491.576205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.576434:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633356544 00000100:00100000:1.0:1787119491.576464:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633356544 00002000:00100000:1.0:1787119491.576511:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (31031296->31076351) req@ffff92a634038000 x1873929633356544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.576523:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633356544 ext(31031296->31076351) 00002000:00010000:1.0:1787119491.576538:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634038000 00000100:00100000:1.0:1787119491.576568:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9693 00000100:00100000:1.0:1787119491.576578:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633356544:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.582507:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633356416:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 22017us (22342us total) trans 4294969089 rc 0/0 00000100:00100000:3.0:1787119491.582522:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9692 00002000:00100000:3.0:1787119491.585161:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (10907648->57078232) req@ffff92a63eb28e00 x1873929633356416/t4294969089(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/456 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.585177:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28e00 with x1873929633356416 ext(10907648->57078232) 00002000:00010000:3.0:1787119491.585184:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28e00 00000100:00100000:1.0:1787119491.588824:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633354880:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 120042us (123492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.588838:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5009 00000001:00080000:2.0:1787119491.593463:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968845 is committed 00000001:00080000:2.0:1787119491.593496:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968846 is committed 00000100:00100000:3.0:1787119491.597535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.597789:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633356544:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 21210us (21593us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1787119491.597800:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9693 00002000:00100000:2.0:1787119491.597811:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (31031296->31076351) req@ffff92a634038000 x1873929633356544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.597820:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633356544 ext(31031296->31076351) 00002000:00010000:2.0:1787119491.597827:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634038000 00000100:00100000:2.0:1787119491.597850:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633356672 00000100:00100000:2.0:1787119491.597856:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633356672 00002000:00100000:2.0:1787119491.597886:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (56528896->56532991) req@ffff92a63eb29180 x1873929633356672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.597893:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29180 with x1873929633356672 ext(56528896->56532991) 00002000:00010000:2.0:1787119491.597897:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29180 00000100:00100000:2.0:1787119491.597917:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9694 00000100:00100000:2.0:1787119491.597925:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633356672:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.598103:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633356672:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 177us (586us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119491.598110:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9694 00002000:00100000:2.0:1787119491.598116:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (56528896->56532991) req@ffff92a63eb29180 x1873929633356672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.598124:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29180 with x1873929633356672 ext(56528896->56532991) 00002000:00010000:2.0:1787119491.598126:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29180 00000100:00100000:0.0:1787119491.603927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.603980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.604009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.604335:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633356800 00000100:00100000:3.0:1787119491.604346:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633356800 00002000:00100000:3.0:1787119491.604409:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (24354816->24358911) req@ffff92a508ffd180 x1873929633356800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.604421:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd180 with x1873929633356800 ext(24354816->24358911) 00002000:00010000:3.0:1787119491.604427:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffd180 00000100:00100000:3.0:1787119491.604478:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633357056 00000100:00100000:3.0:1787119491.604482:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633357056 00002000:00100000:3.0:1787119491.604501:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (56545280->56549375) req@ffff92a508ffd880 x1873929633357056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.604508:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd880 with x1873929633357056 ext(56545280->56549375) 00002000:00010000:3.0:1787119491.604511:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd880 00000100:00100000:3.0:1787119491.604541:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9695 00000100:00100000:3.0:1787119491.604553:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633356800:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.604825:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633356800:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 273us (917us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.604835:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9695 00002000:00100000:3.0:1787119491.604842:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (24354816->24358911) req@ffff92a508ffd180 x1873929633356800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.604849:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd180 with x1873929633356800 ext(24354816->24358911) 00002000:00010000:3.0:1787119491.604851:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffd180 00000100:00100000:3.0:1787119491.604870:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9696 00000100:00100000:3.0:1787119491.604876:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633357056:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.604968:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633357056:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 92us (958us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.604974:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9696 00002000:00100000:3.0:1787119491.604980:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (56545280->56549375) req@ffff92a508ffd880 x1873929633357056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.604987:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd880 with x1873929633357056 ext(56545280->56549375) 00002000:00010000:3.0:1787119491.604989:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd880 00000100:00100000:3.0:1787119491.606271:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633356928 00000100:00100000:3.0:1787119491.606281:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633356928 00000100:00100000:3.0:1787119491.606340:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5011 00000100:00100000:3.0:1787119491.606348:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633356928:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119491.616171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.616233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.616349:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633357184 00000100:00100000:0.0:1787119491.616362:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633357184 00002000:00100000:0.0:1787119491.616429:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (24358912->24363007) req@ffff92a63eb29f80 x1873929633357184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.616480:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633357184 ext(24358912->24363007) 00002000:00010000:0.0:1787119491.616486:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29f80 00000100:00100000:0.0:1787119491.616511:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633357312 00000100:00100000:0.0:1787119491.616514:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633357312 00002000:00100000:0.0:1787119491.616547:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (54800384->54861823) req@ffff92a63eb2b800 x1873929633357312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.616554:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633357312 ext(54800384->54861823) 00002000:00010000:0.0:1787119491.616558:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b800 00000100:00100000:0.0:1787119491.616576:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9697 00000100:00100000:0.0:1787119491.616585:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633357184:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.616854:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633357184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 269us (694us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.616861:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9697 00002000:00100000:0.0:1787119491.616868:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (24358912->24363007) req@ffff92a63eb29f80 x1873929633357184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.616875:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633357184 ext(24358912->24363007) 00002000:00010000:0.0:1787119491.616877:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb29f80 00000100:00100000:0.0:1787119491.616894:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9698 00000100:00100000:0.0:1787119491.616900:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633357312:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.620793:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633357312:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3881us (4548us total) trans 0 rc 61440/61440 00000100:00100000:1.0:1787119491.620807:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9698 00002000:00100000:1.0:1787119491.620821:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (54800384->54861823) req@ffff92a63eb2b800 x1873929633357312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.620831:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633357312 ext(54800384->54861823) 00002000:00010000:1.0:1787119491.620837:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b800 00000100:00100000:3.0:1787119491.623618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.623668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.623757:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633357440 00000100:00100000:1.0:1787119491.623767:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633357440 00002000:00100000:1.0:1787119491.623815:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (21684224->21688319) req@ffff92a63eb2a300 x1873929633357440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.623831:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a300 with x1873929633357440 ext(21684224->21688319) 00002000:00010000:1.0:1787119491.623836:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2a300 00000100:00100000:1.0:1787119491.623864:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633357568 00000100:00100000:1.0:1787119491.623876:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633357568 00002000:00100000:1.0:1787119491.623892:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (24334336->24399871) req@ffff92a63ebd4a80 x1873929633357568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.623899:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd4a80 with x1873929633357568 ext(24334336->24399871) 00002000:00010000:1.0:1787119491.623902:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd4a80 00000100:00100000:1.0:1787119491.623918:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9699 00000100:00100000:1.0:1787119491.623926:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633357440:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.624162:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633357440:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 235us (552us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119491.624170:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9699 00002000:00100000:1.0:1787119491.624175:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (21684224->21688319) req@ffff92a63eb2a300 x1873929633357440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.624182:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a300 with x1873929633357440 ext(21684224->21688319) 00002000:00010000:1.0:1787119491.624185:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2a300 00000100:00100000:1.0:1787119491.624201:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9700 00000100:00100000:1.0:1787119491.624207:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633357568:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.630254:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633357568:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6035us (6573us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119491.630268:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9700 00002000:00100000:2.0:1787119491.630282:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (24334336->24399871) req@ffff92a63ebd4a80 x1873929633357568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.630292:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd4a80 with x1873929633357568 ext(24334336->24399871) 00002000:00010000:2.0:1787119491.630298:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd4a80 00000100:00100000:1.0:1787119491.640300:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633355008:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 166453us (166734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119491.640314:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5010 00000001:00080000:3.0:1787119491.640560:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969088 is committed 00000100:00100000:0.0:1787119491.640917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.641009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.641093:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633357696 00000100:00100000:3.0:1787119491.641103:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633357696 00002000:00100000:3.0:1787119491.641147:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (22253568->22257663) req@ffff92a508fff100 x1873929633357696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.641159:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff100 with x1873929633357696 ext(22253568->22257663) 00002000:00010000:3.0:1787119491.641164:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508fff100 00000100:00100000:3.0:1787119491.641191:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633357824 00000100:00100000:3.0:1787119491.641195:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633357824 00002000:00100000:3.0:1787119491.641212:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (21688320->21692415) req@ffff92a508fffb80 x1873929633357824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.641220:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fffb80 with x1873929633357824 ext(21688320->21692415) 00002000:00010000:3.0:1787119491.641224:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508fffb80 00000100:00100000:3.0:1787119491.641241:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9701 00000100:00100000:3.0:1787119491.641251:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633357696:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.641511:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633357696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 261us (596us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.641518:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9701 00002000:00100000:3.0:1787119491.641536:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (22253568->22257663) req@ffff92a508fff100 x1873929633357696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.641544:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff100 with x1873929633357696 ext(22253568->22257663) 00002000:00010000:3.0:1787119491.641548:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508fff100 00000100:00100000:3.0:1787119491.641566:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9702 00000100:00100000:3.0:1787119491.641574:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633357824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.641673:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633357824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 99us (663us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.641679:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9702 00002000:00100000:3.0:1787119491.641684:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (21688320->21692415) req@ffff92a508fffb80 x1873929633357824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.641692:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fffb80 with x1873929633357824 ext(21688320->21692415) 00002000:00010000:3.0:1787119491.641694:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508fffb80 00000100:00100000:0.0:1787119491.648384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.649017:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633357952 00000100:00100000:3.0:1787119491.649030:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633357952 00002000:00100000:3.0:1787119491.649081:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (24399872->24436735) req@ffff92a508ffd500 x1873929633357952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.649091:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd500 with x1873929633357952 ext(24399872->24436735) 00002000:00010000:3.0:1787119491.649097:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffd500 00000100:00100000:3.0:1787119491.649131:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9703 00000100:00100000:3.0:1787119491.649141:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633357952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.657168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.657394:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633358080 00000100:00100000:3.0:1787119491.657406:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633358080 00002000:00100000:3.0:1787119491.657494:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (21663744->21729279) req@ffff92a508ffe680 x1873929633358080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.657506:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe680 with x1873929633358080 ext(21663744->21729279) 00002000:00010000:3.0:1787119491.657513:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffe680 00000100:00100000:3.0:1787119491.657548:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9704 00000100:00100000:3.0:1787119491.657558:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633358080:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.659654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.659757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.660181:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633358208 00000100:00100000:0.0:1787119491.660191:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633358208 00002000:00100000:0.0:1787119491.660236:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (22257664->22261759) req@ffff92a63ebd5180 x1873929633358208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.660248:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5180 with x1873929633358208 ext(22257664->22261759) 00002000:00010000:0.0:1787119491.660254:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5180 00000100:00100000:0.0:1787119491.660280:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633358336 00000100:00100000:0.0:1787119491.660284:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633358336 00002000:00100000:0.0:1787119491.660299:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (15896576->15904767) req@ffff92a63ebd4700 x1873929633358336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.660307:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd4700 with x1873929633358336 ext(15896576->15904767) 00002000:00010000:0.0:1787119491.660311:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd4700 00000100:00100000:0.0:1787119491.660330:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9705 00000100:00100000:0.0:1787119491.660339:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633358208:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.660621:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633358208:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 282us (976us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.660630:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9705 00002000:00100000:0.0:1787119491.660637:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (22257664->22261759) req@ffff92a63ebd5180 x1873929633358208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.660645:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5180 with x1873929633358208 ext(22257664->22261759) 00002000:00010000:0.0:1787119491.660649:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5180 00000100:00100000:0.0:1787119491.660682:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9706 00000100:00100000:0.0:1787119491.660690:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633358336:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.660808:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633358336:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 117us (1050us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1787119491.660815:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9706 00002000:00100000:0.0:1787119491.660821:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (15896576->15904767) req@ffff92a63ebd4700 x1873929633358336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/8632 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.660828:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd4700 with x1873929633358336 ext(15896576->15904767) 00002000:00010000:0.0:1787119491.660832:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd4700 00000100:00100000:3.0:1787119491.666556:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633357952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17405us (18173us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119491.666570:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9703 00002000:00100000:3.0:1787119491.666584:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (24399872->24436735) req@ffff92a508ffd500 x1873929633357952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.666595:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd500 with x1873929633357952 ext(24399872->24436735) 00002000:00010000:3.0:1787119491.666602:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffd500 00000100:00100000:3.0:1787119491.666694:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633358080:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9138us (9537us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119491.666702:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9704 00002000:00100000:3.0:1787119491.666707:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (21663744->21729279) req@ffff92a508ffe680 x1873929633358080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.666715:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe680 with x1873929633358080 ext(21663744->21729279) 00002000:00010000:3.0:1787119491.666719:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffe680 00000100:00100000:2.0:1787119491.679583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.679617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.679639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.679676:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633358464 00000100:00100000:2.0:1787119491.679685:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633358464 00002000:00100000:2.0:1787119491.679736:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (56160256->56205311) req@ffff92a6068bf100 x1873929633358464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.679749:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf100 with x1873929633358464 ext(56160256->56205311) 00002000:00010000:2.0:1787119491.679756:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf100 00000100:00100000:2.0:1787119491.679778:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633358592 00000100:00100000:2.0:1787119491.679781:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633358592 00002000:00100000:2.0:1787119491.679796:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (22233088->22298623) req@ffff92a6068bc000 x1873929633358592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.679804:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633358592 ext(22233088->22298623) 00002000:00010000:2.0:1787119491.679808:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bc000 00000100:00100000:2.0:1787119491.679818:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633358720 00000100:00100000:2.0:1787119491.679821:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633358720 00002000:00100000:2.0:1787119491.679836:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (1011712->1015807) req@ffff92a6068bc380 x1873929633358720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.679843:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc380 with x1873929633358720 ext(1011712->1015807) 00002000:00010000:2.0:1787119491.679847:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc380 00000100:00100000:2.0:1787119491.679864:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9707 00000100:00100000:2.0:1787119491.679888:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633358464:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.680157:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9708 00000100:00100000:2.0:1787119491.680165:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633358592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.687845:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9709 00000100:00100000:3.0:1787119491.687875:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633358720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.688187:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633358720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 326us (8546us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.688196:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9709 00002000:00100000:3.0:1787119491.688206:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (1011712->1015807) req@ffff92a6068bc380 x1873929633358720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.688216:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc380 with x1873929633358720 ext(1011712->1015807) 00002000:00010000:3.0:1787119491.688223:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc380 00000100:00100000:2.0:1787119491.689015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.694650:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633358848 00000100:00100000:3.0:1787119491.694663:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633358848 00002000:00100000:3.0:1787119491.694716:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (21729280->21766143) req@ffff92a6068bfb80 x1873929633358848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.694728:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bfb80 with x1873929633358848 ext(21729280->21766143) 00002000:00010000:3.0:1787119491.694734:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bfb80 00000100:00100000:3.0:1787119491.694768:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9710 00000100:00100000:3.0:1787119491.694778:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633358848:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.696664:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633358464:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16768us (17084us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1787119491.696677:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9707 00002000:00100000:2.0:1787119491.696688:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (56160256->56205311) req@ffff92a6068bf100 x1873929633358464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.696699:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf100 with x1873929633358464 ext(56160256->56205311) 00002000:00010000:2.0:1787119491.696705:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf100 00000100:00100000:2.0:1787119491.702245:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633358592:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22069us (22616us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119491.702260:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9708 00002000:00100000:2.0:1787119491.702274:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (22233088->22298623) req@ffff92a6068bc000 x1873929633358592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.702293:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633358592 ext(22233088->22298623) 00002000:00010000:2.0:1787119491.702299:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bc000 00000100:00100000:2.0:1787119491.721515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.721562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.721590:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633358976 00000100:00100000:0.0:1787119491.721601:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633358976 00002000:00100000:0.0:1787119491.721649:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (1015808->1019903) req@ffff92a6068bc700 x1873929633358976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.721660:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc700 with x1873929633358976 ext(1015808->1019903) 00002000:00010000:0.0:1787119491.721666:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc700 00000100:00100000:0.0:1787119491.721696:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633359104 00000100:00100000:0.0:1787119491.721700:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633359104 00002000:00100000:0.0:1787119491.721718:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (56528896->56532991) req@ffff92a509640700 x1873929633359104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.721726:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640700 with x1873929633359104 ext(56528896->56532991) 00002000:00010000:0.0:1787119491.721730:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509640700 00000100:00100000:0.0:1787119491.721750:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9711 00000100:00100000:0.0:1787119491.721760:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633358976:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.721982:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9712 00000100:00100000:2.0:1787119491.721990:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633359104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.722022:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633358976:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 264us (517us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.722030:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9711 00002000:00100000:0.0:1787119491.722038:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (1015808->1019903) req@ffff92a6068bc700 x1873929633358976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.722052:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc700 with x1873929633358976 ext(1015808->1019903) 00002000:00010000:0.0:1787119491.722056:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc700 00000100:00100000:2.0:1787119491.722102:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633359104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 112us (539us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119491.722108:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9712 00002000:00100000:2.0:1787119491.722114:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (56528896->56532991) req@ffff92a509640700 x1873929633359104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.722122:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640700 with x1873929633359104 ext(56528896->56532991) 00002000:00010000:2.0:1787119491.722125:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509640700 00000100:00100000:3.0:1787119491.722845:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633358848:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 28065us (33832us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119491.722854:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9710 00002000:00100000:3.0:1787119491.722861:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (21729280->21766143) req@ffff92a6068bfb80 x1873929633358848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.723250:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bfb80 with x1873929633358848 ext(21729280->21766143) 00002000:00010000:3.0:1787119491.723256:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bfb80 00000100:00100000:2.0:1787119491.734294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.734347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.735102:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633359488 00000100:00100000:3.0:1787119491.735112:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633359488 00002000:00100000:3.0:1787119491.735161:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (1019904->1056767) req@ffff92a509642d80 x1873929633359488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.735173:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642d80 with x1873929633359488 ext(1019904->1056767) 00002000:00010000:3.0:1787119491.735179:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509642d80 00000100:00100000:3.0:1787119491.735208:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9713 00000100:00100000:3.0:1787119491.735281:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633359488:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.735676:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633359360 00000100:00100000:1.0:1787119491.735681:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633359360 00000100:00100000:2.0:1787119491.735689:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.735727:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19529 00000100:00100000:1.0:1787119491.735734:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+198:32728:x1873929633359360:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119491.735774:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787119491.735798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119491.735800:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2bfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b3f expref: 198 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.735818:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119491.735822:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119491.736030:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.736043:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.736052:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119491.736103:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976342 00000004:00010000:1.0:1787119491.736129:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090ffea19 reply state 000000005ada6244 transno 4294976343 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119491.736137:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119491.736213:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+200:32728:x1873929633359360:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 478us (1931us total) trans 4294976343 rc 0/0 00000100:00100000:1.0:1787119491.736221:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19529 00000020:00080000:1.0:1787119491.736226:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119491.736717:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633359616 00000100:00100000:3.0:1787119491.736723:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633359616 00002000:00100000:3.0:1787119491.736751:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (56545280->56549375) req@ffff92a509643b80 x1873929633359616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.736761:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643b80 with x1873929633359616 ext(56545280->56549375) 00002000:00010000:3.0:1787119491.736765:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643b80 00000100:00100000:3.0:1787119491.736790:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633359744 00000100:00100000:3.0:1787119491.736793:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633359744 00002000:00100000:3.0:1787119491.736811:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (16404480->16408575) req@ffff92a509641f80 x1873929633359744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.736819:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641f80 with x1873929633359744 ext(16404480->16408575) 00002000:00010000:3.0:1787119491.736822:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641f80 00000100:00100000:3.0:1787119491.736839:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9714 00000100:00100000:3.0:1787119491.736847:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633359616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.737091:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633359616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 244us (1400us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.737098:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9714 00002000:00100000:3.0:1787119491.737104:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (56545280->56549375) req@ffff92a509643b80 x1873929633359616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.737112:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643b80 with x1873929633359616 ext(56545280->56549375) 00002000:00010000:3.0:1787119491.737115:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643b80 00000100:00100000:3.0:1787119491.737131:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9715 00000100:00100000:3.0:1787119491.737138:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633359744:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.737234:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633359744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 95us (1435us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.737245:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9715 00002000:00100000:3.0:1787119491.737251:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (16404480->16408575) req@ffff92a509641f80 x1873929633359744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.737259:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641f80 with x1873929633359744 ext(16404480->16408575) 00002000:00010000:3.0:1787119491.737262:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641f80 00000001:00080000:0.0:1787119491.738822:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969089 is committed 00000100:00100000:3.0:1787119491.743361:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633356928:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 137001us (139368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.743376:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5011 00010000:00010000:3.0:1787119491.743862:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.743889:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.743896:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.743904:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.743908:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.743915:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.743931:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119491.743934:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119491.743939:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.743950:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2c80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119491.750370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.750633:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633359872 00000100:00100000:1.0:1787119491.750644:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633359872 00002000:00010000:1.0:1787119491.750685:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (22177220->18446744073709551615) 00002000:00100000:1.0:1787119491.750690:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641500 with x1873929633359872 ext(22177220->18446744073709551615) 00002000:00010000:1.0:1787119491.750701:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509641500. 00000100:00100000:1.0:1787119491.750728:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9716 00000100:00100000:1.0:1787119491.750737:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633359872:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119491.751094:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1008584 -> 22177220 00002000:00010000:1.0:1787119491.751099:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119489 -> 1787119490 00002000:00010000:1.0:1787119491.751101:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.751103:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119489 -> 1787119490 00002000:00010000:1.0:1787119491.751105:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1677 -> 1037 00000100:00100000:1.0:1787119491.751161:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633359872:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 425us (800us total) trans 4294969090 rc 0/0 00000100:00100000:1.0:1787119491.751169:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9716 00002000:00010000:1.0:1787119491.751172:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (22177220->18446744073709551615) 00002000:00100000:1.0:1787119491.751175:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641500 with x1873929633359872 ext(22177220->18446744073709551615) 00002000:00010000:1.0:1787119491.751179:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509641500. 00000100:00100000:3.0:1787119491.751551:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633359488:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16332us (17201us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119491.751560:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9713 00002000:00100000:3.0:1787119491.751570:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (1019904->1056767) req@ffff92a509642d80 x1873929633359488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.751578:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642d80 with x1873929633359488 ext(1019904->1056767) 00002000:00010000:3.0:1787119491.751584:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509642d80 00000100:00100000:2.0:1787119491.759732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.759841:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633360000 00000100:00100000:0.0:1787119491.759852:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633360000 00002000:00100000:0.0:1787119491.759916:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (16408576->16412671) req@ffff92a509643100 x1873929633360000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.759928:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643100 with x1873929633360000 ext(16408576->16412671) 00002000:00010000:0.0:1787119491.759934:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509643100 00000100:00100000:0.0:1787119491.759967:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9717 00000100:00100000:0.0:1787119491.759977:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633360000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.760229:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633360000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 253us (508us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.760237:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9717 00002000:00100000:0.0:1787119491.760244:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (16408576->16412671) req@ffff92a509643100 x1873929633360000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.760252:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643100 with x1873929633360000 ext(16408576->16412671) 00002000:00010000:0.0:1787119491.760256:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509643100 00000100:00100000:0.0:1787119491.767810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.767855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.767960:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633360384 00000100:00100000:3.0:1787119491.767972:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633360384 00000100:00100000:3.0:1787119491.768039:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19530 00000100:00100000:3.0:1787119491.768049:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+199:32728:x1873929633360384:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119491.768072:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119491.768092:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b70 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.768178:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2c8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.768192:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.768202:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119491.768233:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 22177220 00000004:00200000:3.0:1787119491.768237:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119491.768256:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.768281:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2c87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b70 expref: 201 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.768300:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2c8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b70 expref: 200 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.768308:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119491.768311:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119491.768314:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c64400, rc 0) 00000100:00100000:3.0:1787119491.768369:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+200:32728:x1873929633360384:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 321us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.768376:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19530 00000100:00100000:0.0:1787119491.768838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.770975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.774700:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633360128 00000100:00100000:1.0:1787119491.774718:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633360128 00002000:00100000:2.0:1787119491.775021:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (54800384->54861823) req@ffff92a519cd6a00 x1873929633360128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.775036:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633360128 ext(54800384->54861823) 00002000:00010000:2.0:1787119491.775044:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6a00 00000100:00100000:2.0:1787119491.775094:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633360256 00000100:00100000:2.0:1787119491.775100:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633360256 00002000:00100000:2.0:1787119491.775120:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (15896576->15904767) req@ffff92a519cd7800 x1873929633360256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.775135:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd7800 with x1873929633360256 ext(15896576->15904767) 00002000:00010000:2.0:1787119491.775140:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd7800 00000100:00100000:2.0:1787119491.775167:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9718 00000100:00100000:2.0:1787119491.775179:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633360128:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.775600:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9719 00000100:00100000:2.0:1787119491.775608:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633360256:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.775770:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633360256:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 161us (6932us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119491.775779:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9719 00002000:00100000:2.0:1787119491.775785:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (15896576->15904767) req@ffff92a519cd7800 x1873929633360256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/8632 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.775793:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd7800 with x1873929633360256 ext(15896576->15904767) 00002000:00010000:2.0:1787119491.775797:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd7800 00000100:00100000:0.0:1787119491.776222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.776583:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633360640 00000100:00100000:1.0:1787119491.776591:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633360640 00002000:00100000:1.0:1787119491.776625:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (16437248->16474111) req@ffff92a519cd6d80 x1873929633360640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.776637:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6d80 with x1873929633360640 ext(16437248->16474111) 00002000:00010000:1.0:1787119491.776641:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cd6d80 00000100:00100000:1.0:1787119491.776669:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633360512 00000100:00100000:1.0:1787119491.776673:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633360512 00002000:00100000:1.0:1787119491.776689:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (1056768->1093631) req@ffff92a519cd5c00 x1873929633360512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.776697:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5c00 with x1873929633360512 ext(1056768->1093631) 00002000:00010000:1.0:1787119491.776701:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cd5c00 00000100:00100000:1.0:1787119491.776720:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9720 00000100:00100000:1.0:1787119491.776731:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633360640:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.777005:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9721 00000100:00100000:1.0:1787119491.777013:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633360512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.781690:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633360128:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6203us (13523us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1787119491.781709:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9718 00002000:00100000:2.0:1787119491.781724:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (54800384->54861823) req@ffff92a519cd6a00 x1873929633360128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.781736:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633360128 ext(54800384->54861823) 00002000:00010000:2.0:1787119491.781743:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6a00 00000100:00100000:1.0:1787119491.782406:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633360640:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5672us (11435us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119491.782417:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9720 00002000:00100000:1.0:1787119491.782425:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (16437248->16474111) req@ffff92a519cd6d80 x1873929633360640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.782435:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6d80 with x1873929633360640 ext(16437248->16474111) 00002000:00010000:1.0:1787119491.782473:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cd6d80 00000100:00100000:1.0:1787119491.783809:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633360512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6789us (7583us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119491.783820:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9721 00002000:00100000:1.0:1787119491.783829:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (1056768->1093631) req@ffff92a519cd5c00 x1873929633360512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.783838:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5c00 with x1873929633360512 ext(1056768->1093631) 00002000:00010000:1.0:1787119491.783843:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cd5c00 00000100:00100000:2.0:1787119491.795783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.795835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.795866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.795911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.795948:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633360768 00000100:00100000:2.0:1787119491.795958:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633360768 00002000:00100000:2.0:1787119491.796010:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (16404480->54219438) req@ffff92a509640a80 x1873929633360768/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.796021:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640a80 with x1873929633360768 ext(16404480->54219438) 00002000:00010000:2.0:1787119491.796027:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640a80 00000100:00100000:2.0:1787119491.796050:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633361280 00000100:00100000:2.0:1787119491.796053:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633361280 00002000:00100000:2.0:1787119491.796069:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (22253568->22257663) req@ffff92a509643480 x1873929633361280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.796077:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643480 with x1873929633361280 ext(22253568->22257663) 00002000:00010000:2.0:1787119491.796081:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643480 00000100:00100000:2.0:1787119491.796094:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633361152 00000100:00100000:2.0:1787119491.796097:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633361152 00002000:00100000:2.0:1787119491.796111:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (56160256->56205311) req@ffff92a509643800 x1873929633361152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.796119:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643800 with x1873929633361152 ext(56160256->56205311) 00002000:00010000:2.0:1787119491.796122:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643800 00000100:00100000:2.0:1787119491.796139:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9722 00000100:00100000:2.0:1787119491.796148:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633360768:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119491.796357:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9723 00000100:00100000:2.0:1787119491.796365:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633361280:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.796559:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633361024 00000100:00100000:0.0:1787119491.796564:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633361024 00000100:00100000:0.0:1787119491.796671:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19531 00000100:00100000:0.0:1787119491.796680:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+200:32728:x1873929633361024:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119491.796794:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119491.796821:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2c8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b70 expref: 200 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.796840:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119491.796844:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119491.797040:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.797054:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.797064:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119491.797117:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976344 00000004:00010000:0.0:1787119491.797142:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ed4cc9d reply state 00000000e11e4990 transno 4294976345 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119491.797150:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119491.797218:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+202:32728:x1873929633361024:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 539us (1382us total) trans 4294976345 rc 0/0 00000100:00100000:0.0:1787119491.797225:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19531 00000020:00080000:0.0:1787119491.797229:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119491.798804:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9724 00000100:00100000:1.0:1787119491.798826:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633361152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.800067:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633361280:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3695us (4192us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119491.800077:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9723 00002000:00100000:2.0:1787119491.800087:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (22253568->22257663) req@ffff92a509643480 x1873929633361280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.800097:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643480 with x1873929633361280 ext(22253568->22257663) 00002000:00010000:2.0:1787119491.800103:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643480 00010000:00010000:2.0:1787119491.806573:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.806592:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.806762:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.806771:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fa200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119491.806775:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.806783:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.806801:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119491.806804:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119491.806809:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.806819:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2c95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119491.808728:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633360768:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 12568us (13013us total) trans 4294968847 rc 0/0 00000100:00100000:2.0:1787119491.808745:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9722 00002000:00100000:2.0:1787119491.808761:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (16404480->54219438) req@ffff92a509640a80 x1873929633360768/t4294968847(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 520/456 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.808770:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640a80 with x1873929633360768 ext(16404480->54219438) 00002000:00010000:2.0:1787119491.808776:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640a80 00000100:00100000:3.0:1787119491.809876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.809917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.810040:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633361408 00000100:00100000:1.0:1787119491.810050:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633361408 00002000:00010000:1.0:1787119491.810085:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (45345609->18446744073709551615) 00002000:00100000:1.0:1787119491.810090:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6680 with x1873929633361408 ext(45345609->18446744073709551615) 00002000:00010000:1.0:1787119491.810100:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd6680. 00000100:00100000:1.0:1787119491.810128:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633361536 00000100:00100000:1.0:1787119491.810131:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633361536 00002000:00100000:1.0:1787119491.810154:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (33882112->33943551) req@ffff92a63ebd5c00 x1873929633361536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.810164:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5c00 with x1873929633361536 ext(33882112->33943551) 00002000:00010000:1.0:1787119491.810169:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd5c00 00000100:00100000:1.0:1787119491.810193:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9725 00000100:00100000:1.0:1787119491.810202:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633361408:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119491.810406:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 22177220 -> 45345609 00002000:00010000:1.0:1787119491.810411:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119491.810413:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119489 -> 1787119489 00002000:00010000:1.0:1787119491.810416:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119491.810418:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1037 -> 1037 00000100:00100000:1.0:1787119491.810501:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633361408:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 300us (630us total) trans 4294969091 rc 0/0 00000100:00100000:1.0:1787119491.810508:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9725 00002000:00010000:1.0:1787119491.810512:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (45345609->18446744073709551615) 00002000:00100000:1.0:1787119491.810515:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6680 with x1873929633361408 ext(45345609->18446744073709551615) 00002000:00010000:1.0:1787119491.810519:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd6680. 00000100:00100000:1.0:1787119491.810552:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9726 00000100:00100000:1.0:1787119491.810559:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633361536:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.816089:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633361152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17261us (20165us total) trans 0 rc 45056/45056 00000100:00100000:0.0:1787119491.816107:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9724 00002000:00100000:0.0:1787119491.816120:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (56160256->56205311) req@ffff92a509643800 x1873929633361152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.816131:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643800 with x1873929633361152 ext(56160256->56205311) 00002000:00010000:0.0:1787119491.816138:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643800 00000100:00100000:1.0:1787119491.817785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.817954:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633361536:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7394us (8034us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1787119491.817965:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9726 00002000:00100000:2.0:1787119491.817978:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (33882112->33943551) req@ffff92a63ebd5c00 x1873929633361536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.817987:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5c00 with x1873929633361536 ext(33882112->33943551) 00002000:00010000:2.0:1787119491.817993:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd5c00 00000100:00100000:3.0:1787119491.818954:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633361664 00000100:00100000:3.0:1787119491.818965:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633361664 00000100:00100000:3.0:1787119491.819033:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19532 00000100:00100000:3.0:1787119491.819044:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+201:32728:x1873929633361664:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119491.819066:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119491.819087:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b77 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.819174:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2ca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.819190:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.819201:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119491.819225:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 45345609 00000004:00200000:3.0:1787119491.819229:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119491.819244:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.819266:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2c9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b77 expref: 203 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.819281:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b77 expref: 202 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.819290:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119491.819292:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119491.819296:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c64200, rc 0) 00000100:00100000:3.0:1787119491.819354:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+202:32728:x1873929633361664:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 311us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.819360:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19532 00000100:00100000:1.0:1787119491.826782:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.826886:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633361792 00000100:00100000:0.0:1787119491.826897:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633361792 00002000:00100000:0.0:1787119491.826945:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (22257664->22261759) req@ffff92a634039880 x1873929633361792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.826956:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039880 with x1873929633361792 ext(22257664->22261759) 00002000:00010000:0.0:1787119491.826963:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039880 00000100:00100000:0.0:1787119491.826999:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9727 00000100:00100000:0.0:1787119491.827009:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633361792:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119491.827301:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633361792:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 293us (528us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119491.827309:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9727 00002000:00100000:0.0:1787119491.827317:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (22257664->22261759) req@ffff92a634039880 x1873929633361792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119491.827324:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039880 with x1873929633361792 ext(22257664->22261759) 00002000:00010000:0.0:1787119491.827327:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039880 00000100:00100000:0.0:1787119491.844132:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.844171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.844199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.844278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.844290:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633362048 00000100:00100000:2.0:1787119491.844301:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633362048 00000100:00100000:3.0:1787119491.844335:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633362176 00000100:00100000:3.0:1787119491.844340:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633362176 00002000:00100000:2.0:1787119491.844351:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (24227840->24240127) req@ffff92a519cd5180 x1873929633362048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.844362:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5180 with x1873929633362048 ext(24227840->24240127) 00002000:00010000:2.0:1787119491.844368:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5180 00000100:00100000:2.0:1787119491.844391:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633361920 00000100:00100000:2.0:1787119491.844395:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633361920 00002000:00100000:2.0:1787119491.844410:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (56528896->56532991) req@ffff92a519cd5f80 x1873929633361920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787119491.844576:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9728 00000100:00100000:1.0:1787119491.844589:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633362048:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.844839:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633362048:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 253us (715us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119491.844846:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9728 00002000:00100000:1.0:1787119491.844853:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (24227840->24240127) req@ffff92a519cd5180 x1873929633362048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/12728 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.844862:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5180 with x1873929633362048 ext(24227840->24240127) 00002000:00010000:1.0:1787119491.844865:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5180 00002000:00100000:2.0:1787119491.845349:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5f80 with x1873929633361920 ext(56528896->56532991) 00002000:00010000:2.0:1787119491.845354:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5f80 00000100:00100000:2.0:1787119491.845378:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9729 00000100:00100000:2.0:1787119491.845387:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633361920:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.845592:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633361920:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 161us (1375us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119491.845599:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9729 00002000:00100000:2.0:1787119491.845605:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (56528896->56532991) req@ffff92a519cd5f80 x1873929633361920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.845613:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5f80 with x1873929633361920 ext(56528896->56532991) 00002000:00010000:2.0:1787119491.845616:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5f80 00000100:00100000:0.0:1787119491.847942:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5012 00000100:00100000:0.0:1787119491.847963:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633362176:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119491.848889:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633362432 00000100:00100000:2.0:1787119491.848901:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633362432 00000100:00100000:2.0:1787119491.848963:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19533 00000100:00100000:2.0:1787119491.848971:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+202:32724:x1873929633362432:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119491.849022:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119491.849049:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63e561000/0xcaba3de8463e2bd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b31 expref: 202 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.849070:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119491.849075:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119491.849276:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.849289:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.849298:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119491.849341:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976346 00000004:00010000:2.0:1787119491.849362:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000846f1a43 reply state 00000000ebc9c213 transno 4294976347 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119491.849370:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119491.849493:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+204:32724:x1873929633362432:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 523us (5214us total) trans 4294976347 rc 0/0 00000100:00100000:2.0:1787119491.849501:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19533 00000020:00080000:2.0:1787119491.849506:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119491.851285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.852104:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633362560 00000100:00100000:2.0:1787119491.852116:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633362560 00002000:00100000:2.0:1787119491.854270:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (22233088->22298623) req@ffff92a519cd5880 x1873929633362560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.854296:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5880 with x1873929633362560 ext(22233088->22298623) 00002000:00010000:2.0:1787119491.854304:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5880 00000100:00100000:2.0:1787119491.854349:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9730 00000100:00100000:2.0:1787119491.854370:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633362560:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.855887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.856055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.856294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119491.856324:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.856336:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.856344:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.856351:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.856356:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.856364:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.856380:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00000100:00100000:2.0:1787119491.857580:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633362688 00000100:00100000:2.0:1787119491.857594:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633362688 00010000:00010000:3.0:1787119491.857647:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00100000:2.0:1787119491.857649:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (36225024->36229119) req@ffff92a63ebd5880 x1873929633362688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787119491.857658:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.857677:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2caa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787119491.857679:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5880 with x1873929633362688 ext(36225024->36229119) 00002000:00010000:2.0:1787119491.857688:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5880 00000100:00100000:2.0:1787119491.857714:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633362816 00000100:00100000:2.0:1787119491.857717:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633362816 00002000:00010000:2.0:1787119491.857732:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (27367412->18446744073709551615) 00002000:00100000:2.0:1787119491.857736:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5f80 with x1873929633362816 ext(27367412->18446744073709551615) 00002000:00010000:2.0:1787119491.857746:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd5f80. 00000100:00100000:2.0:1787119491.861630:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633362944 00000100:00100000:2.0:1787119491.861644:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633362944 00002000:00100000:2.0:1787119491.861695:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (56545280->56549375) req@ffff92a63ebd6d80 x1873929633362944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.861707:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6d80 with x1873929633362944 ext(56545280->56549375) 00002000:00010000:2.0:1787119491.861712:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd6d80 00000100:00100000:2.0:1787119491.861735:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9731 00000100:00100000:2.0:1787119491.861744:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633362688:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.861863:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9732 00000100:00100000:3.0:1787119491.861877:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633362816:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119491.862295:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 45345609 -> 27367412 00002000:00010000:3.0:1787119491.862299:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119489 -> 1787119490 00002000:00010000:3.0:1787119491.862302:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119488 -> 1787119489 00002000:00010000:3.0:1787119491.862305:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119489 -> 1787119490 00002000:00010000:3.0:1787119491.862308:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1037 -> 1549 00000100:00100000:3.0:1787119491.862366:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633362816:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 492us (6311us total) trans 4294968848 rc 0/0 00000100:00100000:3.0:1787119491.862375:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9732 00002000:00010000:3.0:1787119491.862379:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (27367412->18446744073709551615) 00002000:00100000:3.0:1787119491.862382:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5f80 with x1873929633362816 ext(27367412->18446744073709551615) 00002000:00010000:3.0:1787119491.862742:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63ebd5f80. 00000100:00100000:3.0:1787119491.862772:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9733 00000100:00100000:3.0:1787119491.862781:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633362944:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.862966:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633362944:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 186us (6671us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.862974:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9733 00002000:00100000:3.0:1787119491.862981:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (56545280->56549375) req@ffff92a63ebd6d80 x1873929633362944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.862991:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd6d80 with x1873929633362944 ext(56545280->56549375) 00002000:00010000:3.0:1787119491.862995:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd6d80 00000100:00100000:2.0:1787119491.865225:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633362560:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10858us (13937us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119491.865249:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9730 00002000:00100000:2.0:1787119491.865259:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (22233088->22298623) req@ffff92a519cd5880 x1873929633362560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.865269:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5880 with x1873929633362560 ext(22233088->22298623) 00002000:00010000:2.0:1787119491.865275:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5880 00000100:00100000:2.0:1787119491.865493:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633362688:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3750us (9614us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119491.865501:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9731 00002000:00100000:2.0:1787119491.865507:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (36225024->36229119) req@ffff92a63ebd5880 x1873929633362688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.865515:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd5880 with x1873929633362688 ext(36225024->36229119) 00002000:00010000:2.0:1787119491.865519:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd5880 00000100:00100000:1.0:1787119491.871621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.871729:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633363072 00000100:00100000:3.0:1787119491.871740:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633363072 00000100:00100000:3.0:1787119491.871798:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19534 00000100:00100000:3.0:1787119491.871809:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+203:32724:x1873929633363072:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119491.871833:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119491.871856:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2cb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.871947:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.871961:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.871972:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119491.871999:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 27367412 00000004:00200000:3.0:1787119491.872003:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119491.872021:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.872045:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2cb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b7e expref: 205 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.872062:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b7e expref: 204 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.872071:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119491.872073:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119491.872077:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c64400, rc 0) 00000100:00100000:3.0:1787119491.872149:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+204:32724:x1873929633363072:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 341us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.872157:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19534 00000100:00100000:0.0:1787119491.881765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.881825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.881891:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633363584 00000100:00100000:2.0:1787119491.881903:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633363584 00000100:00100000:3.0:1787119491.881949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:2.0:1787119491.881967:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (54800384->54861823) req@ffff92a519cd4a80 x1873929633363584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.881979:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd4a80 with x1873929633363584 ext(54800384->54861823) 00002000:00010000:2.0:1787119491.881985:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd4a80 00000100:00100000:3.0:1787119491.882072:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633363200 00000100:00100000:3.0:1787119491.882077:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633363200 00002000:00100000:3.0:1787119491.882110:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (36229120->36233215) req@ffff92a63ebd7b80 x1873929633363200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.882120:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7b80 with x1873929633363200 ext(36229120->36233215) 00002000:00010000:3.0:1787119491.882123:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd7b80 00000100:00100000:3.0:1787119491.882147:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9734 00000100:00100000:2.0:1787119491.882159:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9735 00000100:00100000:3.0:1787119491.882160:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633363584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.882173:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633363200:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.885730:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633363200:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3549us (3770us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119491.885744:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9735 00002000:00100000:2.0:1787119491.885757:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (36229120->36233215) req@ffff92a63ebd7b80 x1873929633363200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.885768:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7b80 with x1873929633363200 ext(36229120->36233215) 00002000:00010000:2.0:1787119491.885774:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd7b80 00000100:00100000:1.0:1787119491.886026:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633363456 00000100:00100000:1.0:1787119491.886035:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633363456 00000100:00100000:1.0:1787119491.886083:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19535 00000100:00100000:1.0:1787119491.886093:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+204:32729:x1873929633363456:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119491.886150:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119491.886179:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2c41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b54 expref: 204 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.886198:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119491.886204:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119491.886608:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.886623:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119491.886633:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119491.886685:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976348 00000004:00010000:1.0:1787119491.886713:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b0321c7 reply state 000000005bd02eb0 transno 4294976349 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119491.886723:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119491.886804:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+206:32729:x1873929633363456:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 712us (5048us total) trans 4294976349 rc 0/0 00000100:00100000:1.0:1787119491.886811:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19535 00000020:00080000:1.0:1787119491.886816:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119491.888825:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633363584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6656us (6987us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1787119491.888840:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9734 00002000:00100000:3.0:1787119491.888856:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (54800384->54861823) req@ffff92a519cd4a80 x1873929633363584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.888867:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd4a80 with x1873929633363584 ext(54800384->54861823) 00002000:00010000:3.0:1787119491.888873:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd4a80 00010000:00010000:2.0:1787119491.890404:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.890423:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.890432:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.890470:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119491.890476:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.890486:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.890504:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119491.890508:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119491.890513:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119491.890531:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2cbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119491.892646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.900302:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633363712 00000100:00100000:1.0:1787119491.900316:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633363712 00000100:00100000:3.0:1787119491.901222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.904287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.904436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.908156:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633363840 00000100:00100000:2.0:1787119491.908173:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633363840 00002000:00100000:2.0:1787119491.908225:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (36204544->36270079) req@ffff92a63ebd7480 x1873929633363840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.908236:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7480 with x1873929633363840 ext(36204544->36270079) 00002000:00010000:2.0:1787119491.908242:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd7480 00000100:00100000:2.0:1787119491.908275:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633364224 00000100:00100000:2.0:1787119491.908279:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633364224 00002000:00100000:2.0:1787119491.908296:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (22253568->22257663) req@ffff92a506e5a300 x1873929633364224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.908309:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5a300 with x1873929633364224 ext(22253568->22257663) 00002000:00010000:2.0:1787119491.908313:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5a300 00000100:00100000:2.0:1787119491.908329:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9736 00000100:00100000:2.0:1787119491.908337:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633363840:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.908653:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9737 00000100:00100000:2.0:1787119491.908661:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633364224:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.908782:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633364224:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 121us (4356us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119491.908790:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9737 00002000:00100000:2.0:1787119491.908796:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (22253568->22257663) req@ffff92a506e5a300 x1873929633364224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.908804:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5a300 with x1873929633364224 ext(22253568->22257663) 00002000:00010000:2.0:1787119491.908808:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5a300 00002000:00010000:2.0:1787119491.908843:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (22177220->18446744073709551615) 00002000:00100000:2.0:1787119491.908846:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6300 with x1873929633363712 ext(22177220->18446744073709551615) 00002000:00010000:2.0:1787119491.908856:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6300. 00000100:00100000:2.0:1787119491.908874:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9738 00000100:00100000:2.0:1787119491.908880:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633363712:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119491.909146:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 1008584 -> 22177220 00002000:00010000:2.0:1787119491.909150:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119489 -> 1787119490 00002000:00010000:2.0:1787119491.909153:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119489 -> 1787119490 00002000:00010000:2.0:1787119491.909155:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119489 -> 1787119490 00002000:00010000:2.0:1787119491.909158:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1805 -> 1037 00000100:00100000:2.0:1787119491.909198:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633363712:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 317us (16562us total) trans 4294969092 rc 0/0 00000100:00100000:2.0:1787119491.909205:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9738 00002000:00010000:2.0:1787119491.909208:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (22177220->18446744073709551615) 00002000:00100000:2.0:1787119491.909211:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6300 with x1873929633363712 ext(22177220->18446744073709551615) 00002000:00010000:2.0:1787119491.909216:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6300. 00000100:00100000:1.0:1787119491.911136:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633364096 00000100:00100000:1.0:1787119491.911150:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633364096 00000100:00100000:0.0:1787119491.911792:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19536 00000100:00100000:0.0:1787119491.911803:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+205:32724:x1873929633364096:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119491.911864:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119491.911891:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2cb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b7e expref: 205 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.912315:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119491.912321:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119491.912834:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.912852:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.912863:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119491.914065:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976350 00000004:00010000:0.0:1787119491.914116:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f9a17d3 reply state 000000001d98445e transno 4294976351 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119491.914132:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119491.914766:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+207:32724:x1873929633364096:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2958us (10482us total) trans 4294976351 rc 0/0 00000100:00100000:0.0:1787119491.914776:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19536 00000020:00080000:0.0:1787119491.914782:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119491.927576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.927628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.927786:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633364352 00000100:00100000:3.0:1787119491.927795:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633364352 00000100:00100000:2.0:1787119491.927822:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633363840:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 19484us (26604us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119491.927833:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9736 00002000:00100000:2.0:1787119491.927846:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (36204544->36270079) req@ffff92a63ebd7480 x1873929633363840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.927855:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7480 with x1873929633363840 ext(36204544->36270079) 00002000:00010000:2.0:1787119491.927860:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd7480 00000100:00100000:2.0:1787119491.927879:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633364480 00000100:00100000:2.0:1787119491.927882:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633364480 00002000:00100000:2.0:1787119491.927905:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (22257664->22261759) req@ffff92a5069e2d80 x1873929633364480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.927913:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2d80 with x1873929633364480 ext(22257664->22261759) 00002000:00010000:2.0:1787119491.927916:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2d80 00000100:00100000:2.0:1787119491.927935:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9739 00000100:00100000:2.0:1787119491.927944:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633364480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.927975:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19537 00000100:00100000:3.0:1787119491.927989:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+207:32729:x1873929633364352:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119491.928002:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119491.928021:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a642177000/0xcaba3de8463e2ccd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b85 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.928103:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2cd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.928118:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.928130:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119491.928155:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 22177220 00000004:00200000:3.0:1787119491.928159:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119491.928174:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.928200:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a642177000/0xcaba3de8463e2ccd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b85 expref: 209 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119491.928209:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633364480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 266us (582us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1787119491.928217:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b85 expref: 208 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119491.928219:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9739 00010000:00010000:3.0:1787119491.928225:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00002000:00100000:2.0:1787119491.928225:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (22257664->22261759) req@ffff92a5069e2d80 x1873929633364480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787119491.928228:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119491.928231:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a642176a00, rc 0) 00002000:00100000:2.0:1787119491.928233:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2d80 with x1873929633364480 ext(22257664->22261759) 00002000:00010000:2.0:1787119491.928236:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2d80 00000100:00100000:3.0:1787119491.928259:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+208:32729:x1873929633364352:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 277us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119491.928267:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19537 00000001:00080000:2.0:1787119491.944056:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968847 is committed 00000100:00100000:0.0:1787119491.944242:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633362176:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 96282us (100035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119491.944254:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5012 00010000:00010000:3.0:1787119491.947680:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.947703:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.947710:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.947717:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fa800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.947721:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.947729:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.947746:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119491.947749:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119491.947754:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.947760:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2cc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119491.947981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119491.948027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.948099:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633364608 00000100:00100000:3.0:1787119491.948110:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633364608 00002000:00010000:3.0:1787119491.948152:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (49988592->18446744073709551615) 00002000:00100000:3.0:1787119491.948156:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640000 with x1873929633364608 ext(49988592->18446744073709551615) 00002000:00010000:3.0:1787119491.948168:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640000. 00000100:00100000:3.0:1787119491.948197:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633364736 00000100:00100000:3.0:1787119491.948201:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633364736 00002000:00100000:3.0:1787119491.948224:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (36270080->36306943) req@ffff92a519c69880 x1873929633364736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.948238:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69880 with x1873929633364736 ext(36270080->36306943) 00002000:00010000:3.0:1787119491.948241:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69880 00000100:00100000:3.0:1787119491.948265:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9740 00000100:00100000:3.0:1787119491.948275:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633364608:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:1.0:1787119491.948293:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9741 00000100:00100000:1.0:1787119491.948306:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633364736:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:3.0:1787119491.948560:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 27367412 -> 49988592 00002000:00010000:3.0:1787119491.948565:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119491.948568:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119489 -> 1787119489 00002000:00010000:3.0:1787119491.948571:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119491.948574:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1549 -> 1549 00000100:00100000:3.0:1787119491.948617:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633364608:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 343us (640us total) trans 4294968849 rc 0/0 00000100:00100000:3.0:1787119491.948625:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9740 00002000:00010000:3.0:1787119491.948629:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (49988592->18446744073709551615) 00002000:00100000:3.0:1787119491.948632:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640000 with x1873929633364608 ext(49988592->18446744073709551615) 00002000:00010000:3.0:1787119491.948637:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640000. 00000100:00100000:1.0:1787119491.967623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.967655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.967678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119491.967706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.967775:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633365120 00000100:00100000:3.0:1787119491.967788:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633365120 00002000:00100000:3.0:1787119491.967840:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (22233088->22298623) req@ffff92a5069e3800 x1873929633365120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.967851:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3800 with x1873929633365120 ext(22233088->22298623) 00002000:00010000:3.0:1787119491.967857:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e3800 00000100:00100000:3.0:1787119491.967885:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633364864 00000100:00100000:3.0:1787119491.967889:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633364864 00000100:00100000:2.0:1787119491.967903:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633364736:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 19598us (19872us total) trans 0 rc 36864/36864 00002000:00100000:3.0:1787119491.967909:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (24354816->24358911) req@ffff92a5069e3480 x1873929633364864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787119491.967918:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9741 00002000:00100000:3.0:1787119491.967926:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3480 with x1873929633364864 ext(24354816->24358911) 00002000:00100000:2.0:1787119491.967931:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (36270080->36306943) req@ffff92a519c69880 x1873929633364736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00010000:3.0:1787119491.967933:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e3480 00002000:00100000:2.0:1787119491.967943:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69880 with x1873929633364736 ext(36270080->36306943) 00002000:00010000:2.0:1787119491.967947:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69880 00000100:00100000:3.0:1787119491.967951:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633364992 00000100:00100000:3.0:1787119491.967956:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633364992 00000100:00100000:2.0:1787119491.967967:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9742 00002000:00100000:3.0:1787119491.967973:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (49967104->49971199) req@ffff92a5069e0700 x1873929633364992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787119491.967980:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633365120:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:3.0:1787119491.967990:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0700 with x1873929633364992 ext(49967104->49971199) 00002000:00010000:3.0:1787119491.967994:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e0700 00000100:00100000:3.0:1787119491.968021:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9743 00000100:00100000:3.0:1787119491.968031:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633364864:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.968207:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633364864:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 178us (551us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.968215:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9743 00002000:00100000:3.0:1787119491.968222:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (24354816->24358911) req@ffff92a5069e3480 x1873929633364864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.968229:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3480 with x1873929633364864 ext(24354816->24358911) 00002000:00010000:3.0:1787119491.968232:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e3480 00000100:00100000:3.0:1787119491.968247:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9744 00000100:00100000:3.0:1787119491.968255:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633364992:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119491.968373:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633364992:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 119us (693us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119491.968380:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9744 00002000:00100000:3.0:1787119491.968391:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (49967104->49971199) req@ffff92a5069e0700 x1873929633364992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.968398:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0700 with x1873929633364992 ext(49967104->49971199) 00002000:00010000:3.0:1787119491.968401:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e0700 00000100:00100000:3.0:1787119491.968421:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633365376 00000100:00100000:3.0:1787119491.968425:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633365376 00000100:00100000:3.0:1787119491.969150:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19538 00000100:00100000:3.0:1787119491.969159:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+207:32729:x1873929633365376:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119491.969203:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119491.969226:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2cd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b85 expref: 207 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.969245:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119491.969250:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119491.969420:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.969434:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.969476:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119491.969537:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976352 00000004:00010000:3.0:1787119491.969561:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067075c0b reply state 00000000811f0ea7 transno 4294976353 ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119491.969570:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119491.969645:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+209:32729:x1873929633365376:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 485us (1936us total) trans 4294976353 rc 0/0 00000100:00100000:3.0:1787119491.969652:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19538 00000020:00080000:3.0:1787119491.969656:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119491.975038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.975187:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633365504 00000100:00100000:3.0:1787119491.975198:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633365504 00002000:00100000:3.0:1787119491.975246:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (16412672->16437247) req@ffff92a519c68380 x1873929633365504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119491.975258:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68380 with x1873929633365504 ext(16412672->16437247) 00002000:00010000:3.0:1787119491.975263:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c68380 00000100:00100000:3.0:1787119491.975297:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9745 00000100:00100000:3.0:1787119491.975308:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633365504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119491.976151:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633365120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8170us (8533us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119491.976162:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9742 00002000:00100000:2.0:1787119491.976172:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (22233088->22298623) req@ffff92a5069e3800 x1873929633365120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 504/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119491.976189:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e3800 with x1873929633365120 ext(22233088->22298623) 00002000:00010000:2.0:1787119491.976194:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e3800 00010000:00010000:0.0:1787119491.976266:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.976283:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.976290:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.976296:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a642176c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119491.976300:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.976307:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.976323:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119491.976326:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119491.976331:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.976336:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176c00/0xcaba3de8463e2cdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119491.979844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.979949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.979972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119491.980005:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633365632 00000100:00100000:3.0:1787119491.980015:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633365632 00002000:00010000:3.0:1787119491.980053:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (45345609->18446744073709551615) 00002000:00100000:3.0:1787119491.980058:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58e00 with x1873929633365632 ext(45345609->18446744073709551615) 00002000:00010000:3.0:1787119491.980070:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e58e00. 00000100:00100000:3.0:1787119491.980093:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633365760 00000100:00100000:3.0:1787119491.980098:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633365760 00000100:00100000:1.0:1787119491.980098:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633365504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4789us (5066us total) trans 0 rc 24576/24576 00000100:00100000:1.0:1787119491.980110:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9745 00002000:00100000:3.0:1787119491.980123:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (24358912->24363007) req@ffff92a506e5bb80 x1873929633365760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.980123:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (16412672->16437247) req@ffff92a519c68380 x1873929633365504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/440 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.980156:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68380 with x1873929633365504 ext(16412672->16437247) 00002000:00100000:3.0:1787119491.980157:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5bb80 with x1873929633365760 ext(24358912->24363007) 00002000:00010000:1.0:1787119491.980162:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c68380 00002000:00010000:3.0:1787119491.980164:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e5bb80 00000100:00100000:1.0:1787119491.980178:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633365888 00000100:00100000:1.0:1787119491.980182:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633365888 00000100:00100000:3.0:1787119491.980191:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9746 00002000:00100000:1.0:1787119491.980197:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (49971200->49975295) req@ffff92a506e5aa00 x1873929633365888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/0 e 0 to 0 dl 1787119502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119491.980206:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633365632:12345-192.168.201.59@tcp:10:fsx.0 00002000:00100000:1.0:1787119491.980206:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5aa00 with x1873929633365888 ext(49971200->49975295) 00002000:00010000:1.0:1787119491.980211:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e5aa00 00000100:00100000:1.0:1787119491.980228:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9747 00000100:00100000:1.0:1787119491.980235:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633365760:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:3.0:1787119491.980433:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 22177220 -> 45345609 00002000:00010000:3.0:1787119491.980476:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119491.980480:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00000100:00100000:1.0:1787119491.980484:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633365760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 247us (533us total) trans 0 rc 4096/4096 00002000:00010000:3.0:1787119491.980485:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119491.980491:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1037 -> 1037 00000100:00100000:1.0:1787119491.980499:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9747 00002000:00100000:1.0:1787119491.980506:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (24358912->24363007) req@ffff92a506e5bb80 x1873929633365760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.980515:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5bb80 with x1873929633365760 ext(24358912->24363007) 00002000:00010000:1.0:1787119491.980528:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e5bb80 00000100:00100000:3.0:1787119491.980533:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633365632:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 319us (685us total) trans 4294969093 rc 0/0 00000100:00100000:3.0:1787119491.980544:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9746 00002000:00010000:3.0:1787119491.980548:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (45345609->18446744073709551615) 00000100:00100000:1.0:1787119491.980638:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9748 00000100:00100000:1.0:1787119491.980647:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633365888:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119491.981044:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633365888:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 398us (1070us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119491.981052:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9748 00002000:00100000:1.0:1787119491.981059:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (49971200->49975295) req@ffff92a506e5aa00 x1873929633365888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:527/0 lens 488/4536 e 0 to 0 dl 1787119502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119491.981067:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5aa00 with x1873929633365888 ext(49971200->49975295) 00002000:00010000:1.0:1787119491.981070:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e5aa00 00002000:00100000:3.0:1787119491.981733:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58e00 with x1873929633365632 ext(45345609->18446744073709551615) 00002000:00010000:3.0:1787119491.981744:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e58e00. 00000100:00100000:3.0:1787119491.981809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119491.984117:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633366144 00000100:00100000:0.0:1787119491.984130:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633366144 00000100:00100000:0.0:1787119491.984200:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19539 00000100:00100000:0.0:1787119491.984211:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+208:32727:x1873929633366144:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119491.984266:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119491.984291:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b5b expref: 208 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.984309:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119491.984313:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119491.984864:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.984880:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119491.984890:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119491.984941:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976354 00000004:00010000:0.0:1787119491.984966:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aee8fb82 reply state 000000005babfcc9 transno 4294976355 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119491.984975:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119491.985075:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+210:32727:x1873929633366144:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 864us (3265us total) trans 4294976355 rc 0/0 00000100:00100000:0.0:1787119491.985082:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19539 00000020:00080000:0.0:1787119491.985087:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787119491.997638:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.997658:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.997676:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.997683:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119491.997689:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.997697:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.997717:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119491.997720:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119491.997725:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119491.997732:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2ce2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119492.000072:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.000110:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.000142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.000228:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633366272 00000100:00100000:1.0:1787119492.000238:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633366272 00002000:00100000:1.0:1787119492.000287:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (49946624->49991679) req@ffff92a519c6b800 x1873929633366272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.000300:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b800 with x1873929633366272 ext(49946624->49991679) 00002000:00010000:1.0:1787119492.000305:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6b800 00000100:00100000:1.0:1787119492.000336:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633366528 00000100:00100000:1.0:1787119492.000339:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633366528 00002000:00100000:1.0:1787119492.000353:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (24334336->24399871) req@ffff92a519c6a680 x1873929633366528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.000362:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a680 with x1873929633366528 ext(24334336->24399871) 00002000:00010000:1.0:1787119492.000365:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6a680 00000100:00100000:1.0:1787119492.000374:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633366400 00000100:00100000:1.0:1787119492.000376:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633366400 00002000:00010000:1.0:1787119492.000387:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (22177220->18446744073709551615) 00002000:00100000:1.0:1787119492.000390:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68700 with x1873929633366400 ext(22177220->18446744073709551615) 00002000:00010000:1.0:1787119492.000400:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c68700. 00000100:00100000:1.0:1787119492.000412:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9749 00000100:00100000:1.0:1787119492.000421:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633366272:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.000870:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9750 00000100:00100000:0.0:1787119492.000881:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633366528:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.001421:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9751 00000100:00100000:3.0:1787119492.001433:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633366400:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119492.002905:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 1008584 -> 22177220 00002000:00010000:3.0:1787119492.002914:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119489 -> 1787119490 00002000:00010000:3.0:1787119492.002917:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119489 -> 1787119490 00002000:00010000:3.0:1787119492.002919:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119489 -> 1787119490 00002000:00010000:3.0:1787119492.002921:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1805 -> 1037 00000100:00100000:3.0:1787119492.002986:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633366400:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1553us (2840us total) trans 4294969094 rc 0/0 00000100:00100000:3.0:1787119492.002996:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9751 00002000:00010000:3.0:1787119492.003001:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (22177220->18446744073709551615) 00002000:00100000:3.0:1787119492.003004:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68700 with x1873929633366400 ext(22177220->18446744073709551615) 00002000:00010000:3.0:1787119492.003011:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c68700. 00000100:00100000:1.0:1787119492.003252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.003355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.003427:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633366656 00000100:00100000:0.0:1787119492.003435:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633366656 00000100:00100000:0.0:1787119492.003515:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19540 00000100:00100000:0.0:1787119492.003532:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+209:32729:x1873929633366656:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119492.003551:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119492.003570:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2ce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b8c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.003653:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2cf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.003680:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.003692:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119492.003719:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 45345609 00000004:00200000:0.0:1787119492.003724:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119492.003741:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.003767:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2ce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b8c expref: 211 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.003785:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b8c expref: 210 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.003798:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119492.003801:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119492.003805:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa200, rc 0) 00000100:00100000:0.0:1787119492.003837:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+210:32729:x1873929633366656:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 307us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119492.003843:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19540 00000100:00100000:3.0:1787119492.004255:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633366784 00000100:00100000:3.0:1787119492.004261:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633366784 00002000:00100000:3.0:1787119492.004289:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (24756224->24760319) req@ffff92a5069e1c00 x1873929633366784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.004298:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1c00 with x1873929633366784 ext(24756224->24760319) 00002000:00010000:3.0:1787119492.004302:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e1c00 00000100:00100000:3.0:1787119492.004325:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9752 00000100:00100000:3.0:1787119492.004334:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633366784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.004834:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633366784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 499us (1579us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.004842:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9752 00002000:00100000:3.0:1787119492.004848:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (24756224->24760319) req@ffff92a5069e1c00 x1873929633366784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.004856:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1c00 with x1873929633366784 ext(24756224->24760319) 00002000:00010000:3.0:1787119492.004859:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e1c00 00000100:00100000:3.0:1787119492.013702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.013801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.013957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.014013:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633366912 00000100:00100000:0.0:1787119492.014023:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633366912 00000100:00100000:0.0:1787119492.014079:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19541 00000100:00100000:0.0:1787119492.014089:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+210:32727:x1873929633366912:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119492.014110:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119492.014132:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fbe00/0xcaba3de8463e2cf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.014215:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2cfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.014229:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.014238:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119492.014263:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 22177220 00000004:00200000:0.0:1787119492.014268:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119492.014287:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.014318:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fbe00/0xcaba3de8463e2cf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b93 expref: 212 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.014335:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b93 expref: 211 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.014344:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119492.014347:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119492.014351:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb800, rc 0) 00000100:00100000:0.0:1787119492.014405:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+211:32727:x1873929633366912:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 317us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119492.014412:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19541 00000100:00100000:0.0:1787119492.019363:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633366528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18472us (19239us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119492.019378:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9750 00002000:00100000:0.0:1787119492.019392:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (24334336->24399871) req@ffff92a519c6a680 x1873929633366528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.019402:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a680 with x1873929633366528 ext(24334336->24399871) 00002000:00010000:0.0:1787119492.019408:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6a680 00000100:00100000:1.0:1787119492.019912:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633367040 00000100:00100000:1.0:1787119492.019921:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633367040 00002000:00100000:1.0:1787119492.019960:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (24768512->24772607) req@ffff92a506e5b800 x1873929633367040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.019971:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b800 with x1873929633367040 ext(24768512->24772607) 00002000:00010000:1.0:1787119492.019974:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b800 00000100:00100000:1.0:1787119492.020000:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633367168 00000100:00100000:1.0:1787119492.020004:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633367168 00002000:00100000:1.0:1787119492.020020:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (24227840->24240127) req@ffff92a506e5b480 x1873929633367168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.020028:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b480 with x1873929633367168 ext(24227840->24240127) 00002000:00010000:1.0:1787119492.020031:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b480 00000100:00100000:1.0:1787119492.020051:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9753 00000100:00100000:1.0:1787119492.020060:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633367040:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.020263:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633367040:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 204us (6462us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119492.020270:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9753 00002000:00100000:1.0:1787119492.020275:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (24768512->24772607) req@ffff92a506e5b800 x1873929633367040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.020283:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b800 with x1873929633367040 ext(24768512->24772607) 00002000:00010000:1.0:1787119492.020286:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b800 00000100:00100000:1.0:1787119492.020300:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9754 00000100:00100000:1.0:1787119492.020306:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633367168:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.020396:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633367168:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 90us (6440us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119492.020402:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9754 00002000:00100000:1.0:1787119492.020407:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (24227840->24240127) req@ffff92a506e5b480 x1873929633367168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/12728 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.020414:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b480 with x1873929633367168 ext(24227840->24240127) 00002000:00010000:1.0:1787119492.020417:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b480 00000100:00100000:0.0:1787119492.020915:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633366272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20492us (20851us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119492.020923:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9749 00002000:00100000:0.0:1787119492.020929:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (49946624->49991679) req@ffff92a519c6b800 x1873929633366272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.020944:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b800 with x1873929633366272 ext(49946624->49991679) 00002000:00010000:0.0:1787119492.020948:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6b800 00000100:00100000:1.0:1787119492.026776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.026833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.027382:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633367296 00000100:00100000:3.0:1787119492.027475:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633367296 00002000:00100000:3.0:1787119492.027543:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (31031296->31076351) req@ffff92a5069e1f80 x1873929633367296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.027554:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1f80 with x1873929633367296 ext(31031296->31076351) 00002000:00010000:3.0:1787119492.027560:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e1f80 00000100:00100000:0.0:1787119492.027600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.030082:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633367424 00000100:00100000:3.0:1787119492.030089:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633367552 00000100:00100000:3.0:1787119492.030102:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633367552 00000100:00100000:2.0:1787119492.030102:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633367424 00002000:00100000:2.0:1787119492.030184:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (24399872->24436735) req@ffff92a5069e0000 x1873929633367424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.030185:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (36225024->36229119) req@ffff92a519cd5500 x1873929633367552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.030207:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0000 with x1873929633367424 ext(24399872->24436735) 00002000:00100000:3.0:1787119492.030216:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5500 with x1873929633367552 ext(36225024->36229119) 00002000:00010000:2.0:1787119492.030218:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e0000 00002000:00010000:3.0:1787119492.030225:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5500 00000100:00100000:1.0:1787119492.030290:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9755 00000100:00100000:1.0:1787119492.030305:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633367296:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.030400:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9756 00000100:00100000:2.0:1787119492.030410:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633367424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.032947:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9757 00000100:00100000:1.0:1787119492.033160:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633367552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.034173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.034207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.034222:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633367680 00000100:00100000:2.0:1787119492.034230:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633367680 00002000:00100000:2.0:1787119492.034268:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (49967104->49988591) req@ffff92a506e59c00 x1873929633367680/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.034279:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59c00 with x1873929633367680 ext(49967104->49988591) 00002000:00010000:2.0:1787119492.034284:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59c00 00000100:00100000:1.0:1787119492.034311:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633367552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1350us (6713us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.034314:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9758 00000100:00100000:1.0:1787119492.034327:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9757 00000100:00100000:2.0:1787119492.034328:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633367680:12345-192.168.201.59@tcp:4:fsx.0 00002000:00100000:1.0:1787119492.034338:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (36225024->36229119) req@ffff92a519cd5500 x1873929633367552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.034349:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd5500 with x1873929633367552 ext(36225024->36229119) 00002000:00010000:1.0:1787119492.034353:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd5500 00000100:00100000:1.0:1787119492.034713:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633367936 00000100:00100000:1.0:1787119492.034718:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633367936 00000100:00100000:1.0:1787119492.034763:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19542 00000100:00100000:1.0:1787119492.034771:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+211:32727:x1873929633367936:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119492.034816:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119492.034844:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2cfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b93 expref: 211 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.034864:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119492.034869:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119492.035068:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.035082:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.035092:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119492.035144:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976356 00000004:00010000:1.0:1787119492.035170:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dace2efe reply state 000000007d55b7f2 transno 4294976357 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119492.035179:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119492.035873:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+213:32727:x1873929633367936:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1100us (1663us total) trans 4294976357 rc 0/0 00000100:00100000:1.0:1787119492.035882:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19542 00000020:00080000:1.0:1787119492.035887:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119492.036235:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633367296:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5933us (9469us total) trans 0 rc 45056/45056 00000100:00100000:1.0:1787119492.036243:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9755 00002000:00100000:1.0:1787119492.036251:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (31031296->31076351) req@ffff92a5069e1f80 x1873929633367296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.036261:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1f80 with x1873929633367296 ext(31031296->31076351) 00002000:00010000:1.0:1787119492.036266:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e1f80 00000100:00100000:2.0:1787119492.037255:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633367424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6842us (10418us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119492.037267:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9756 00002000:00100000:2.0:1787119492.037275:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (24399872->24436735) req@ffff92a5069e0000 x1873929633367424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.037283:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0000 with x1873929633367424 ext(24399872->24436735) 00002000:00010000:2.0:1787119492.037287:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e0000 00010000:00010000:2.0:1787119492.038875:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.038900:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.038912:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.038923:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119492.038933:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.038947:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.038974:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119492.038977:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119492.038981:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.038987:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2d05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.040891:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633367680:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 6556us (6710us total) trans 4294968850 rc 0/0 00000100:00100000:3.0:1787119492.040905:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9758 00002000:00100000:3.0:1787119492.040919:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (49967104->49988591) req@ffff92a506e59c00 x1873929633367680/t4294968850(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/448 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.040929:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59c00 with x1873929633367680 ext(49967104->49988591) 00002000:00010000:3.0:1787119492.040934:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59c00 00000100:00100000:2.0:1787119492.041500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.041723:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633368064 00000100:00100000:3.0:1787119492.041733:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633368064 00002000:00100000:3.0:1787119492.041772:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (1011712->1015807) req@ffff92a519c69c00 x1873929633368064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.041783:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69c00 with x1873929633368064 ext(1011712->1015807) 00002000:00010000:3.0:1787119492.041787:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c69c00 00000100:00100000:3.0:1787119492.041822:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9759 00000100:00100000:3.0:1787119492.041832:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633368064:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.042034:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633368064:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 203us (536us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.042042:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9759 00002000:00100000:3.0:1787119492.042048:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (1011712->1015807) req@ffff92a519c69c00 x1873929633368064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.042056:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69c00 with x1873929633368064 ext(1011712->1015807) 00002000:00010000:3.0:1787119492.042059:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c69c00 00000100:00100000:0.0:1787119492.044576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.044627:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633368192 00000100:00100000:1.0:1787119492.044637:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633368192 00000100:00100000:0.0:1787119492.044642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00010000:1.0:1787119492.044676:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (45345609->18446744073709551615) 00002000:00100000:1.0:1787119492.044681:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb100 with x1873929633368192 ext(45345609->18446744073709551615) 00002000:00010000:1.0:1787119492.044693:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb100. 00000100:00100000:1.0:1787119492.044726:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633368320 00000100:00100000:1.0:1787119492.044730:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633368320 00002000:00100000:1.0:1787119492.044751:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (36229120->36233215) req@ffff92a6072f9f80 x1873929633368320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.044762:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9f80 with x1873929633368320 ext(36229120->36233215) 00002000:00010000:1.0:1787119492.044766:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9f80 00000100:00100000:1.0:1787119492.044787:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9760 00000100:00100000:1.0:1787119492.044795:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633368192:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:0.0:1787119492.044821:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9761 00000100:00100000:0.0:1787119492.044833:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633368320:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:1.0:1787119492.045015:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 22177220 -> 45345609 00002000:00010000:1.0:1787119492.045020:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119492.045022:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119492.045024:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119492.045026:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1037 -> 1037 00000100:00100000:1.0:1787119492.045078:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633368192:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 282us (512us total) trans 4294969095 rc 0/0 00000100:00100000:1.0:1787119492.045086:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9760 00002000:00010000:1.0:1787119492.045090:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (45345609->18446744073709551615) 00002000:00100000:1.0:1787119492.045093:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb100 with x1873929633368192 ext(45345609->18446744073709551615) 00002000:00010000:1.0:1787119492.045097:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb100. 00000100:00100000:0.0:1787119492.045747:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633368320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 913us (1102us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.045756:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9761 00002000:00100000:0.0:1787119492.045765:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (36229120->36233215) req@ffff92a6072f9f80 x1873929633368320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.045776:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9f80 with x1873929633368320 ext(36229120->36233215) 00002000:00010000:0.0:1787119492.045780:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9f80 00000100:00100000:0.0:1787119492.046159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.046234:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633368448 00000100:00100000:1.0:1787119492.046241:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633368448 00000100:00100000:1.0:1787119492.046317:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5013 00000100:00100000:1.0:1787119492.046327:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633368448:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119492.055048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.055085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.055113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.055149:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633368576 00000100:00100000:3.0:1787119492.055158:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633368576 00002000:00100000:3.0:1787119492.055207:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (1015808->1019903) req@ffff92a506e59180 x1873929633368576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.055220:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59180 with x1873929633368576 ext(1015808->1019903) 00002000:00010000:3.0:1787119492.055226:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59180 00000100:00100000:3.0:1787119492.055244:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633368832 00000100:00100000:3.0:1787119492.055247:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633368832 00002000:00100000:3.0:1787119492.055264:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (36204544->36270079) req@ffff92a506e59500 x1873929633368832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.055273:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59500 with x1873929633368832 ext(36204544->36270079) 00002000:00010000:3.0:1787119492.055277:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e59500 00000100:00100000:3.0:1787119492.055293:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9762 00000100:00100000:3.0:1787119492.055303:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633368576:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.055577:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633368576:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 274us (535us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.055584:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9762 00002000:00100000:3.0:1787119492.055601:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (1015808->1019903) req@ffff92a506e59180 x1873929633368576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.055610:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59180 with x1873929633368576 ext(1015808->1019903) 00002000:00010000:3.0:1787119492.055614:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59180 00000100:00100000:3.0:1787119492.055631:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9763 00000100:00100000:3.0:1787119492.055638:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633368832:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.056616:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633368704 00000100:00100000:0.0:1787119492.056625:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633368704 00000100:00100000:0.0:1787119492.056664:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19543 00000100:00100000:0.0:1787119492.056673:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+212:32727:x1873929633368704:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119492.056690:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119492.056711:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e2d0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715b9a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.056795:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2d13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.056806:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.056814:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119492.056833:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 45345609 00000004:00200000:0.0:1787119492.056836:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119492.056850:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.056871:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e2d0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b9a expref: 214 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.056882:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b9a expref: 213 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.056888:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119492.056890:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119492.056893:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fae00, rc 0) 00000100:00100000:0.0:1787119492.056925:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+213:32727:x1873929633368704:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 254us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119492.056930:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19543 00000100:00100000:0.0:1787119492.056981:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.057218:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633368960 00000100:00100000:1.0:1787119492.057223:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633368960 00002000:00100000:1.0:1787119492.057249:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (21684224->21688319) req@ffff92a6072f9c00 x1873929633368960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.057258:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9c00 with x1873929633368960 ext(21684224->21688319) 00002000:00010000:1.0:1787119492.057263:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9c00 00000100:00100000:1.0:1787119492.057291:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9764 00000100:00100000:1.0:1787119492.057298:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633368960:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.058669:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633368960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1363us (1679us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119492.058679:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9764 00002000:00100000:1.0:1787119492.058687:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (21684224->21688319) req@ffff92a6072f9c00 x1873929633368960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.058697:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9c00 with x1873929633368960 ext(21684224->21688319) 00002000:00010000:1.0:1787119492.058701:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9c00 00000100:00100000:3.0:1787119492.064287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.064330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.064704:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633369088 00000100:00100000:0.0:1787119492.064714:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633369088 00002000:00100000:0.0:1787119492.064764:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (1019904->1056767) req@ffff92a506e59f80 x1873929633369088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.064776:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59f80 with x1873929633369088 ext(1019904->1056767) 00002000:00010000:0.0:1787119492.064782:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59f80 00000100:00100000:0.0:1787119492.064888:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633369216 00000100:00100000:0.0:1787119492.064893:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633369216 00002000:00100000:0.0:1787119492.064912:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (24227840->24240127) req@ffff92a506e5b100 x1873929633369216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.064919:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b100 with x1873929633369216 ext(24227840->24240127) 00002000:00010000:0.0:1787119492.064922:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b100 00000100:00100000:0.0:1787119492.064940:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9765 00000100:00100000:0.0:1787119492.064949:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633369088:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.064979:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9766 00000100:00100000:2.0:1787119492.064987:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633369216:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.065284:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633369216:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 296us (952us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119492.065291:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9766 00002000:00100000:2.0:1787119492.065298:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (24227840->24240127) req@ffff92a506e5b100 x1873929633369216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/12728 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.065307:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e5b100 with x1873929633369216 ext(24227840->24240127) 00002000:00010000:2.0:1787119492.065310:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e5b100 00010000:00010000:1.0:1787119492.068966:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119492.078322:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633368832:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22673us (23198us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119492.078337:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9763 00002000:00100000:3.0:1787119492.078351:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (36204544->36270079) req@ffff92a506e59500 x1873929633368832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.078362:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59500 with x1873929633368832 ext(36204544->36270079) 00002000:00010000:3.0:1787119492.078368:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506e59500 00000100:00100000:2.0:1787119492.087034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.087071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.087091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.087312:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633369472 00000100:00100000:1.0:1787119492.087312:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633369088:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22361us (23033us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119492.087320:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633369472 00000100:00100000:1.0:1787119492.087325:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9765 00002000:00100000:1.0:1787119492.087337:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (1019904->1056767) req@ffff92a506e59f80 x1873929633369088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.087346:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e59f80 with x1873929633369088 ext(1019904->1056767) 00002000:00010000:1.0:1787119492.087351:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e59f80 00002000:00100000:3.0:1787119492.087356:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (36225024->36229119) req@ffff92a519c69500 x1873929633369472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.087364:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69500 with x1873929633369472 ext(36225024->36229119) 00000100:00100000:1.0:1787119492.087367:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633369344 00002000:00010000:3.0:1787119492.087368:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69500 00000100:00100000:1.0:1787119492.087369:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633369344 00002000:00100000:1.0:1787119492.087384:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (21688320->21692415) req@ffff92a519c6b100 x1873929633369344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.087392:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b100 with x1873929633369344 ext(21688320->21692415) 00000100:00100000:3.0:1787119492.087394:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633369600 00002000:00010000:1.0:1787119492.087395:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6b100 00000100:00100000:3.0:1787119492.087396:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633369600 00002000:00100000:3.0:1787119492.087409:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (36270080->36306943) req@ffff92a519c69f80 x1873929633369600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787119492.087409:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9767 00002000:00100000:3.0:1787119492.087417:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69f80 with x1873929633369600 ext(36270080->36306943) 00000100:00100000:1.0:1787119492.087418:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633369472:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:3.0:1787119492.087420:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69f80 00000100:00100000:3.0:1787119492.087434:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9768 00000100:00100000:3.0:1787119492.087458:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633369344:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.087654:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633369344:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 213us (581us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.087661:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9768 00002000:00100000:3.0:1787119492.087666:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (21688320->21692415) req@ffff92a519c6b100 x1873929633369344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.087673:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b100 with x1873929633369344 ext(21688320->21692415) 00002000:00010000:3.0:1787119492.087677:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6b100 00000100:00100000:3.0:1787119492.087693:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9769 00000100:00100000:3.0:1787119492.087700:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633369600:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.087756:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633369472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 338us (732us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119492.087763:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9767 00002000:00100000:1.0:1787119492.087768:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (36225024->36229119) req@ffff92a519c69500 x1873929633369472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.087775:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69500 with x1873929633369472 ext(36225024->36229119) 00002000:00010000:1.0:1787119492.087778:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69500 00000100:00100000:1.0:1787119492.091752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.091859:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633369600:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4157us (4764us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119492.091872:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9769 00002000:00100000:3.0:1787119492.091885:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (36270080->36306943) req@ffff92a519c69f80 x1873929633369600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.091895:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69f80 with x1873929633369600 ext(36270080->36306943) 00002000:00010000:3.0:1787119492.091902:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c69f80 00000100:00100000:3.0:1787119492.091923:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633369728 00000100:00100000:3.0:1787119492.091930:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633369728 00002000:00100000:3.0:1787119492.091960:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (36229120->36233215) req@ffff92a5069e2a00 x1873929633369728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.091969:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2a00 with x1873929633369728 ext(36229120->36233215) 00002000:00010000:3.0:1787119492.091972:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2a00 00000100:00100000:3.0:1787119492.091997:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9770 00000100:00100000:3.0:1787119492.092006:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633369728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.092402:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633369728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 395us (660us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.092409:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9770 00002000:00100000:3.0:1787119492.092414:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (36229120->36233215) req@ffff92a5069e2a00 x1873929633369728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.092422:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2a00 with x1873929633369728 ext(36229120->36233215) 00002000:00010000:3.0:1787119492.092425:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2a00 00000100:00100000:2.0:1787119492.100598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.100633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.101825:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633369856 00000100:00100000:0.0:1787119492.101836:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633369856 00002000:00100000:0.0:1787119492.101897:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (21663744->21729279) req@ffff92a519c6a300 x1873929633369856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.101907:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a300 with x1873929633369856 ext(21663744->21729279) 00002000:00010000:0.0:1787119492.101912:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6a300 00000100:00100000:0.0:1787119492.101941:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633369984 00000100:00100000:0.0:1787119492.101944:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633369984 00002000:00100000:0.0:1787119492.101962:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (1056768->1093631) req@ffff92a519c6aa00 x1873929633369984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.101970:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6aa00 with x1873929633369984 ext(1056768->1093631) 00002000:00010000:0.0:1787119492.101974:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6aa00 00000100:00100000:0.0:1787119492.101988:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9771 00000100:00100000:0.0:1787119492.101996:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633369856:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.102525:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9772 00000100:00100000:2.0:1787119492.102537:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633369984:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.104026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.104070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.104141:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633370112 00000100:00100000:2.0:1787119492.104149:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633370112 00002000:00100000:2.0:1787119492.104188:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (36204544->36270079) req@ffff92a6072fb480 x1873929633370112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.104199:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb480 with x1873929633370112 ext(36204544->36270079) 00002000:00010000:2.0:1787119492.104204:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb480 00000100:00100000:2.0:1787119492.104231:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633370240 00000100:00100000:2.0:1787119492.104235:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633370240 00002000:00100000:2.0:1787119492.104250:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (16412672->16437247) req@ffff92a6072faa00 x1873929633370240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.104259:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072faa00 with x1873929633370240 ext(16412672->16437247) 00002000:00010000:2.0:1787119492.104263:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072faa00 00000100:00100000:3.0:1787119492.104268:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9773 00000100:00100000:3.0:1787119492.104278:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633370112:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.104854:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9774 00000100:00100000:2.0:1787119492.104864:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633370240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.110590:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633369856:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8580us (9989us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119492.110604:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9771 00002000:00100000:2.0:1787119492.110616:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (21663744->21729279) req@ffff92a519c6a300 x1873929633369856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.110626:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a300 with x1873929633369856 ext(21663744->21729279) 00002000:00010000:2.0:1787119492.110632:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6a300 00000100:00100000:1.0:1787119492.111743:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633369984:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9203us (11102us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119492.111758:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9772 00002000:00100000:1.0:1787119492.111768:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (1056768->1093631) req@ffff92a519c6aa00 x1873929633369984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.111777:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6aa00 with x1873929633369984 ext(1056768->1093631) 00002000:00010000:1.0:1787119492.111782:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6aa00 00000001:00080000:2.0:1787119492.112163:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968850 is committed 00000100:00100000:2.0:1787119492.112248:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633370240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7384us (8176us total) trans 0 rc 24576/24576 00000100:00100000:2.0:1787119492.112255:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9774 00002000:00100000:2.0:1787119492.112262:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (16412672->16437247) req@ffff92a6072faa00 x1873929633370240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.112270:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072faa00 with x1873929633370240 ext(16412672->16437247) 00002000:00010000:2.0:1787119492.112274:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072faa00 00000100:00100000:3.0:1787119492.112462:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633370112:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8184us (8443us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119492.112465:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633368448:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 66140us (66370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119492.112471:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9773 00000100:00100000:1.0:1787119492.112472:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5013 00002000:00100000:3.0:1787119492.112478:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (36204544->36270079) req@ffff92a6072fb480 x1873929633370112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.112486:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb480 with x1873929633370112 ext(36204544->36270079) 00002000:00010000:3.0:1787119492.112489:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb480 00000100:00100000:0.0:1787119492.122274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.123650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.123688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.123786:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633370496 00000100:00100000:3.0:1787119492.123796:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633370496 00000100:00100000:3.0:1787119492.123924:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19544 00000100:00100000:3.0:1787119492.123935:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+213:32724:x1873929633370496:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119492.123957:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119492.123980:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a642177000/0xcaba3de8463e2d1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ba1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.124082:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2d21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.124097:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.124108:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119492.124134:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 49988592 00000004:00200000:3.0:1787119492.124138:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119492.124159:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.124185:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a642177000/0xcaba3de8463e2d1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ba1 expref: 215 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.124203:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ba1 expref: 214 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.124210:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119492.124213:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119492.124216:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a642176a00, rc 0) 00000100:00100000:3.0:1787119492.124269:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+214:32724:x1873929633370496:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 337us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119492.124276:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19544 00000100:00100000:0.0:1787119492.126933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.129228:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633370368 00000100:00100000:1.0:1787119492.129245:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633370368 00002000:00100000:1.0:1787119492.129303:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (21729280->21766143) req@ffff92a6072f8700 x1873929633370368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.129314:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8700 with x1873929633370368 ext(21729280->21766143) 00002000:00010000:1.0:1787119492.129321:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8700 00000100:00100000:1.0:1787119492.129367:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633370624 00000100:00100000:1.0:1787119492.129372:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633370624 00002000:00100000:1.0:1787119492.129395:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (24756224->24760319) req@ffff92a6072f9500 x1873929633370624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.129413:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9500 with x1873929633370624 ext(24756224->24760319) 00002000:00010000:1.0:1787119492.129417:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9500 00000100:00100000:0.0:1787119492.129975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.130013:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633370752 00000100:00100000:2.0:1787119492.130019:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633370752 00002000:00100000:2.0:1787119492.130044:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (36270080->36306943) req@ffff92a512846a00 x1873929633370752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.130054:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633370752 ext(36270080->36306943) 00002000:00010000:2.0:1787119492.130058:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846a00 00000100:00100000:2.0:1787119492.130082:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9775 00000100:00100000:2.0:1787119492.130091:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633370368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.130853:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9776 00000100:00100000:2.0:1787119492.130870:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633370624:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.131068:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633370624:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 202us (7377us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.131079:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9776 00002000:00100000:2.0:1787119492.131089:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (24756224->24760319) req@ffff92a6072f9500 x1873929633370624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.131100:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9500 with x1873929633370624 ext(24756224->24760319) 00002000:00010000:2.0:1787119492.131106:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9500 00000100:00100000:2.0:1787119492.131133:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9777 00000100:00100000:2.0:1787119492.131143:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633370752:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.135240:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633370880 00000100:00100000:2.0:1787119492.135255:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633370880 00002000:00100000:2.0:1787119492.135310:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (33882112->33943551) req@ffff92a512844e00 x1873929633370880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.135321:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844e00 with x1873929633370880 ext(33882112->33943551) 00002000:00010000:2.0:1787119492.135327:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844e00 00000100:00100000:2.0:1787119492.135649:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9778 00000100:00100000:2.0:1787119492.135661:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633370880:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.137810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.137914:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633370368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7821us (15648us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119492.137927:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9775 00002000:00100000:2.0:1787119492.137941:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (21729280->21766143) req@ffff92a6072f8700 x1873929633370368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.137951:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8700 with x1873929633370368 ext(21729280->21766143) 00002000:00010000:2.0:1787119492.137957:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8700 00000100:00100000:3.0:1787119492.138037:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633371136 00000100:00100000:3.0:1787119492.138045:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633371136 00000100:00100000:3.0:1787119492.138098:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19545 00000100:00100000:3.0:1787119492.138107:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+214:32724:x1873929633371136:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119492.138198:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119492.138226:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a642176a00/0xcaba3de8463e2d21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ba1 expref: 214 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.138245:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119492.138250:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119492.138936:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.138954:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.138965:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119492.139024:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976358 00000004:00010000:3.0:1787119492.139051:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef5335aa reply state 000000002657e957 transno 4294976359 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.139061:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119492.139148:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+216:32724:x1873929633371136:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1041us (1349us total) trans 4294976359 rc 0/0 00000100:00100000:3.0:1787119492.139157:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19545 00000020:00080000:3.0:1787119492.139161:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119492.141251:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633370752:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10099us (14319us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119492.141265:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9777 00002000:00100000:2.0:1787119492.141278:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (36270080->36306943) req@ffff92a512846a00 x1873929633370752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.141289:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633370752 ext(36270080->36306943) 00002000:00010000:2.0:1787119492.141295:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846a00 00000100:00100000:3.0:1787119492.141506:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633370880:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5847us (11532us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1787119492.141514:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9778 00002000:00100000:3.0:1787119492.141531:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (33882112->33943551) req@ffff92a512844e00 x1873929633370880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.141539:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844e00 with x1873929633370880 ext(33882112->33943551) 00002000:00010000:3.0:1787119492.141543:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844e00 00000100:00100000:0.0:1787119492.147337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.147381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119492.147478:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.147491:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.147498:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.147514:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c64c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119492.147526:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.147534:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.147551:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119492.147554:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119492.147559:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.147566:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119492.147597:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633371392 00000100:00100000:2.0:1787119492.147607:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633371392 00002000:00100000:2.0:1787119492.147654:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (24768512->24772607) req@ffff92a512844380 x1873929633371392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.147669:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844380 with x1873929633371392 ext(24768512->24772607) 00002000:00010000:2.0:1787119492.147674:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844380 00000100:00100000:1.0:1787119492.147701:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633371264 00000100:00100000:1.0:1787119492.147706:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633371264 00000100:00100000:2.0:1787119492.147715:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9779 00000100:00100000:2.0:1787119492.147724:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633371392:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:1.0:1787119492.147726:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (62516461->18446744073709551615) 00002000:00100000:1.0:1787119492.147729:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633371264 ext(62516461->18446744073709551615) 00002000:00010000:1.0:1787119492.147738:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844a80. 00000100:00100000:1.0:1787119492.147765:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9780 00000100:00100000:1.0:1787119492.147771:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633371264:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:2.0:1787119492.147972:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633371392:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 247us (646us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.147980:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9779 00002000:00100000:2.0:1787119492.147986:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (24768512->24772607) req@ffff92a512844380 x1873929633371392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.147995:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844380 with x1873929633371392 ext(24768512->24772607) 00002000:00010000:2.0:1787119492.147998:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844380 00002000:00010000:1.0:1787119492.148054:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 49988592 -> 62516461 00002000:00010000:1.0:1787119492.148058:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119492.148060:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119489 -> 1787119490 00002000:00010000:1.0:1787119492.148062:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119492.148064:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1549 -> 1421 00000100:00100000:1.0:1787119492.148092:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633371264:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 320us (710us total) trans 4294968851 rc 0/0 00000100:00100000:1.0:1787119492.148098:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9780 00002000:00010000:1.0:1787119492.148102:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (62516461->18446744073709551615) 00002000:00100000:1.0:1787119492.148104:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633371264 ext(62516461->18446744073709551615) 00002000:00010000:1.0:1787119492.148109:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844a80. 00000100:00100000:0.0:1787119492.153806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.153937:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633371648 00000100:00100000:1.0:1787119492.153948:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633371648 00000100:00100000:1.0:1787119492.154092:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19546 00000100:00100000:1.0:1787119492.154104:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+215:32720:x1873929633371648:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119492.154162:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119492.154190:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2c79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b69 expref: 215 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.154214:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119492.154219:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119492.154494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.154562:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633371776 00000100:00100000:2.0:1787119492.154568:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633371776 00000100:00100000:2.0:1787119492.154603:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19547 00000100:00100000:2.0:1787119492.154611:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+216:32724:x1873929633371776:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119492.154620:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119492.154638:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2d2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ba8 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.154714:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2d36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.154729:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.154739:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119492.154762:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 62516461 00000004:00200000:2.0:1787119492.154766:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119492.154784:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.154809:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2d2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ba8 expref: 218 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.154822:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2d36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ba8 expref: 217 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.154829:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119492.154832:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119492.154835:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1400, rc 0) 00000100:00100000:2.0:1787119492.154896:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+217:32724:x1873929633371776:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 285us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119492.154902:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19547 00010000:00010000:1.0:1787119492.155173:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.155187:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.155194:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119492.155262:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976360 00000004:00010000:1.0:1787119492.155292:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083bf95c4 reply state 0000000081ac4c43 transno 4294976361 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119492.155301:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119492.155369:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+218:32720:x1873929633371648:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1267us (1576us total) trans 4294976361 rc 0/0 00000100:00100000:1.0:1787119492.155376:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19546 00000020:00080000:1.0:1787119492.155380:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119492.162683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.162929:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633372032 00000100:00100000:2.0:1787119492.162939:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633372032 00002000:00100000:2.0:1787119492.162992:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (47022080->47026175) req@ffff92a512844000 x1873929633372032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.163003:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633372032 ext(47022080->47026175) 00002000:00010000:2.0:1787119492.163010:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844000 00000100:00100000:2.0:1787119492.163050:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9781 00000100:00100000:2.0:1787119492.163060:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633372032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.163341:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633372032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 281us (669us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.163349:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9781 00002000:00100000:2.0:1787119492.163356:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (47022080->47026175) req@ffff92a512844000 x1873929633372032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.163365:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633372032 ext(47022080->47026175) 00002000:00010000:2.0:1787119492.163368:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844000 00000100:00100000:0.0:1787119492.168294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.168339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.168376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.168422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.168469:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633372160 00000100:00100000:0.0:1787119492.168474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.168479:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633372160 00002000:00100000:3.0:1787119492.168556:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (16412672->16437247) req@ffff92a512847100 x1873929633372160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.168567:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847100 with x1873929633372160 ext(16412672->16437247) 00002000:00010000:3.0:1787119492.168572:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847100 00000100:00100000:3.0:1787119492.168602:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633371904 00000100:00100000:3.0:1787119492.168606:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633371904 00002000:00100000:3.0:1787119492.168621:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (16404480->16408575) req@ffff92a512845c00 x1873929633371904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.168629:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845c00 with x1873929633371904 ext(16404480->16408575) 00002000:00010000:3.0:1787119492.168633:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845c00 00000100:00100000:3.0:1787119492.168648:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633372288 00000100:00100000:3.0:1787119492.168651:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633372288 00002000:00010000:3.0:1787119492.168665:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (27367412->18446744073709551615) 00002000:00100000:3.0:1787119492.168668:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846300 with x1873929633372288 ext(27367412->18446744073709551615) 00002000:00010000:3.0:1787119492.168679:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512846300. 00000100:00100000:3.0:1787119492.168737:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633372416 00000100:00100000:3.0:1787119492.168740:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633372416 00002000:00100000:3.0:1787119492.168756:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (47026176->47030271) req@ffff92a5098a6300 x1873929633372416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.168764:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6300 with x1873929633372416 ext(47026176->47030271) 00002000:00010000:3.0:1787119492.168768:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a6300 00000100:00100000:3.0:1787119492.168780:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633372544 00000100:00100000:3.0:1787119492.168783:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633372544 00002000:00100000:3.0:1787119492.168797:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (31031296->31076351) req@ffff92a5098a4700 x1873929633372544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.168804:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633372544 ext(31031296->31076351) 00002000:00010000:3.0:1787119492.168808:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4700 00000100:00100000:3.0:1787119492.168825:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9782 00000100:00100000:3.0:1787119492.168834:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633372160:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.168957:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9783 00000100:00100000:1.0:1787119492.168966:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633371904:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.169061:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9784 00000100:00100000:3.0:1787119492.169068:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633372288:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:1.0:1787119492.169178:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633371904:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 213us (837us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119492.169186:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9783 00002000:00100000:1.0:1787119492.169193:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (16404480->16408575) req@ffff92a512845c00 x1873929633371904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.169200:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845c00 with x1873929633371904 ext(16404480->16408575) 00002000:00010000:1.0:1787119492.169203:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845c00 00000100:00100000:1.0:1787119492.169222:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9785 00000100:00100000:1.0:1787119492.169228:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633372416:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.169317:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633372416:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 88us (895us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119492.169324:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9785 00002000:00100000:1.0:1787119492.169329:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (47026176->47030271) req@ffff92a5098a6300 x1873929633372416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.169336:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6300 with x1873929633372416 ext(47026176->47030271) 00002000:00010000:1.0:1787119492.169339:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a6300 00002000:00010000:3.0:1787119492.169349:0:19246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 45345609 -> 27367412 00000100:00100000:1.0:1787119492.169351:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9786 00002000:00010000:3.0:1787119492.169352:0:19246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119492.169355:0:19246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119489 -> 1787119490 00000100:00100000:1.0:1787119492.169357:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633372544:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:3.0:1787119492.169358:0:19246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119492.169360:0:19246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1037 -> 1549 00000100:00100000:3.0:1787119492.169390:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633372288:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 322us (1013us total) trans 4294968852 rc 0/0 00000100:00100000:3.0:1787119492.169397:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9784 00002000:00010000:3.0:1787119492.169400:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (27367412->18446744073709551615) 00002000:00100000:3.0:1787119492.169402:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846300 with x1873929633372288 ext(27367412->18446744073709551615) 00002000:00010000:3.0:1787119492.169407:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512846300. 00010000:00010000:2.0:1787119492.170235:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.170247:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.170254:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.170260:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119492.170265:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.170271:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.170287:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119492.170290:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119492.170294:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.170300:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e2d3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119492.181011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.181054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.181150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.181176:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633372672 00000100:00100000:3.0:1787119492.181186:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633372672 00002000:00100000:3.0:1787119492.181236:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (47001600->47067135) req@ffff92a509870000 x1873929633372672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.181246:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870000 with x1873929633372672 ext(47001600->47067135) 00002000:00010000:3.0:1787119492.181252:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509870000 00000100:00100000:3.0:1787119492.181271:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633372928 00000100:00100000:3.0:1787119492.181274:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633372928 00002000:00100000:3.0:1787119492.181289:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (16408576->16412671) req@ffff92a509871f80 x1873929633372928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.181302:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871f80 with x1873929633372928 ext(16408576->16412671) 00002000:00010000:3.0:1787119492.181306:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871f80 00000100:00100000:3.0:1787119492.181321:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9787 00000100:00100000:1.0:1787119492.181326:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633372544:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11968us (12850us total) trans 0 rc 45056/45056 00000100:00100000:3.0:1787119492.181329:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633372672:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.181334:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9786 00002000:00100000:1.0:1787119492.181340:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (31031296->31076351) req@ffff92a5098a4700 x1873929633372544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.181348:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633372544 ext(31031296->31076351) 00002000:00010000:1.0:1787119492.181351:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4700 00000100:00100000:1.0:1787119492.181368:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9788 00000100:00100000:1.0:1787119492.181374:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633372928:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.181579:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633372928:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 204us (428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119492.181591:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9788 00002000:00100000:1.0:1787119492.181597:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (16408576->16412671) req@ffff92a509871f80 x1873929633372928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.181605:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871f80 with x1873929633372928 ext(16408576->16412671) 00002000:00010000:1.0:1787119492.181609:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871f80 00000100:00100000:3.0:1787119492.181903:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633372160:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13068us (13618us total) trans 0 rc 24576/24576 00000100:00100000:3.0:1787119492.181912:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9782 00002000:00100000:3.0:1787119492.181918:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (16412672->16437247) req@ffff92a512847100 x1873929633372160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.181926:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847100 with x1873929633372160 ext(16412672->16437247) 00002000:00010000:3.0:1787119492.181930:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847100 00000100:00100000:2.0:1787119492.182925:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633372800 00000100:00100000:2.0:1787119492.182935:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633372800 00000100:00100000:2.0:1787119492.182983:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19548 00000100:00100000:2.0:1787119492.182992:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+217:32720:x1873929633372800:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119492.183014:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119492.183039:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2d44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715baf expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.183130:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2d4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.183146:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.183158:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119492.183184:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 27367412 00000004:00200000:2.0:1787119492.183189:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119492.183206:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.183235:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2d44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715baf expref: 219 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.183252:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2d4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715baf expref: 218 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.183260:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119492.183263:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119492.183266:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:2.0:1787119492.183321:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+218:32720:x1873929633372800:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 329us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119492.183331:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19548 00000100:00100000:0.0:1787119492.192616:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633372672:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11277us (11550us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119492.192632:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9787 00002000:00100000:0.0:1787119492.192644:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (47001600->47067135) req@ffff92a509870000 x1873929633372672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.192656:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870000 with x1873929633372672 ext(47001600->47067135) 00002000:00010000:0.0:1787119492.192663:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509870000 00000100:00100000:3.0:1787119492.193223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.198617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.206564:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.207705:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633373056 00000100:00100000:0.0:1787119492.207719:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633373056 00002000:00100000:0.0:1787119492.207780:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (24756224->24760319) req@ffff92a506009f80 x1873929633373056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.207791:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009f80 with x1873929633373056 ext(24756224->24760319) 00002000:00010000:0.0:1787119492.207797:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506009f80 00000100:00100000:0.0:1787119492.207937:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633373184 00000100:00100000:0.0:1787119492.207942:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633373184 00002000:00100000:0.0:1787119492.207962:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (16437248->16474111) req@ffff92a509872680 x1873929633373184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.207971:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872680 with x1873929633373184 ext(16437248->16474111) 00002000:00010000:0.0:1787119492.207974:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872680 00000100:00100000:1.0:1787119492.208959:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9789 00000100:00100000:1.0:1787119492.208980:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633373056:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.209274:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633373056:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 303us (16053us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119492.209282:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9789 00002000:00100000:1.0:1787119492.209290:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (24756224->24760319) req@ffff92a506009f80 x1873929633373056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.209300:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009f80 with x1873929633373056 ext(24756224->24760319) 00002000:00010000:1.0:1787119492.209305:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506009f80 00000100:00100000:1.0:1787119492.209328:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9790 00000100:00100000:1.0:1787119492.209335:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633373184:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.215824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.215833:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633373312 00000100:00100000:0.0:1787119492.215845:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633373312 00002000:00100000:0.0:1787119492.215897:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (21684224->21688319) req@ffff92a506577b80 x1873929633373312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.215909:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577b80 with x1873929633373312 ext(21684224->21688319) 00002000:00010000:0.0:1787119492.215915:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577b80 00000100:00100000:1.0:1787119492.216080:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633373184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6743us (17471us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119492.216090:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9790 00002000:00100000:1.0:1787119492.216097:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (16437248->16474111) req@ffff92a509872680 x1873929633373184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.216112:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872680 with x1873929633373184 ext(16437248->16474111) 00002000:00010000:1.0:1787119492.216116:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872680 00000100:00100000:1.0:1787119492.216136:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633373440 00000100:00100000:1.0:1787119492.216140:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633373440 00002000:00100000:1.0:1787119492.216158:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (47022080->47054847) req@ffff92a506576a00 x1873929633373440/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.216166:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576a00 with x1873929633373440 ext(47022080->47054847) 00002000:00010000:1.0:1787119492.216169:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506576a00 00000100:00100000:3.0:1787119492.218856:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9791 00000100:00100000:3.0:1787119492.218881:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633373312:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.218898:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9792 00000100:00100000:0.0:1787119492.218908:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633373440:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119492.223979:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633373312:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5095us (17411us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.223995:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9791 00002000:00100000:3.0:1787119492.224012:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (21684224->21688319) req@ffff92a506577b80 x1873929633373312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.224022:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577b80 with x1873929633373312 ext(21684224->21688319) 00002000:00010000:3.0:1787119492.224030:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577b80 00000100:00100000:2.0:1787119492.233292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.233340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.234617:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633373824 00000100:00100000:0.0:1787119492.234630:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633373824 00002000:00100000:0.0:1787119492.234681:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (24768512->24772607) req@ffff92a506577480 x1873929633373824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.234698:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577480 with x1873929633373824 ext(24768512->24772607) 00002000:00010000:0.0:1787119492.234714:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577480 00000100:00100000:3.0:1787119492.234719:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633373696 00000100:00100000:3.0:1787119492.234725:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633373696 00000100:00100000:0.0:1787119492.234745:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9793 00000100:00100000:0.0:1787119492.234755:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633373824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.234756:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19549 00000100:00100000:3.0:1787119492.234762:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+218:32720:x1873929633373696:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119492.234803:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119492.234830:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2d4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715baf expref: 218 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.234850:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119492.234856:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119492.235048:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.235063:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.235073:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119492.235126:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976362 00000004:00010000:3.0:1787119492.235153:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008acefec7 reply state 00000000814052f7 transno 4294976363 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.235163:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119492.235207:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633373824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 453us (1866us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.235211:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+220:32720:x1873929633373696:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 449us (1929us total) trans 4294976363 rc 0/0 00000100:00100000:0.0:1787119492.235215:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9793 00000100:00100000:3.0:1787119492.235217:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19549 00000020:00080000:3.0:1787119492.235221:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00100000:0.0:1787119492.235222:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (24768512->24772607) req@ffff92a506577480 x1873929633373824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.235230:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577480 with x1873929633373824 ext(24768512->24772607) 00002000:00010000:0.0:1787119492.235233:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577480 00000100:00100000:2.0:1787119492.235394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.235543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.235675:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633373952 00000100:00100000:0.0:1787119492.235681:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633373952 00002000:00100000:0.0:1787119492.235704:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (21688320->21692415) req@ffff92a506576d80 x1873929633373952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.235713:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576d80 with x1873929633373952 ext(21688320->21692415) 00002000:00010000:0.0:1787119492.235718:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506576d80 00000100:00100000:0.0:1787119492.235741:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633374080 00000100:00100000:0.0:1787119492.235744:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633374080 00002000:00100000:0.0:1787119492.235759:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (16404480->54219438) req@ffff92a506575c00 x1873929633374080/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 520/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.235767:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575c00 with x1873929633374080 ext(16404480->54219438) 00002000:00010000:0.0:1787119492.235770:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575c00 00000100:00100000:0.0:1787119492.235785:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9794 00000100:00100000:0.0:1787119492.235792:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633373952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.235923:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633373952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 131us (529us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.235935:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9794 00002000:00100000:0.0:1787119492.235941:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (21688320->21692415) req@ffff92a506576d80 x1873929633373952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.235949:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576d80 with x1873929633373952 ext(21688320->21692415) 00002000:00010000:0.0:1787119492.235951:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506576d80 00000100:00100000:0.0:1787119492.235964:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9795 00000100:00100000:0.0:1787119492.235971:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633374080:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119492.239334:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633373440:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 20416us (23507us total) trans 4294968853 rc 0/0 00000100:00100000:0.0:1787119492.239348:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9792 00002000:00100000:0.0:1787119492.239360:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (47022080->47054847) req@ffff92a506576a00 x1873929633373440/t4294968853(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/448 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.239371:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576a00 with x1873929633373440 ext(47022080->47054847) 00002000:00010000:0.0:1787119492.239376:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506576a00 00000100:00100000:1.0:1787119492.241239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.241306:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633374208 00000100:00100000:3.0:1787119492.241316:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633374208 00002000:00010000:3.0:1787119492.241387:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (49988592->18446744073709551615) 00002000:00100000:3.0:1787119492.241392:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871500 with x1873929633374208 ext(49988592->18446744073709551615) 00002000:00010000:3.0:1787119492.241417:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871500. 00000100:00100000:3.0:1787119492.241467:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9796 00000100:00100000:3.0:1787119492.241477:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633374208:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119492.241693:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 27367412 -> 49988592 00002000:00010000:3.0:1787119492.241698:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119492.241700:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119492.241702:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119492.241704:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1549 -> 1549 00000100:00100000:3.0:1787119492.241754:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633374208:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 277us (521us total) trans 4294968854 rc 0/0 00000100:00100000:3.0:1787119492.241761:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9796 00002000:00010000:3.0:1787119492.241765:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (49988592->18446744073709551615) 00002000:00100000:3.0:1787119492.241767:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871500 with x1873929633374208 ext(49988592->18446744073709551615) 00002000:00010000:3.0:1787119492.241772:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871500. 00010000:00010000:0.0:1787119492.242109:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.242119:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.242126:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.242134:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c65800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119492.242140:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.242147:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.242163:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119492.242166:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119492.242171:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.242177:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119492.248856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.248974:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633374336 00000100:00100000:0.0:1787119492.248984:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633374336 00002000:00100000:0.0:1787119492.249034:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (31031296->31076351) req@ffff92a509873100 x1873929633374336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.249044:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873100 with x1873929633374336 ext(31031296->31076351) 00002000:00010000:0.0:1787119492.249050:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509873100 00000100:00100000:0.0:1787119492.249083:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9797 00000100:00100000:0.0:1787119492.249093:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633374336:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.250568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.250711:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633374464 00000100:00100000:0.0:1787119492.250721:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633374464 00002000:00100000:0.0:1787119492.250761:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (21663744->21729279) req@ffff92a506575180 x1873929633374464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.250779:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575180 with x1873929633374464 ext(21663744->21729279) 00002000:00010000:0.0:1787119492.250784:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575180 00000100:00100000:0.0:1787119492.250817:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9798 00000100:00100000:0.0:1787119492.250827:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633374464:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.258707:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633374464:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7867us (8134us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119492.258724:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9798 00002000:00100000:2.0:1787119492.258739:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (21663744->21729279) req@ffff92a506575180 x1873929633374464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.258751:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575180 with x1873929633374464 ext(21663744->21729279) 00002000:00010000:2.0:1787119492.258758:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575180 00000100:00100000:0.0:1787119492.263158:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633374336:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14055us (14301us total) trans 0 rc 45056/45056 00000100:00100000:0.0:1787119492.263174:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9797 00002000:00100000:0.0:1787119492.263190:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (31031296->31076351) req@ffff92a509873100 x1873929633374336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.263201:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873100 with x1873929633374336 ext(31031296->31076351) 00002000:00010000:0.0:1787119492.263207:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509873100 00000100:00100000:0.0:1787119492.268918:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633374080:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 32933us (33360us total) trans 4294969096 rc 0/0 00000100:00100000:0.0:1787119492.268934:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9795 00002000:00100000:0.0:1787119492.268949:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (16404480->54219438) req@ffff92a506575c00 x1873929633374080/t4294969096(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 520/456 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.268959:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575c00 with x1873929633374080 ext(16404480->54219438) 00002000:00010000:0.0:1787119492.268966:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575c00 00000100:00100000:3.0:1787119492.278522:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.278577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.278652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.278679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.278704:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633374720 00000100:00100000:3.0:1787119492.278711:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633374720 00002000:00100000:3.0:1787119492.278750:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (21729280->21766143) req@ffff92a506008700 x1873929633374720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787119492.278782:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633374592 00000100:00100000:0.0:1787119492.278788:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633374592 00002000:00100000:3.0:1787119492.278812:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008700 with x1873929633374720 ext(21729280->21766143) 00002000:00010000:3.0:1787119492.278817:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008700 00000100:00100000:0.0:1787119492.278823:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633374976 00000100:00100000:0.0:1787119492.278826:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633374976 00000100:00100000:3.0:1787119492.278838:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633374848 00000100:00100000:3.0:1787119492.278842:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633374848 00000100:00100000:0.0:1787119492.278856:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5014 00002000:00100000:3.0:1787119492.278858:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (49967104->49971199) req@ffff92a506008000 x1873929633374848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.278865:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008000 with x1873929633374848 ext(49967104->49971199) 00002000:00010000:3.0:1787119492.278869:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008000 00000100:00100000:0.0:1787119492.278870:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633374592:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119492.278886:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9799 00000100:00100000:0.0:1787119492.278925:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5015 00000100:00100000:0.0:1787119492.278933:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633374976:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119492.279071:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633374720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.279312:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9800 00000100:00100000:3.0:1787119492.279320:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633374848:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.281690:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633374848:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2363us (3029us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.281701:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9800 00002000:00100000:3.0:1787119492.281711:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (49967104->49971199) req@ffff92a506008000 x1873929633374848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.281718:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008000 with x1873929633374848 ext(49967104->49971199) 00002000:00010000:3.0:1787119492.281722:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008000 00000100:00100000:3.0:1787119492.282227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.282255:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633375104 00000100:00100000:3.0:1787119492.282263:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633375104 00002000:00100000:3.0:1787119492.282291:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (21684224->21688319) req@ffff92a50600aa00 x1873929633375104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.282297:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600aa00 with x1873929633375104 ext(21684224->21688319) 00002000:00010000:3.0:1787119492.282300:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600aa00 00000100:00100000:3.0:1787119492.282316:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9801 00000100:00100000:3.0:1787119492.282322:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633375104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.282870:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633375104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 546us (644us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.282876:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9801 00002000:00100000:3.0:1787119492.282881:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (21684224->21688319) req@ffff92a50600aa00 x1873929633375104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.282886:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600aa00 with x1873929633375104 ext(21684224->21688319) 00002000:00010000:3.0:1787119492.282888:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600aa00 00000100:00100000:3.0:1787119492.285057:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633374720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6157us (6471us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119492.285065:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9799 00002000:00100000:3.0:1787119492.285073:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (21729280->21766143) req@ffff92a506008700 x1873929633374720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.285080:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008700 with x1873929633374720 ext(21729280->21766143) 00002000:00010000:3.0:1787119492.285085:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008700 00000100:00100000:3.0:1787119492.287306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.287335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.288555:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633375360 00000100:00100000:2.0:1787119492.288570:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633375360 00002000:00100000:2.0:1787119492.288621:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (49971200->49975295) req@ffff92a506008a80 x1873929633375360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.288632:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008a80 with x1873929633375360 ext(49971200->49975295) 00002000:00010000:2.0:1787119492.288637:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008a80 00000100:00100000:2.0:1787119492.288666:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633375232 00000100:00100000:2.0:1787119492.288670:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633375232 00000100:00100000:3.0:1787119492.288687:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9802 00002000:00100000:2.0:1787119492.288689:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (21688320->21692415) req@ffff92a50600a680 x1873929633375232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119492.288700:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633375360:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:2.0:1787119492.288713:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600a680 with x1873929633375232 ext(21688320->21692415) 00002000:00010000:2.0:1787119492.288717:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600a680 00000100:00100000:2.0:1787119492.288738:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9803 00000100:00100000:2.0:1787119492.288748:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633375232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.289360:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633375232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 612us (2021us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.289370:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9803 00002000:00100000:2.0:1787119492.289378:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (21688320->21692415) req@ffff92a50600a680 x1873929633375232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.289386:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600a680 with x1873929633375232 ext(21688320->21692415) 00002000:00010000:2.0:1787119492.289390:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600a680 00000100:00100000:3.0:1787119492.291558:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633375360:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2849us (4247us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.291572:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9802 00002000:00100000:3.0:1787119492.291584:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (49971200->49975295) req@ffff92a506008a80 x1873929633375360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.291640:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008a80 with x1873929633375360 ext(49971200->49975295) 00002000:00010000:3.0:1787119492.291645:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008a80 00000100:00100000:3.0:1787119492.302228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.302268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.302297:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633375488 00000100:00100000:3.0:1787119492.302307:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633375488 00002000:00100000:3.0:1787119492.302355:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (21663744->21729279) req@ffff92a50600bb80 x1873929633375488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.302368:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600bb80 with x1873929633375488 ext(21663744->21729279) 00002000:00010000:3.0:1787119492.302374:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600bb80 00000100:00100000:3.0:1787119492.302604:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633375616 00000100:00100000:3.0:1787119492.302609:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633375616 00002000:00100000:3.0:1787119492.302630:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (16404480->16408575) req@ffff92a506009500 x1873929633375616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.302639:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009500 with x1873929633375616 ext(16404480->16408575) 00002000:00010000:3.0:1787119492.302644:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506009500 00000100:00100000:3.0:1787119492.302670:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9804 00000100:00100000:3.0:1787119492.302682:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633375488:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.302810:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9805 00000100:00100000:1.0:1787119492.302821:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633375616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.303197:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2373:x1873929633375616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 376us (927us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119492.303206:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9805 00002000:00100000:1.0:1787119492.303214:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (16404480->16408575) req@ffff92a506009500 x1873929633375616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.303223:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009500 with x1873929633375616 ext(16404480->16408575) 00002000:00010000:1.0:1787119492.303228:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506009500 00000100:00100000:3.0:1787119492.313875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.313928:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633375744 00000100:00100000:3.0:1787119492.313937:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633375744 00002000:00100000:3.0:1787119492.313982:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (49946624->49991679) req@ffff92a506008380 x1873929633375744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.314000:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008380 with x1873929633375744 ext(49946624->49991679) 00002000:00010000:3.0:1787119492.314005:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008380 00000100:00100000:3.0:1787119492.314032:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9806 00000100:00100000:3.0:1787119492.314041:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633375744:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.327285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.327425:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633375488:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 24742us (25206us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119492.327436:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9804 00002000:00100000:3.0:1787119492.327465:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (21663744->21729279) req@ffff92a50600bb80 x1873929633375488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.327476:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600bb80 with x1873929633375488 ext(21663744->21729279) 00002000:00010000:3.0:1787119492.327482:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600bb80 00000100:00100000:3.0:1787119492.327506:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633375872 00000100:00100000:3.0:1787119492.327524:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633375872 00002000:00100000:3.0:1787119492.327556:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (16408576->16412671) req@ffff92a506009180 x1873929633375872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.327565:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009180 with x1873929633375872 ext(16408576->16412671) 00002000:00010000:3.0:1787119492.327568:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506009180 00000100:00100000:3.0:1787119492.327589:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9807 00000100:00100000:3.0:1787119492.327599:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633375872:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.327762:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633375872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 164us (484us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.327773:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9807 00002000:00100000:3.0:1787119492.327779:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (16408576->16412671) req@ffff92a506009180 x1873929633375872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.327787:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009180 with x1873929633375872 ext(16408576->16412671) 00002000:00010000:3.0:1787119492.327790:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506009180 00000100:00100000:0.0:1787119492.332736:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633375744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18687us (18861us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119492.332749:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9806 00002000:00100000:0.0:1787119492.332761:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (49946624->49991679) req@ffff92a506008380 x1873929633375744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.332771:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008380 with x1873929633375744 ext(49946624->49991679) 00002000:00010000:0.0:1787119492.332776:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506008380 00000100:00100000:0.0:1787119492.339604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.339818:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633376000 00000100:00100000:0.0:1787119492.339829:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633376000 00002000:00100000:0.0:1787119492.339879:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (49967104->49988591) req@ffff92a5098a5880 x1873929633376000/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.339891:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5880 with x1873929633376000 ext(49967104->49988591) 00002000:00010000:0.0:1787119492.339897:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a5880 00000100:00100000:0.0:1787119492.339925:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9808 00000100:00100000:0.0:1787119492.339935:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633376000:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119492.340101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.340128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.340149:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633376128 00000100:00100000:3.0:1787119492.340153:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633376128 00002000:00100000:3.0:1787119492.340175:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (21729280->21766143) req@ffff92a50600a300 x1873929633376128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.340184:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600a300 with x1873929633376128 ext(21729280->21766143) 00002000:00010000:3.0:1787119492.340188:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600a300 00000100:00100000:3.0:1787119492.340204:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633376256 00000100:00100000:3.0:1787119492.340207:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633376256 00002000:00100000:3.0:1787119492.340219:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (16437248->16474111) req@ffff92a506008e00 x1873929633376256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.340227:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008e00 with x1873929633376256 ext(16437248->16474111) 00002000:00010000:3.0:1787119492.340231:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008e00 00000100:00100000:3.0:1787119492.340247:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9809 00000100:00100000:3.0:1787119492.340254:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2373:x1873929633376128:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.340306:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9810 00000100:00100000:0.0:1787119492.340314:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633376256:12345-192.168.201.59@tcp:3:fsx.0 00000001:00080000:2.0:1787119492.343095:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976355 is committed 00000001:00080000:2.0:1787119492.343220:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976361 is committed 00000001:00080000:2.0:1787119492.343385:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976363 is committed 00000100:00100000:0.0:1787119492.346182:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633376000:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 6236us (6584us total) trans 4294968855 rc 0/0 00000100:00100000:0.0:1787119492.346199:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9808 00002000:00100000:0.0:1787119492.346212:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (49967104->49988591) req@ffff92a5098a5880 x1873929633376000/t4294968855(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/448 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.346222:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5880 with x1873929633376000 ext(49967104->49988591) 00002000:00010000:0.0:1787119492.346229:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a5880 00000001:00080000:2.0:1787119492.347754:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969096 is committed 00000100:00100000:0.0:1787119492.348192:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633374976:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 69256us (69507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119492.348200:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5015 00000100:00100000:2.0:1787119492.349224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.349325:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633376128:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9070us (9223us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119492.349335:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9809 00002000:00100000:2.0:1787119492.349346:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (21729280->21766143) req@ffff92a50600a300 x1873929633376128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.349357:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600a300 with x1873929633376128 ext(21729280->21766143) 00002000:00010000:2.0:1787119492.349363:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600a300 00000100:00100000:0.0:1787119492.349750:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633376384 00000100:00100000:0.0:1787119492.349759:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633376384 00000100:00100000:0.0:1787119492.349810:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5016 00000100:00100000:0.0:1787119492.349820:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633376384:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119492.350251:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633376256:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9937us (10121us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119492.350257:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9810 00002000:00100000:1.0:1787119492.350263:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (16437248->16474111) req@ffff92a506008e00 x1873929633376256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.350270:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506008e00 with x1873929633376256 ext(16437248->16474111) 00002000:00010000:1.0:1787119492.350273:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506008e00 00000100:00100000:2.0:1787119492.356874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.356915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.357015:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633376512 00000100:00100000:0.0:1787119492.357026:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633376512 00002000:00100000:0.0:1787119492.357076:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (16404480->16408575) req@ffff92a506576680 x1873929633376512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.357087:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576680 with x1873929633376512 ext(16404480->16408575) 00002000:00010000:0.0:1787119492.357093:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506576680 00000100:00100000:0.0:1787119492.357122:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633376640 00000100:00100000:0.0:1787119492.357125:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633376640 00002000:00100000:0.0:1787119492.357136:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (16404480->54219438) req@ffff92a506574000 x1873929633376640/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 520/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.357142:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506574000 with x1873929633376640 ext(16404480->54219438) 00002000:00010000:0.0:1787119492.357144:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506574000 00000100:00100000:0.0:1787119492.357157:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9811 00000100:00100000:0.0:1787119492.357164:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633376512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.357366:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633376512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 202us (502us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.357372:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9811 00002000:00100000:0.0:1787119492.357378:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (16404480->16408575) req@ffff92a506576680 x1873929633376512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.357386:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576680 with x1873929633376512 ext(16404480->16408575) 00002000:00010000:0.0:1787119492.357389:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506576680 00000100:00100000:0.0:1787119492.357405:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9812 00000100:00100000:0.0:1787119492.357411:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633376640:12345-192.168.201.59@tcp:4:fsx.0 00000001:00080000:2.0:1787119492.364341:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968853 is committed 00000001:00080000:2.0:1787119492.364366:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968854 is committed 00000100:00100000:0.0:1787119492.365105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.365152:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633376768 00000100:00100000:0.0:1787119492.365161:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633376768 00002000:00100000:0.0:1787119492.365208:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (16408576->16412671) req@ffff92a5098a5500 x1873929633376768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.365220:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633376768 ext(16408576->16412671) 00002000:00010000:0.0:1787119492.365225:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5500 00000100:00100000:0.0:1787119492.365254:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9813 00000100:00100000:0.0:1787119492.365263:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633376768:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.366312:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633376768:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1042us (1204us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.366323:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9813 00002000:00100000:0.0:1787119492.366333:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (16408576->16412671) req@ffff92a5098a5500 x1873929633376768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.366342:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633376768 ext(16408576->16412671) 00002000:00010000:0.0:1787119492.366346:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5500 00000100:00100000:1.0:1787119492.367181:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633374592:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 88309us (88671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119492.367191:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5014 00000100:00100000:1.0:1787119492.367670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.367730:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633376896 00000100:00100000:2.0:1787119492.367739:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633376896 00002000:00100000:2.0:1787119492.367776:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (24354816->24358911) req@ffff92a509870e00 x1873929633376896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.367787:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870e00 with x1873929633376896 ext(24354816->24358911) 00002000:00010000:2.0:1787119492.367792:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870e00 00000100:00100000:2.0:1787119492.367815:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9814 00000100:00100000:2.0:1787119492.367824:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633376896:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.368197:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633376896:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 373us (528us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.368205:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9814 00002000:00100000:2.0:1787119492.368211:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (24354816->24358911) req@ffff92a509870e00 x1873929633376896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.368219:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870e00 with x1873929633376896 ext(24354816->24358911) 00002000:00010000:2.0:1787119492.368222:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870e00 00000100:00100000:3.0:1787119492.369670:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633376640:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 12250us (12746us total) trans 4294969097 rc 0/0 00000100:00100000:3.0:1787119492.369682:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9812 00002000:00100000:3.0:1787119492.369694:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (16404480->54219438) req@ffff92a506574000 x1873929633376640/t4294969097(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 520/456 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.369717:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506574000 with x1873929633376640 ext(16404480->54219438) 00002000:00010000:3.0:1787119492.369722:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506574000 00000100:00100000:0.0:1787119492.371931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.372091:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633377024 00000100:00100000:1.0:1787119492.372100:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633377024 00000100:00100000:1.0:1787119492.372188:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5017 00000100:00100000:1.0:1787119492.372198:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633377024:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119492.378117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.379950:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633377152 00000100:00100000:3.0:1787119492.379968:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633377152 00002000:00100000:3.0:1787119492.380023:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (16437248->16474111) req@ffff92a506575f80 x1873929633377152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.380035:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575f80 with x1873929633377152 ext(16437248->16474111) 00002000:00010000:3.0:1787119492.380041:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575f80 00000100:00100000:3.0:1787119492.380069:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9815 00000100:00100000:3.0:1787119492.380079:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633377152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.381025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.382384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.382836:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633377280 00000100:00100000:3.0:1787119492.382847:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633377280 00002000:00100000:3.0:1787119492.382895:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (24358912->24363007) req@ffff92a508f6bb80 x1873929633377280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.382907:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6bb80 with x1873929633377280 ext(24358912->24363007) 00002000:00010000:3.0:1787119492.382913:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6bb80 00000100:00100000:3.0:1787119492.382934:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633377408 00000100:00100000:3.0:1787119492.382937:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633377408 00002000:00100000:3.0:1787119492.382956:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (21311488->21315583) req@ffff92a508f6b800 x1873929633377408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.382964:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6b800 with x1873929633377408 ext(21311488->21315583) 00002000:00010000:3.0:1787119492.382968:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6b800 00000100:00100000:3.0:1787119492.383063:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9816 00000100:00100000:3.0:1787119492.383076:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633377280:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.383307:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633377280:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 233us (2286us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.383315:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9816 00002000:00100000:3.0:1787119492.383321:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (24358912->24363007) req@ffff92a508f6bb80 x1873929633377280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.383330:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6bb80 with x1873929633377280 ext(24358912->24363007) 00002000:00010000:3.0:1787119492.383333:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6bb80 00000100:00100000:3.0:1787119492.383350:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9817 00000100:00100000:3.0:1787119492.383357:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633377408:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.383576:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633377408:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 218us (1208us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.383978:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9817 00002000:00100000:3.0:1787119492.384059:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (21311488->21315583) req@ffff92a508f6b800 x1873929633377408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.384068:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6b800 with x1873929633377408 ext(21311488->21315583) 00002000:00010000:3.0:1787119492.384073:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6b800 00000100:00100000:2.0:1787119492.389145:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633377152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9054us (11024us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119492.389161:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9815 00002000:00100000:2.0:1787119492.389174:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (16437248->16474111) req@ffff92a506575f80 x1873929633377152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.389190:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575f80 with x1873929633377152 ext(16437248->16474111) 00002000:00010000:2.0:1787119492.389197:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506575f80 00000100:00100000:1.0:1787119492.393937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.393979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.394092:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633377664 00000100:00100000:3.0:1787119492.394103:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633377664 00002000:00100000:3.0:1787119492.394150:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (21315584->21319679) req@ffff92a509872a00 x1873929633377664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.394170:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872a00 with x1873929633377664 ext(21315584->21319679) 00002000:00010000:3.0:1787119492.394176:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509872a00 00000100:00100000:3.0:1787119492.394197:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633377536 00000100:00100000:3.0:1787119492.394200:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633377536 00002000:00100000:3.0:1787119492.394216:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (24334336->24399871) req@ffff92a509871880 x1873929633377536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.394224:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871880 with x1873929633377536 ext(24334336->24399871) 00002000:00010000:3.0:1787119492.394227:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871880 00000100:00100000:3.0:1787119492.394242:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9818 00000100:00100000:3.0:1787119492.394251:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633377664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.394492:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633377664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 240us (565us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.394501:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9818 00002000:00100000:3.0:1787119492.394508:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (21315584->21319679) req@ffff92a509872a00 x1873929633377664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.394532:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872a00 with x1873929633377664 ext(21315584->21319679) 00002000:00010000:3.0:1787119492.394535:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509872a00 00000100:00100000:3.0:1787119492.394553:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9819 00000100:00100000:3.0:1787119492.394560:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633377536:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.399693:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.399741:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633377792 00000100:00100000:0.0:1787119492.399752:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633377792 00002000:00100000:0.0:1787119492.399798:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (21291008->21356543) req@ffff92a508f68380 x1873929633377792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.399809:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68380 with x1873929633377792 ext(21291008->21356543) 00002000:00010000:0.0:1787119492.399815:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f68380 00000100:00100000:0.0:1787119492.399849:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9820 00000100:00100000:0.0:1787119492.399859:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633377792:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.405173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.405345:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633377536:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10781us (11362us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119492.405357:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9819 00002000:00100000:3.0:1787119492.405371:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (24334336->24399871) req@ffff92a509871880 x1873929633377536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.405390:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871880 with x1873929633377536 ext(24334336->24399871) 00002000:00010000:3.0:1787119492.405397:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871880 00000100:00100000:2.0:1787119492.405568:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633377920 00000100:00100000:2.0:1787119492.405579:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633377920 00002000:00100000:2.0:1787119492.405691:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (16404480->54219438) req@ffff92a508f68a80 x1873929633377920/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 520/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.405711:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68a80 with x1873929633377920 ext(16404480->54219438) 00002000:00010000:2.0:1787119492.405716:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f68a80 00000100:00100000:2.0:1787119492.405742:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9821 00000100:00100000:2.0:1787119492.405751:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633377920:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119492.406374:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633377792:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6513us (6766us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119492.406384:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9820 00002000:00100000:0.0:1787119492.406391:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (21291008->21356543) req@ffff92a508f68380 x1873929633377792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.406399:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68380 with x1873929633377792 ext(21291008->21356543) 00002000:00010000:0.0:1787119492.406403:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f68380 00000100:00100000:1.0:1787119492.416219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.416251:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633378048 00000100:00100000:1.0:1787119492.416261:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633378048 00002000:00100000:1.0:1787119492.416307:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (24399872->24436735) req@ffff92a509872300 x1873929633378048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.416318:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872300 with x1873929633378048 ext(24399872->24436735) 00002000:00010000:1.0:1787119492.416324:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872300 00000100:00100000:1.0:1787119492.416348:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9822 00000100:00100000:1.0:1787119492.416357:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633378048:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.419669:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633377920:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 13908us (14493us total) trans 4294969098 rc 0/0 00000100:00100000:2.0:1787119492.419684:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9821 00002000:00100000:2.0:1787119492.419697:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (16404480->54219438) req@ffff92a508f68a80 x1873929633377920/t4294969098(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 520/456 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.419708:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68a80 with x1873929633377920 ext(16404480->54219438) 00002000:00010000:2.0:1787119492.419715:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f68a80 00000100:00100000:3.0:1787119492.427764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.427839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.427946:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633378048:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11587us (11735us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119492.427958:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9822 00002000:00100000:0.0:1787119492.427972:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (24399872->24436735) req@ffff92a509872300 x1873929633378048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.427984:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872300 with x1873929633378048 ext(24399872->24436735) 00000100:00100000:1.0:1787119492.428017:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633378176 00000100:00100000:1.0:1787119492.428028:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633378176 00002000:00010000:0.0:1787119492.428064:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872300 00002000:00100000:1.0:1787119492.428070:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (21356544->21393407) req@ffff92a508f68700 x1873929633378176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.428079:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68700 with x1873929633378176 ext(21356544->21393407) 00002000:00010000:1.0:1787119492.428082:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f68700 00000100:00100000:1.0:1787119492.428101:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9823 00000100:00100000:1.0:1787119492.428110:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633378176:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.428321:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633378304 00000100:00100000:1.0:1787119492.428325:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633378304 00000100:00100000:1.0:1787119492.428349:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5018 00000100:00100000:1.0:1787119492.428356:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633378304:12345-192.168.201.59@tcp:16:fsx.0 00000001:00080000:0.0:1787119492.441997:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968855 is committed 00000100:00100000:1.0:1787119492.442087:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633376384:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 92263us (92863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119492.442099:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5016 00000100:00100000:1.0:1787119492.446505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.446571:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.446914:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633378176:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18804us (19160us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119492.446922:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9823 00002000:00100000:3.0:1787119492.446932:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (21356544->21393407) req@ffff92a508f68700 x1873929633378176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.446940:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68700 with x1873929633378176 ext(21356544->21393407) 00002000:00010000:3.0:1787119492.446945:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f68700 00000100:00100000:3.0:1787119492.446967:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633378432 00000100:00100000:3.0:1787119492.446973:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633378432 00002000:00100000:3.0:1787119492.447009:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (1011712->1015807) req@ffff92a509870380 x1873929633378432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.447016:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870380 with x1873929633378432 ext(1011712->1015807) 00002000:00010000:3.0:1787119492.447020:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870380 00000100:00100000:3.0:1787119492.447044:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9824 00000100:00100000:3.0:1787119492.447054:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633378432:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.447212:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633378432:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 160us (715us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.447217:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9824 00002000:00100000:3.0:1787119492.447221:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (1011712->1015807) req@ffff92a509870380 x1873929633378432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.447226:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870380 with x1873929633378432 ext(1011712->1015807) 00002000:00010000:3.0:1787119492.447228:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870380 00000100:00100000:1.0:1787119492.448836:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633378560 00000100:00100000:1.0:1787119492.448847:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633378560 00000100:00100000:1.0:1787119492.448898:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19550 00000100:00100000:1.0:1787119492.448907:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:32720:x1873929633378560:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119492.448927:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119492.448947:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2d59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715bb6 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.449029:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2d60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.449043:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.449055:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119492.449081:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 49988592 00000004:00200000:1.0:1787119492.449085:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119492.449102:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.449130:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2d59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bb6 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.449149:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2d60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bb6 expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.449158:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119492.449162:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119492.449166:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119492.449223:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:32720:x1873929633378560:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 316us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119492.449230:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19550 00000100:00100000:1.0:1787119492.453486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.453570:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633378688 00000100:00100000:3.0:1787119492.453583:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633378688 00002000:00100000:3.0:1787119492.453633:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (21311488->21364735) req@ffff92a509873480 x1873929633378688/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.453645:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873480 with x1873929633378688 ext(21311488->21364735) 00002000:00010000:3.0:1787119492.453650:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509873480 00000100:00100000:3.0:1787119492.453685:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9825 00000100:00100000:3.0:1787119492.453695:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633378688:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119492.462695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.463298:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633378816 00000100:00100000:3.0:1787119492.463310:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633378816 00002000:00100000:3.0:1787119492.463358:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (1015808->1019903) req@ffff92a509870a80 x1873929633378816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.463371:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870a80 with x1873929633378816 ext(1015808->1019903) 00002000:00010000:3.0:1787119492.463377:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870a80 00000100:00100000:3.0:1787119492.463417:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9826 00000100:00100000:3.0:1787119492.463428:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633378816:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.463715:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633378816:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 287us (1029us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.463728:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9826 00002000:00100000:3.0:1787119492.463735:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (1015808->1019903) req@ffff92a509870a80 x1873929633378816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.463743:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870a80 with x1873929633378816 ext(1015808->1019903) 00002000:00010000:3.0:1787119492.463747:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870a80 00000100:00100000:3.0:1787119492.464183:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633378688:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 10489us (10706us total) trans 4294968856 rc 0/0 00000100:00100000:3.0:1787119492.464191:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9825 00002000:00100000:3.0:1787119492.464198:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (21311488->21364735) req@ffff92a509873480 x1873929633378688/t4294968856(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/448 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.464206:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873480 with x1873929633378688 ext(21311488->21364735) 00002000:00010000:3.0:1787119492.464210:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509873480 00000100:00100000:2.0:1787119492.471100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.471143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.471178:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633379072 00000100:00100000:2.0:1787119492.471190:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633379072 00000100:00100000:2.0:1787119492.471255:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5019 00000100:00100000:2.0:1787119492.471267:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633379072:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119492.471819:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633377024:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 99620us (99895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119492.471829:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5017 00000100:00100000:3.0:1787119492.475369:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633378944 00000100:00100000:3.0:1787119492.475386:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633378944 00002000:00100000:3.0:1787119492.475581:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (1019904->1056767) req@ffff92a506577100 x1873929633378944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.475656:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577100 with x1873929633378944 ext(1019904->1056767) 00002000:00010000:3.0:1787119492.475663:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577100 00000100:00100000:3.0:1787119492.475698:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9827 00000100:00100000:3.0:1787119492.475777:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633378944:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.475972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000001:00080000:2.0:1787119492.477700:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969097 is committed 00000100:00100000:2.0:1787119492.477747:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633379328 00000100:00100000:2.0:1787119492.477756:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633379328 00000100:00100000:2.0:1787119492.477816:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19551 00000100:00100000:2.0:1787119492.477827:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:32720:x1873929633379328:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119492.477878:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119492.477911:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2d60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bb6 expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.477930:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119492.477936:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119492.478191:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.478207:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.478217:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119492.478271:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976364 00000004:00010000:2.0:1787119492.478299:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ff26c53 reply state 00000000957a8ffb transno 4294976365 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119492.478308:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119492.478422:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:32720:x1873929633379328:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 596us (2450us total) trans 4294976365 rc 0/0 00000100:00100000:2.0:1787119492.478430:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19551 00000020:00080000:2.0:1787119492.478436:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119492.489713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.489769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.489852:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633379456 00000100:00100000:0.0:1787119492.489862:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633379456 00002000:00100000:0.0:1787119492.489906:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (24354816->24358911) req@ffff92a5098a7480 x1873929633379456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.489917:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7480 with x1873929633379456 ext(24354816->24358911) 00002000:00010000:0.0:1787119492.489923:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a7480 00000100:00100000:0.0:1787119492.489944:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633379584 00000100:00100000:0.0:1787119492.489948:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633379584 00002000:00010000:0.0:1787119492.489965:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (62516461->18446744073709551615) 00002000:00100000:0.0:1787119492.489968:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4380 with x1873929633379584 ext(62516461->18446744073709551615) 00002000:00010000:0.0:1787119492.489978:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a4380. 00000100:00100000:0.0:1787119492.489998:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9828 00000100:00100000:0.0:1787119492.490006:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633379456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.490225:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633379456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 219us (521us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.490233:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9828 00002000:00100000:0.0:1787119492.490240:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (24354816->24358911) req@ffff92a5098a7480 x1873929633379456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.490248:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7480 with x1873929633379456 ext(24354816->24358911) 00002000:00010000:0.0:1787119492.490252:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a7480 00000100:00100000:0.0:1787119492.490270:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9829 00000100:00100000:0.0:1787119492.490278:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633379584:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119492.490531:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 49988592 -> 62516461 00002000:00010000:0.0:1787119492.490535:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119490 -> 1787119491 00002000:00010000:0.0:1787119492.490537:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:0.0:1787119492.490540:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119490 -> 1787119491 00002000:00010000:0.0:1787119492.490542:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1549 -> 1421 00000100:00100000:0.0:1787119492.490568:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633379584:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 292us (799us total) trans 4294968857 rc 0/0 00000100:00100000:0.0:1787119492.490574:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9829 00002000:00010000:0.0:1787119492.490576:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (62516461->18446744073709551615) 00002000:00100000:0.0:1787119492.490578:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4380 with x1873929633379584 ext(62516461->18446744073709551615) 00002000:00010000:0.0:1787119492.490581:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a4380. 00010000:00010000:0.0:1787119492.490604:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.490613:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.490620:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.490627:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119492.490632:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.490640:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.490657:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119492.490659:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119492.490662:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.490666:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2d67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.491824:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633378944:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16045us (20729us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119492.491835:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9827 00002000:00100000:3.0:1787119492.491844:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (1019904->1056767) req@ffff92a506577100 x1873929633378944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.491853:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577100 with x1873929633378944 ext(1019904->1056767) 00002000:00010000:3.0:1787119492.491858:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577100 00000100:00100000:1.0:1787119492.502633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.502675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.502709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.502746:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633379712 00000100:00100000:1.0:1787119492.502759:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633379712 00002000:00100000:1.0:1787119492.502811:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (24358912->24363007) req@ffff92a509871180 x1873929633379712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.502822:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871180 with x1873929633379712 ext(24358912->24363007) 00002000:00010000:1.0:1787119492.502829:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871180 00000100:00100000:1.0:1787119492.502850:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633379968 00000100:00100000:1.0:1787119492.502854:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633379968 00002000:00100000:1.0:1787119492.502869:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (1056768->1093631) req@ffff92a6068bed80 x1873929633379968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.502877:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bed80 with x1873929633379968 ext(1056768->1093631) 00002000:00010000:1.0:1787119492.502881:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bed80 00000100:00100000:1.0:1787119492.502898:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9830 00000100:00100000:1.0:1787119492.502907:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633379712:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.503419:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633379712:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 511us (795us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119492.503428:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9830 00002000:00100000:1.0:1787119492.503435:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (24358912->24363007) req@ffff92a509871180 x1873929633379712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.503476:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871180 with x1873929633379712 ext(24358912->24363007) 00002000:00010000:1.0:1787119492.503481:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871180 00000100:00100000:1.0:1787119492.503504:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9831 00000100:00100000:1.0:1787119492.503525:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633379968:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.505145:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633379840 00000100:00100000:3.0:1787119492.505160:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633379840 00000100:00100000:3.0:1787119492.505241:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19552 00000100:00100000:3.0:1787119492.505250:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:32720:x1873929633379840:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119492.505271:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119492.505293:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2d6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715bbd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.505408:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.505423:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.505434:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119492.505482:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 62516461 00000004:00200000:3.0:1787119492.505487:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119492.505506:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.505714:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2d6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bbd expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.505738:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bbd expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.505746:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119492.505750:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119492.505754:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c64c00, rc 0) 00000100:00100000:3.0:1787119492.505825:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:32720:x1873929633379840:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 576us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119492.505832:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19552 00000100:00100000:0.0:1787119492.524826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.524857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.524889:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633380096 00000100:00100000:0.0:1787119492.524899:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633380096 00002000:00100000:0.0:1787119492.524944:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (24334336->24399871) req@ffff92a5098a6680 x1873929633380096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.524955:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6680 with x1873929633380096 ext(24334336->24399871) 00002000:00010000:0.0:1787119492.524961:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6680 00000100:00100000:0.0:1787119492.524983:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633380224 00000100:00100000:0.0:1787119492.524987:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633380224 00002000:00100000:0.0:1787119492.525004:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (47022080->47026175) req@ffff92a5098a4a80 x1873929633380224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.525012:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633380224 ext(47022080->47026175) 00002000:00010000:0.0:1787119492.525015:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a4a80 00000100:00100000:0.0:1787119492.525033:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9832 00000100:00100000:0.0:1787119492.525042:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633380096:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.525305:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9833 00000100:00100000:0.0:1787119492.525313:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633380224:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.525494:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633380224:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 181us (636us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.525502:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9833 00000100:00100000:2.0:1787119492.525675:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633379968:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22163us (22975us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119492.525683:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9831 00002000:00100000:2.0:1787119492.525689:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (1056768->1093631) req@ffff92a6068bed80 x1873929633379968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.525696:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bed80 with x1873929633379968 ext(1056768->1093631) 00002000:00010000:2.0:1787119492.525700:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bed80 00002000:00100000:0.0:1787119492.525820:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (47022080->47026175) req@ffff92a5098a4a80 x1873929633380224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.525831:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633380224 ext(47022080->47026175) 00002000:00010000:0.0:1787119492.525836:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a4a80 00000100:00100000:0.0:1787119492.542021:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633380096:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16970us (17195us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119492.542036:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9832 00002000:00100000:0.0:1787119492.542050:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (24334336->24399871) req@ffff92a5098a6680 x1873929633380096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.542060:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6680 with x1873929633380096 ext(24334336->24399871) 00002000:00010000:0.0:1787119492.542067:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6680 00000100:00100000:0.0:1787119492.543174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.543256:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633380352 00000100:00100000:3.0:1787119492.543269:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633380352 00002000:00100000:3.0:1787119492.543312:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (47026176->47030271) req@ffff92a5098a4e00 x1873929633380352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.543324:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633380352 ext(47026176->47030271) 00002000:00010000:3.0:1787119492.543329:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:3.0:1787119492.543362:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9834 00000100:00100000:3.0:1787119492.543372:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633380352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.544018:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633380352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 644us (848us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.544027:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9834 00002000:00100000:3.0:1787119492.544034:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (47026176->47030271) req@ffff92a5098a4e00 x1873929633380352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.544043:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633380352 ext(47026176->47030271) 00002000:00010000:3.0:1787119492.544048:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:0.0:1787119492.547975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000001:00080000:0.0:1787119492.548696:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969098 is committed 00000100:00100000:3.0:1787119492.548946:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633380480 00000100:00100000:3.0:1787119492.548956:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633380480 00002000:00100000:3.0:1787119492.549005:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (33882112->33943551) req@ffff92a5098a7800 x1873929633380480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.549016:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7800 with x1873929633380480 ext(33882112->33943551) 00002000:00010000:3.0:1787119492.549022:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a7800 00000100:00100000:3.0:1787119492.549051:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9835 00000100:00100000:3.0:1787119492.549061:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633380480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.550142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.552271:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633380608 00000100:00100000:0.0:1787119492.552288:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633380608 00002000:00100000:0.0:1787119492.552342:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (47001600->47067135) req@ffff92a506ede680 x1873929633380608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.552355:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506ede680 with x1873929633380608 ext(47001600->47067135) 00002000:00010000:0.0:1787119492.552361:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506ede680 00000100:00100000:0.0:1787119492.552408:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9836 00000100:00100000:0.0:1787119492.552420:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633380608:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.556885:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633378304:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 128516us (129032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119492.556899:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5018 00000100:00100000:3.0:1787119492.568039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.568238:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633380480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 19176us (20271us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1787119492.568249:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9835 00002000:00100000:3.0:1787119492.568262:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (33882112->33943551) req@ffff92a5098a7800 x1873929633380480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.568271:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7800 with x1873929633380480 ext(33882112->33943551) 00002000:00010000:3.0:1787119492.568278:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a7800 00000100:00100000:3.0:1787119492.568301:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633380736 00000100:00100000:3.0:1787119492.568308:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633380736 00002000:00100000:3.0:1787119492.568339:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (24399872->24436735) req@ffff92a508f69f80 x1873929633380736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.568348:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69f80 with x1873929633380736 ext(24399872->24436735) 00002000:00010000:3.0:1787119492.568352:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69f80 00000100:00100000:3.0:1787119492.568381:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9837 00000100:00100000:3.0:1787119492.568391:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633380736:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.568598:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633380608:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16168us (18447us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119492.568605:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9836 00002000:00100000:1.0:1787119492.568612:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (47001600->47067135) req@ffff92a506ede680 x1873929633380608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.568620:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506ede680 with x1873929633380608 ext(47001600->47067135) 00002000:00010000:1.0:1787119492.568623:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506ede680 00000100:00100000:1.0:1787119492.572052:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.572721:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633380864 00000100:00100000:2.0:1787119492.572732:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633380864 00002000:00100000:2.0:1787119492.572778:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (24354816->24358911) req@ffff92a63403b480 x1873929633380864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.572788:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b480 with x1873929633380864 ext(24354816->24358911) 00002000:00010000:2.0:1787119492.572794:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b480 00000100:00100000:2.0:1787119492.572818:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9838 00000100:00100000:2.0:1787119492.572827:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633380864:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.573071:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633380864:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 244us (1027us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.573078:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9838 00002000:00100000:2.0:1787119492.573085:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (24354816->24358911) req@ffff92a63403b480 x1873929633380864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.573093:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b480 with x1873929633380864 ext(24354816->24358911) 00002000:00010000:2.0:1787119492.573096:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b480 00000100:00100000:0.0:1787119492.574970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.575222:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633380736:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6830us (7193us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119492.575234:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9837 00002000:00100000:3.0:1787119492.575244:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (24399872->24436735) req@ffff92a508f69f80 x1873929633380736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.575255:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69f80 with x1873929633380736 ext(24399872->24436735) 00002000:00010000:3.0:1787119492.575260:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69f80 00000100:00100000:1.0:1787119492.575350:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633381120 00000100:00100000:1.0:1787119492.575359:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633381120 00000100:00100000:1.0:1787119492.575422:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19553 00000100:00100000:1.0:1787119492.575432:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:32728:x1873929633381120:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119492.575865:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119492.575895:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2ca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b77 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.575915:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119492.575920:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119492.576135:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.576149:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.576162:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119492.576215:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976366 00000004:00010000:1.0:1787119492.576242:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a678a3e9 reply state 000000003a27b6eb transno 4294976367 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119492.576251:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119492.577337:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:32728:x1873929633381120:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1897us (2367us total) trans 4294976367 rc 0/0 00000100:00100000:1.0:1787119492.577349:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19553 00000020:00080000:1.0:1787119492.577354:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119492.585876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.586418:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633381248 00000100:00100000:2.0:1787119492.586429:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633381248 00002000:00100000:2.0:1787119492.586528:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (1011712->1015807) req@ffff92a508f69500 x1873929633381248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.586540:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69500 with x1873929633381248 ext(1011712->1015807) 00002000:00010000:2.0:1787119492.586545:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69500 00000100:00100000:2.0:1787119492.586567:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9839 00000100:00100000:2.0:1787119492.586577:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633381248:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.586850:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633381248:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 274us (986us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.586858:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9839 00002000:00100000:2.0:1787119492.586864:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (1011712->1015807) req@ffff92a508f69500 x1873929633381248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.586872:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69500 with x1873929633381248 ext(1011712->1015807) 00002000:00010000:2.0:1787119492.586875:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69500 00000100:00100000:3.0:1787119492.591327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.591392:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633381376 00000100:00100000:0.0:1787119492.591418:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633381376 00002000:00100000:0.0:1787119492.591488:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (24358912->24363007) req@ffff92a508f68e00 x1873929633381376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.591500:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68e00 with x1873929633381376 ext(24358912->24363007) 00002000:00010000:0.0:1787119492.591505:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f68e00 00000100:00100000:0.0:1787119492.591549:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9840 00000100:00100000:0.0:1787119492.591559:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633381376:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.591792:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633381376:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 234us (473us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.591801:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9840 00002000:00100000:0.0:1787119492.591808:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (24358912->24363007) req@ffff92a508f68e00 x1873929633381376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.591816:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f68e00 with x1873929633381376 ext(24358912->24363007) 00002000:00010000:0.0:1787119492.591819:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f68e00 00010000:00010000:2.0:1787119492.591883:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.591897:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.591905:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.591911:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119492.591915:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.591926:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.591942:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119492.591945:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119492.591949:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.591955:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2d7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119492.595422:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968856 is committed 00000100:00100000:3.0:1787119492.595454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.595819:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633381632 00000100:00100000:0.0:1787119492.595829:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633381632 00002000:00010000:0.0:1787119492.595867:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (27367412->18446744073709551615) 00002000:00100000:0.0:1787119492.595872:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6aa00 with x1873929633381632 ext(27367412->18446744073709551615) 00002000:00010000:0.0:1787119492.595884:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6aa00. 00000100:00100000:0.0:1787119492.595913:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9841 00000100:00100000:0.0:1787119492.595923:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633381632:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119492.596300:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 45345609 -> 27367412 00002000:00010000:0.0:1787119492.596305:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119490 -> 1787119491 00002000:00010000:0.0:1787119492.596307:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119489 -> 1787119490 00002000:00010000:0.0:1787119492.596309:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119490 -> 1787119491 00002000:00010000:0.0:1787119492.596311:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1037 -> 1549 00000100:00100000:2.0:1787119492.596398:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633379072:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 125130us (125249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119492.596418:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5019 00000100:00100000:3.0:1787119492.597908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.598712:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633381504 00000100:00100000:2.0:1787119492.598723:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633381504 00002000:00100000:2.0:1787119492.598774:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (1015808->1019903) req@ffff92a508f69880 x1873929633381504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.598786:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69880 with x1873929633381504 ext(1015808->1019903) 00002000:00010000:2.0:1787119492.598792:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69880 00000100:00100000:2.0:1787119492.598823:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9842 00000100:00100000:2.0:1787119492.598833:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633381504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.599096:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633381504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 264us (1195us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.599104:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9842 00002000:00100000:2.0:1787119492.599110:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (1015808->1019903) req@ffff92a508f69880 x1873929633381504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.599119:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69880 with x1873929633381504 ext(1015808->1019903) 00002000:00010000:2.0:1787119492.599122:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69880 00000100:00100000:2.0:1787119492.599191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.599226:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633381760 00000100:00100000:3.0:1787119492.599231:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633381760 00002000:00100000:3.0:1787119492.599253:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (47022080->47054847) req@ffff92a506eddc00 x1873929633381760/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.599262:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506eddc00 with x1873929633381760 ext(47022080->47054847) 00002000:00010000:3.0:1787119492.599266:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506eddc00 00000100:00100000:3.0:1787119492.599377:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9843 00000100:00100000:3.0:1787119492.599384:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633381760:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119492.600666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.600728:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633381888 00000100:00100000:3.0:1787119492.600736:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633381888 00002000:00100000:3.0:1787119492.600770:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (24334336->24399871) req@ffff92a506edd500 x1873929633381888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.600779:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd500 with x1873929633381888 ext(24334336->24399871) 00002000:00010000:3.0:1787119492.600784:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edd500 00000100:00100000:3.0:1787119492.600814:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9844 00000100:00100000:3.0:1787119492.600823:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633381888:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.603870:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633381632:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 7931us (8420us total) trans 4294969099 rc 0/0 00000100:00100000:0.0:1787119492.603886:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9841 00002000:00010000:0.0:1787119492.603893:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (27367412->18446744073709551615) 00002000:00100000:0.0:1787119492.603896:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6aa00 with x1873929633381632 ext(27367412->18446744073709551615) 00002000:00010000:0.0:1787119492.603908:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f6aa00. 00000100:00100000:2.0:1787119492.607166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.607298:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633382144 00000100:00100000:0.0:1787119492.607310:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633382144 00002000:00100000:0.0:1787119492.607389:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (6778880->6782975) req@ffff92a506eddf80 x1873929633382144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.607537:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506eddf80 with x1873929633382144 ext(6778880->6782975) 00002000:00010000:0.0:1787119492.607545:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506eddf80 00000100:00100000:0.0:1787119492.607573:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9845 00000100:00100000:0.0:1787119492.607585:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633382144:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.608236:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633382144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 651us (1079us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.608246:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9845 00002000:00100000:0.0:1787119492.608254:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (6778880->6782975) req@ffff92a506eddf80 x1873929633382144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.608268:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506eddf80 with x1873929633382144 ext(6778880->6782975) 00002000:00010000:0.0:1787119492.608271:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506eddf80 00000100:00100000:2.0:1787119492.608904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.609125:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633381888:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8301us (8465us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119492.609133:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9844 00002000:00100000:0.0:1787119492.609142:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (24334336->24399871) req@ffff92a506edd500 x1873929633381888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.609152:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd500 with x1873929633381888 ext(24334336->24399871) 00002000:00010000:0.0:1787119492.609156:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edd500 00000100:00100000:0.0:1787119492.609176:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633382016 00000100:00100000:0.0:1787119492.609183:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633382016 00002000:00100000:0.0:1787119492.609210:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (1019904->1056767) req@ffff92a506edf100 x1873929633382016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.609218:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edf100 with x1873929633382016 ext(1019904->1056767) 00002000:00010000:0.0:1787119492.609221:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edf100 00000100:00100000:0.0:1787119492.609250:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9846 00000100:00100000:0.0:1787119492.609258:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633382016:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.623835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.623877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.624397:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633381760:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 25011us (25204us total) trans 4294968858 rc 0/0 00000100:00100000:0.0:1787119492.624410:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9843 00002000:00100000:0.0:1787119492.624422:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (47022080->47054847) req@ffff92a506eddc00 x1873929633381760/t4294968858(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/448 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.624460:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506eddc00 with x1873929633381760 ext(47022080->47054847) 00002000:00010000:0.0:1787119492.624467:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506eddc00 00000100:00100000:0.0:1787119492.624493:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633382272 00000100:00100000:0.0:1787119492.624500:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633382272 00002000:00100000:0.0:1787119492.624543:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (6782976->6787071) req@ffff92a508f6b480 x1873929633382272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.624552:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6b480 with x1873929633382272 ext(6782976->6787071) 00002000:00010000:0.0:1787119492.624555:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6b480 00000100:00100000:0.0:1787119492.624582:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9847 00000100:00100000:0.0:1787119492.624591:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633382272:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.624731:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633382272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 141us (852us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.624738:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9847 00002000:00100000:0.0:1787119492.624744:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (6782976->6787071) req@ffff92a508f6b480 x1873929633382272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.624752:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6b480 with x1873929633382272 ext(6782976->6787071) 00002000:00010000:0.0:1787119492.624755:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6b480 00000100:00100000:0.0:1787119492.624835:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633382016:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15578us (15935us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119492.624841:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9846 00002000:00100000:0.0:1787119492.624847:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (1019904->1056767) req@ffff92a506edf100 x1873929633382016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.624860:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edf100 with x1873929633382016 ext(1019904->1056767) 00002000:00010000:0.0:1787119492.624863:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edf100 00000100:00100000:2.0:1787119492.628120:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633382400 00000100:00100000:2.0:1787119492.628137:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633382400 00000100:00100000:2.0:1787119492.628219:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19554 00000100:00100000:2.0:1787119492.628229:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:32728:x1873929633382400:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119492.628255:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119492.628277:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2d83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715bc4 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.628365:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.628380:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.628392:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119492.628416:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 27367412 00000004:00200000:2.0:1787119492.628420:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119492.628473:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.628503:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2d83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bc4 expref: 39 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.628532:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bc4 expref: 38 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.628541:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119492.628544:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119492.628548:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0600, rc 0) 00000100:00100000:2.0:1787119492.628617:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:32728:x1873929633382400:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 389us (4792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119492.628624:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19554 00000100:00100000:3.0:1787119492.645998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.646143:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633382528 00000100:00100000:0.0:1787119492.646155:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633382528 00002000:00100000:0.0:1787119492.646209:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (24399872->24436735) req@ffff92a508f69c00 x1873929633382528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.646220:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69c00 with x1873929633382528 ext(24399872->24436735) 00002000:00010000:0.0:1787119492.646227:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69c00 00000100:00100000:0.0:1787119492.646267:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9848 00000100:00100000:0.0:1787119492.646277:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633382528:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.649890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.650089:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633382656 00000100:00100000:2.0:1787119492.650101:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633382656 00002000:00100000:2.0:1787119492.650150:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (1056768->1093631) req@ffff92a5098a5180 x1873929633382656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.650161:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5180 with x1873929633382656 ext(1056768->1093631) 00002000:00010000:2.0:1787119492.650167:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5180 00000100:00100000:2.0:1787119492.650206:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9849 00000100:00100000:2.0:1787119492.650216:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633382656:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.659569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.661049:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633382784 00000100:00100000:3.0:1787119492.661065:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633382784 00000100:00100000:3.0:1787119492.661289:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5020 00000100:00100000:3.0:1787119492.661302:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633382784:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119492.661696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.661953:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633382528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15673us (15962us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119492.661967:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9848 00002000:00100000:3.0:1787119492.661980:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (24399872->24436735) req@ffff92a508f69c00 x1873929633382528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.661992:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69c00 with x1873929633382528 ext(24399872->24436735) 00002000:00010000:3.0:1787119492.661998:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69c00 00000100:00100000:3.0:1787119492.662022:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633382912 00000100:00100000:3.0:1787119492.662027:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633382912 00002000:00100000:3.0:1787119492.662056:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (6758400->6823935) req@ffff92a5098a6a00 x1873929633382912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.662065:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6a00 with x1873929633382912 ext(6758400->6823935) 00002000:00010000:3.0:1787119492.662070:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a6a00 00000100:00100000:3.0:1787119492.662090:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9850 00000100:00100000:3.0:1787119492.662100:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633382912:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.668052:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633382656:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17825us (18160us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119492.668068:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9849 00002000:00100000:0.0:1787119492.668080:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (1056768->1093631) req@ffff92a5098a5180 x1873929633382656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.668091:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5180 with x1873929633382656 ext(1056768->1093631) 00002000:00010000:0.0:1787119492.668097:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5180 00000100:00100000:3.0:1787119492.668869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.668962:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633382912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6863us (7268us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119492.668970:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9850 00002000:00100000:3.0:1787119492.668977:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (6758400->6823935) req@ffff92a5098a6a00 x1873929633382912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.668986:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6a00 with x1873929633382912 ext(6758400->6823935) 00002000:00010000:3.0:1787119492.668991:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a6a00 00000100:00100000:3.0:1787119492.669009:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633383040 00000100:00100000:3.0:1787119492.669015:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633383040 00002000:00100000:3.0:1787119492.669044:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (1011712->1015807) req@ffff92a508f69180 x1873929633383040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.669051:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69180 with x1873929633383040 ext(1011712->1015807) 00002000:00010000:3.0:1787119492.669055:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69180 00000100:00100000:3.0:1787119492.669075:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9851 00000100:00100000:3.0:1787119492.669083:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633383040:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.669267:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633383040:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 185us (400us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.669275:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9851 00002000:00100000:3.0:1787119492.669280:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (1011712->1015807) req@ffff92a508f69180 x1873929633383040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.669290:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f69180 with x1873929633383040 ext(1011712->1015807) 00002000:00010000:3.0:1787119492.669293:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508f69180 00000100:00100000:3.0:1787119492.674699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.674753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.674789:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633383424 00000100:00100000:3.0:1787119492.674799:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633383424 00000100:00100000:3.0:1787119492.674854:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19555 00000100:00100000:3.0:1787119492.674864:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:32728:x1873929633383424:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119492.674933:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119492.674967:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2d8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bc4 expref: 38 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.674989:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119492.674995:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119492.675228:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.675242:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.675252:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119492.675304:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976368 00000004:00010000:3.0:1787119492.675330:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002dfe5c67 reply state 00000000ca116a7d transno 4294976369 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.675339:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119492.675424:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:32728:x1873929633383424:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 560us (670us total) trans 4294976369 rc 0/0 00000100:00100000:3.0:1787119492.675432:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19555 00000020:00080000:3.0:1787119492.675474:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119492.676411:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633383168 00000100:00100000:1.0:1787119492.676420:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633383168 00002000:00100000:1.0:1787119492.676491:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (6823936->6860799) req@ffff92a519cde680 x1873929633383168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.676503:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cde680 with x1873929633383168 ext(6823936->6860799) 00002000:00010000:1.0:1787119492.676517:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cde680 00000100:00100000:1.0:1787119492.676541:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9852 00000100:00100000:1.0:1787119492.676549:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633383168:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.681867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.683079:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633383552 00000100:00100000:3.0:1787119492.683093:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633383552 00002000:00100000:3.0:1787119492.683145:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (1015808->1019903) req@ffff92a5098a6d80 x1873929633383552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.683158:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633383552 ext(1015808->1019903) 00002000:00010000:3.0:1787119492.683164:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6d80 00000100:00100000:3.0:1787119492.683190:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9853 00000100:00100000:3.0:1787119492.683199:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633383552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.683607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.683888:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633383552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 688us (2031us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.683896:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9853 00002000:00100000:3.0:1787119492.683905:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (1015808->1019903) req@ffff92a5098a6d80 x1873929633383552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.683914:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633383552 ext(1015808->1019903) 00002000:00010000:3.0:1787119492.683919:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6d80 00000100:00100000:3.0:1787119492.683939:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633383680 00000100:00100000:3.0:1787119492.683943:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633383680 00002000:00100000:3.0:1787119492.683960:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (33882112->33943551) req@ffff92a506ede300 x1873929633383680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.683970:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506ede300 with x1873929633383680 ext(33882112->33943551) 00002000:00010000:3.0:1787119492.683973:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506ede300 00000100:00100000:3.0:1787119492.683989:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9854 00000100:00100000:3.0:1787119492.683997:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633383680:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.706593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119492.706672:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.706685:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.706693:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.706769:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c64400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119492.706774:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.706782:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.706803:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119492.706806:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119492.706812:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.706819:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2d91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119492.712263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.712296:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633383808 00000100:00100000:2.0:1787119492.712305:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633383808 00002000:00010000:2.0:1787119492.712344:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (49988592->18446744073709551615) 00002000:00100000:2.0:1787119492.712350:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7100 with x1873929633383808 ext(49988592->18446744073709551615) 00002000:00010000:2.0:1787119492.712363:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd7100. 00000100:00100000:2.0:1787119492.712403:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633383936 00000100:00100000:2.0:1787119492.712407:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633383936 00002000:00100000:2.0:1787119492.712429:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (1019904->1056767) req@ffff92a506edd880 x1873929633383936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.712464:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd880 with x1873929633383936 ext(1019904->1056767) 00002000:00010000:2.0:1787119492.712469:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edd880 00000100:00100000:2.0:1787119492.712490:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9855 00000100:00100000:2.0:1787119492.712500:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633383808:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119492.712740:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 27367412 -> 49988592 00002000:00010000:2.0:1787119492.712744:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119492.712746:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:2.0:1787119492.712749:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119492.712751:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1549 -> 1549 00000100:00100000:2.0:1787119492.712803:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633383808:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 304us (6222us total) trans 4294969100 rc 0/0 00000100:00100000:2.0:1787119492.712811:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9855 00002000:00010000:2.0:1787119492.712814:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (49988592->18446744073709551615) 00002000:00100000:2.0:1787119492.712817:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63ebd7100 with x1873929633383808 ext(49988592->18446744073709551615) 00002000:00010000:2.0:1787119492.712821:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63ebd7100. 00000100:00100000:2.0:1787119492.712838:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9856 00000100:00100000:2.0:1787119492.712845:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633383936:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.713422:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633383680:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 29422us (29812us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1787119492.713432:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9854 00002000:00100000:3.0:1787119492.713462:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (33882112->33943551) req@ffff92a506ede300 x1873929633383680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.713472:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506ede300 with x1873929633383680 ext(33882112->33943551) 00002000:00010000:3.0:1787119492.713477:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506ede300 00000100:00100000:0.0:1787119492.713729:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633383168:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 37180us (39041us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119492.713740:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9852 00002000:00100000:0.0:1787119492.713746:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (6823936->6860799) req@ffff92a519cde680 x1873929633383168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.713755:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cde680 with x1873929633383168 ext(6823936->6860799) 00002000:00010000:0.0:1787119492.713759:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cde680 00000001:00080000:0.0:1787119492.715733:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968858 is committed 00000100:00100000:3.0:1787119492.716179:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633382784:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 54874us (56619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119492.716190:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5020 00000100:00100000:1.0:1787119492.718916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.720100:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633384192 00000100:00100000:3.0:1787119492.720113:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633384192 00000100:00100000:3.0:1787119492.720187:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19556 00000100:00100000:3.0:1787119492.720197:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:32729:x1873929633384192:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119492.720257:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119492.720286:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2cf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b8c expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.720307:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119492.720313:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119492.720617:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.720631:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.720641:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119492.720693:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976370 00000004:00010000:3.0:1787119492.720717:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4707a53 reply state 00000000a8f69ad7 transno 4294976371 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.720726:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119492.720815:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:32729:x1873929633384192:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 619us (1909us total) trans 4294976371 rc 0/0 00000100:00100000:3.0:1787119492.720823:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19556 00000020:00080000:3.0:1787119492.720827:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119492.721034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.721121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.721310:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633384320 00000100:00100000:0.0:1787119492.721317:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633384320 00002000:00100000:0.0:1787119492.721352:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (6778880->6832127) req@ffff92a506e58a80 x1873929633384320/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.721363:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58a80 with x1873929633384320 ext(6778880->6832127) 00002000:00010000:0.0:1787119492.721380:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e58a80 00000100:00100000:0.0:1787119492.721408:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633384448 00000100:00100000:0.0:1787119492.721411:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633384448 00002000:00100000:0.0:1787119492.721429:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (49967104->49971199) req@ffff92a506dffb80 x1873929633384448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.721465:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dffb80 with x1873929633384448 ext(49967104->49971199) 00002000:00010000:0.0:1787119492.721469:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dffb80 00000100:00100000:0.0:1787119492.721486:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9857 00000100:00100000:0.0:1787119492.721494:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633384320:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119492.721628:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9858 00000100:00100000:0.0:1787119492.721635:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633384448:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.721836:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633384448:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 201us (714us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.721844:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9858 00002000:00100000:0.0:1787119492.721850:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (49967104->49971199) req@ffff92a506dffb80 x1873929633384448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.721858:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506dffb80 with x1873929633384448 ext(49967104->49971199) 00002000:00010000:0.0:1787119492.721861:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506dffb80 00010000:00010000:0.0:1787119492.722726:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.722739:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.722747:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.722754:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c65800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119492.722758:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.722766:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.722782:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119492.722785:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119492.722789:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.722795:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2d98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119492.723039:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633383936:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10191us (10782us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119492.723047:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9856 00002000:00100000:2.0:1787119492.723056:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (1019904->1056767) req@ffff92a506edd880 x1873929633383936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.723065:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd880 with x1873929633383936 ext(1019904->1056767) 00002000:00010000:2.0:1787119492.723069:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edd880 00000100:00100000:1.0:1787119492.727251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.727358:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633384576 00000100:00100000:3.0:1787119492.727368:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633384576 00002000:00010000:3.0:1787119492.727648:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (27367412->18446744073709551615) 00002000:00100000:3.0:1787119492.727653:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6680 with x1873929633384576 ext(27367412->18446744073709551615) 00002000:00010000:3.0:1787119492.727666:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6680. 00000100:00100000:3.0:1787119492.727744:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9859 00000100:00100000:3.0:1787119492.727756:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633384576:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119492.728090:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 45345609 -> 27367412 00002000:00010000:3.0:1787119492.728095:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119490 -> 1787119491 00002000:00010000:3.0:1787119492.728097:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119492.728099:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119490 -> 1787119491 00002000:00010000:3.0:1787119492.728101:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1037 -> 1549 00000100:00100000:3.0:1787119492.728207:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633384576:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 453us (965us total) trans 4294969101 rc 0/0 00000100:00100000:3.0:1787119492.728216:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9859 00002000:00010000:3.0:1787119492.728220:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (27367412->18446744073709551615) 00002000:00100000:3.0:1787119492.728223:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6680 with x1873929633384576 ext(27367412->18446744073709551615) 00002000:00010000:3.0:1787119492.728229:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6680. 00000100:00100000:3.0:1787119492.734148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.734253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.734928:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633384704 00000100:00100000:0.0:1787119492.734939:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633384704 00002000:00100000:0.0:1787119492.735001:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (21311488->21315583) req@ffff92a519cdd500 x1873929633384704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.735016:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd500 with x1873929633384704 ext(21311488->21315583) 00002000:00010000:0.0:1787119492.735021:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdd500 00000100:00100000:0.0:1787119492.735055:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633384832 00000100:00100000:0.0:1787119492.735058:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633384832 00002000:00100000:0.0:1787119492.735077:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (49971200->49975295) req@ffff92a519cddf80 x1873929633384832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.735086:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cddf80 with x1873929633384832 ext(49971200->49975295) 00002000:00010000:0.0:1787119492.735089:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cddf80 00000100:00100000:0.0:1787119492.735117:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9860 00000100:00100000:0.0:1787119492.735128:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633384704:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.735489:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9861 00000100:00100000:3.0:1787119492.735501:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633384832:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.735711:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633384704:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 583us (1573us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.735719:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9860 00002000:00100000:0.0:1787119492.735726:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (21311488->21315583) req@ffff92a519cdd500 x1873929633384704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.735734:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd500 with x1873929633384704 ext(21311488->21315583) 00002000:00010000:0.0:1787119492.735737:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdd500 00000100:00100000:3.0:1787119492.735993:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633384832:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 494us (1740us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.736001:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9861 00002000:00100000:3.0:1787119492.736008:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (49971200->49975295) req@ffff92a519cddf80 x1873929633384832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.736016:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cddf80 with x1873929633384832 ext(49971200->49975295) 00002000:00010000:3.0:1787119492.736020:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cddf80 00000100:00100000:0.0:1787119492.740685:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633384320:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 19182us (19642us total) trans 4294968859 rc 0/0 00000100:00100000:0.0:1787119492.740789:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9857 00002000:00100000:0.0:1787119492.740803:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (6778880->6832127) req@ffff92a506e58a80 x1873929633384320/t4294968859(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/448 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.740815:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506e58a80 with x1873929633384320 ext(6778880->6832127) 00002000:00010000:0.0:1787119492.740821:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506e58a80 00000100:00100000:2.0:1787119492.741300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.741332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.741548:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633385088 00000100:00100000:0.0:1787119492.741557:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633385088 00002000:00100000:0.0:1787119492.741602:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (1056768->1093631) req@ffff92a506edea00 x1873929633385088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.741611:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edea00 with x1873929633385088 ext(1056768->1093631) 00002000:00010000:0.0:1787119492.741620:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edea00 00000100:00100000:0.0:1787119492.741650:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9862 00000100:00100000:0.0:1787119492.741660:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633385088:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.742005:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633384960 00000100:00100000:3.0:1787119492.742010:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633384960 00000100:00100000:3.0:1787119492.742054:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19557 00000100:00100000:3.0:1787119492.742061:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:32729:x1873929633384960:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119492.742077:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119492.742110:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2d9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715bcb expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.742193:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2da6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.742207:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.742218:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119492.742242:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 27367412 00000004:00200000:3.0:1787119492.742246:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119492.742262:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.742285:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2d9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bcb expref: 42 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.742301:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bcb expref: 41 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.742309:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119492.742311:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119492.742314:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c65a00, rc 0) 00000100:00100000:3.0:1787119492.742345:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:32729:x1873929633384960:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 285us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119492.742350:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19557 00000100:00100000:3.0:1787119492.743595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.743708:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633385216 00000100:00100000:0.0:1787119492.743717:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633385216 00002000:00100000:0.0:1787119492.743760:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (21315584->21319679) req@ffff92a519cdd880 x1873929633385216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.743770:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd880 with x1873929633385216 ext(21315584->21319679) 00002000:00010000:0.0:1787119492.743775:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdd880 00000100:00100000:0.0:1787119492.743808:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9863 00000100:00100000:0.0:1787119492.743817:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633385216:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.744058:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633385216:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 242us (470us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.744066:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9863 00002000:00100000:0.0:1787119492.744073:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (21315584->21319679) req@ffff92a519cdd880 x1873929633385216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.744086:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd880 with x1873929633385216 ext(21315584->21319679) 00002000:00010000:0.0:1787119492.744089:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdd880 00000100:00100000:0.0:1787119492.746082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.746173:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633385344 00000100:00100000:1.0:1787119492.746183:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633385344 00002000:00100000:1.0:1787119492.746225:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (49946624->49991679) req@ffff92a5098a7100 x1873929633385344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.746236:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7100 with x1873929633385344 ext(49946624->49991679) 00002000:00010000:1.0:1787119492.746242:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a7100 00000100:00100000:1.0:1787119492.746273:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9864 00000100:00100000:1.0:1787119492.746282:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633385344:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119492.752864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.752926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.752956:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633385600 00000100:00100000:1.0:1787119492.752966:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633385600 00000100:00100000:1.0:1787119492.753025:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5021 00000100:00100000:1.0:1787119492.753034:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633385600:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119492.753211:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633385344:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6929us (7137us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119492.753219:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9864 00002000:00100000:1.0:1787119492.753228:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (49946624->49991679) req@ffff92a5098a7100 x1873929633385344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.753238:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7100 with x1873929633385344 ext(49946624->49991679) 00002000:00010000:1.0:1787119492.753243:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a7100 00000100:00100000:1.0:1787119492.753259:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633385472 00000100:00100000:1.0:1787119492.753263:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633385472 00002000:00100000:1.0:1787119492.753279:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (21291008->21356543) req@ffff92a508da5c00 x1873929633385472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.753288:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5c00 with x1873929633385472 ext(21291008->21356543) 00002000:00010000:1.0:1787119492.753292:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da5c00 00000100:00100000:1.0:1787119492.753308:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9865 00000100:00100000:1.0:1787119492.753315:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633385472:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.754205:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633385088:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12541us (12866us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119492.754216:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9862 00002000:00100000:0.0:1787119492.754224:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (1056768->1093631) req@ffff92a506edea00 x1873929633385088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.754234:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edea00 with x1873929633385088 ext(1056768->1093631) 00002000:00010000:0.0:1787119492.754238:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edea00 00000100:00100000:1.0:1787119492.761331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.761419:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633385728 00000100:00100000:2.0:1787119492.761430:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633385728 00002000:00100000:2.0:1787119492.761513:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (33882112->33943551) req@ffff92a508da6a00 x1873929633385728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.761523:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6a00 with x1873929633385728 ext(33882112->33943551) 00002000:00010000:2.0:1787119492.761528:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6a00 00000100:00100000:2.0:1787119492.761562:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9866 00000100:00100000:2.0:1787119492.761572:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633385728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.767032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.767324:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633385856 00000100:00100000:3.0:1787119492.767338:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633385856 00002000:00100000:3.0:1787119492.767896:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (49967104->49988591) req@ffff92a511631500 x1873929633385856/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.767908:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633385856 ext(49967104->49988591) 00002000:00010000:3.0:1787119492.767915:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511631500 00000100:00100000:2.0:1787119492.768213:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9867 00000100:00100000:2.0:1787119492.768229:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633385856:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119492.779566:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633385472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 26239us (26702us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119492.779582:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9865 00002000:00100000:1.0:1787119492.779595:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (21291008->21356543) req@ffff92a508da5c00 x1873929633385472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.779605:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5c00 with x1873929633385472 ext(21291008->21356543) 00002000:00010000:1.0:1787119492.779612:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da5c00 00000100:00100000:0.0:1787119492.800940:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633385728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 39357us (39606us total) trans 0 rc 61440/61440 00000100:00100000:0.0:1787119492.800955:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9866 00002000:00100000:0.0:1787119492.800969:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (33882112->33943551) req@ffff92a508da6a00 x1873929633385728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.800980:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6a00 with x1873929633385728 ext(33882112->33943551) 00002000:00010000:0.0:1787119492.800987:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6a00 00000100:00100000:0.0:1787119492.801680:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633385856:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 33453us (34655us total) trans 4294969102 rc 0/0 00000100:00100000:0.0:1787119492.801690:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9867 00002000:00100000:0.0:1787119492.801697:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (49967104->49988591) req@ffff92a511631500 x1873929633385856/t4294969102(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/448 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.801713:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633385856 ext(49967104->49988591) 00002000:00010000:0.0:1787119492.801717:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511631500 00000100:00100000:2.0:1787119492.801902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119492.802149:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633386112 00000100:00100000:0.0:1787119492.802158:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633386112 00000100:00100000:0.0:1787119492.802201:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19558 00000100:00100000:0.0:1787119492.802209:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:32729:x1873929633386112:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119492.802255:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119492.802279:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65a00/0xcaba3de8463e2da6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bcb expref: 41 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.802298:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119492.802303:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119492.802546:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.802560:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.802569:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119492.802611:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976372 00000004:00010000:0.0:1787119492.802633:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a50ae33 reply state 000000008fb560d7 transno 4294976373 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119492.802643:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119492.802704:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:32729:x1873929633386112:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 496us (803us total) trans 4294976373 rc 0/0 00000100:00100000:0.0:1787119492.802715:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19558 00000020:00080000:0.0:1787119492.802718:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119492.811666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.812184:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633386240 00000100:00100000:1.0:1787119492.812195:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633386240 00002000:00100000:1.0:1787119492.812246:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (21356544->21393407) req@ffff92a506edc380 x1873929633386240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.812258:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edc380 with x1873929633386240 ext(21356544->21393407) 00002000:00010000:1.0:1787119492.812264:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edc380 00000100:00100000:1.0:1787119492.812300:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9868 00000100:00100000:1.0:1787119492.812310:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633386240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.816341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.816497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119492.816533:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.816546:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.816553:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.816560:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119492.816565:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.816578:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.816595:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119492.816599:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119492.816603:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.816609:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2dad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119492.819504:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633386496 00000100:00100000:1.0:1787119492.819528:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633386496 00000100:00100000:1.0:1787119492.819604:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19559 00000100:00100000:1.0:1787119492.819616:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:32727:x1873929633386496:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119492.819674:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119492.819714:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2d13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715b9a expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.819734:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119492.819739:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119492.819961:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.819976:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.819988:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119492.820045:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976374 00000004:00010000:1.0:1787119492.820072:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d46786b reply state 000000007ffade42 transno 4294976375 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119492.820080:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119492.820186:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:32727:x1873929633386496:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 571us (3852us total) trans 4294976375 rc 0/0 00000100:00100000:1.0:1787119492.820193:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19559 00000020:00080000:1.0:1787119492.820198:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119492.820719:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633386624 00000100:00100000:0.0:1787119492.820727:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633386624 00002000:00010000:0.0:1787119492.820755:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (49988592->18446744073709551615) 00002000:00100000:0.0:1787119492.820760:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edc700 with x1873929633386624 ext(49988592->18446744073709551615) 00002000:00010000:0.0:1787119492.820769:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edc700. 00000100:00100000:0.0:1787119492.820791:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9869 00000100:00100000:0.0:1787119492.820799:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633386624:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119492.820956:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 27367412 -> 49988592 00002000:00010000:0.0:1787119492.820960:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:0.0:1787119492.820962:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:0.0:1787119492.820965:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:0.0:1787119492.820968:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1549 -> 1549 00000100:00100000:0.0:1787119492.821005:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633386624:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 207us (4509us total) trans 4294969103 rc 0/0 00000100:00100000:0.0:1787119492.821012:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9869 00002000:00010000:0.0:1787119492.821015:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (49988592->18446744073709551615) 00002000:00100000:0.0:1787119492.821018:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edc700 with x1873929633386624 ext(49988592->18446744073709551615) 00002000:00010000:0.0:1787119492.821022:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506edc700. 00000100:00100000:3.0:1787119492.823118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.823234:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633386752 00000100:00100000:1.0:1787119492.823248:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633386752 00000100:00100000:1.0:1787119492.823300:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5022 00000100:00100000:1.0:1787119492.823310:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633386752:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119492.823528:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633386240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11218us (11872us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119492.823537:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9868 00002000:00100000:1.0:1787119492.823547:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (21356544->21393407) req@ffff92a506edc380 x1873929633386240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.823558:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edc380 with x1873929633386240 ext(21356544->21393407) 00002000:00010000:1.0:1787119492.823564:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edc380 00010000:00010000:0.0:1787119492.824159:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.824172:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.824184:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.824190:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119492.824195:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.824203:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.824219:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119492.824223:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119492.824227:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119492.824234:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2db4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.827256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.827292:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633386880 00000100:00100000:3.0:1787119492.827301:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633386880 00002000:00100000:3.0:1787119492.827346:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (49967104->49971199) req@ffff92a519cdfb80 x1873929633386880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.827357:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdfb80 with x1873929633386880 ext(49967104->49971199) 00002000:00010000:3.0:1787119492.827363:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdfb80 00000100:00100000:3.0:1787119492.827393:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9870 00000100:00100000:3.0:1787119492.827402:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633386880:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.827669:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633386880:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 266us (420us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.827678:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9870 00002000:00100000:3.0:1787119492.827684:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (49967104->49971199) req@ffff92a519cdfb80 x1873929633386880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.827691:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdfb80 with x1873929633386880 ext(49967104->49971199) 00002000:00010000:3.0:1787119492.827695:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdfb80 00000100:00100000:2.0:1787119492.838608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.838655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.838686:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633387008 00000100:00100000:2.0:1787119492.838697:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633387008 00002000:00010000:2.0:1787119492.838737:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (27367412->18446744073709551615) 00002000:00100000:2.0:1787119492.838742:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b100 with x1873929633387008 ext(27367412->18446744073709551615) 00002000:00010000:2.0:1787119492.838755:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b100. 00000100:00100000:2.0:1787119492.838779:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633387136 00000100:00100000:2.0:1787119492.838782:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633387136 00002000:00100000:2.0:1787119492.838802:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (49971200->49975295) req@ffff92a606158380 x1873929633387136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.838813:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158380 with x1873929633387136 ext(49971200->49975295) 00002000:00010000:2.0:1787119492.838818:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158380 00000100:00100000:2.0:1787119492.838837:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9871 00000100:00100000:2.0:1787119492.838846:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633387008:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119492.839187:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 45345609 -> 27367412 00002000:00010000:2.0:1787119492.839191:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119490 -> 1787119491 00002000:00010000:2.0:1787119492.839194:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:2.0:1787119492.839196:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119490 -> 1787119491 00002000:00010000:2.0:1787119492.839199:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1037 -> 1549 00000100:00100000:2.0:1787119492.839259:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633387008:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 412us (660us total) trans 4294969104 rc 0/0 00000100:00100000:2.0:1787119492.839267:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9871 00002000:00010000:2.0:1787119492.839271:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (27367412->18446744073709551615) 00002000:00100000:2.0:1787119492.839273:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b100 with x1873929633387008 ext(27367412->18446744073709551615) 00002000:00010000:2.0:1787119492.839278:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b100. 00000100:00100000:2.0:1787119492.839296:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9872 00000100:00100000:2.0:1787119492.839303:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633387136:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.839497:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633387136:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 193us (841us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.839517:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9872 00002000:00100000:2.0:1787119492.839526:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (49971200->49975295) req@ffff92a606158380 x1873929633387136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.839534:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158380 with x1873929633387136 ext(49971200->49975295) 00002000:00010000:2.0:1787119492.839538:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158380 00000100:00100000:1.0:1787119492.840191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.840330:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633387264 00000100:00100000:1.0:1787119492.840337:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633387264 00002000:00100000:1.0:1787119492.840375:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (21311488->21364735) req@ffff92a511453480 x1873929633387264/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.840384:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511453480 with x1873929633387264 ext(21311488->21364735) 00002000:00010000:1.0:1787119492.840388:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511453480 00000100:00100000:1.0:1787119492.840411:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9873 00000100:00100000:1.0:1787119492.840419:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633387264:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119492.845068:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633387264:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 4640us (4868us total) trans 4294968860 rc 0/0 00000100:00100000:1.0:1787119492.845083:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9873 00002000:00100000:1.0:1787119492.845096:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (21311488->21364735) req@ffff92a511453480 x1873929633387264/t4294968860(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/448 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.845108:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511453480 with x1873929633387264 ext(21311488->21364735) 00002000:00010000:1.0:1787119492.845114:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511453480 00000100:00100000:3.0:1787119492.860531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.860561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.860584:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633387520 00000100:00100000:3.0:1787119492.860593:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633387520 00000100:00100000:3.0:1787119492.860638:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19560 00000100:00100000:3.0:1787119492.860646:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:32727:x1873929633387520:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119492.860668:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119492.860687:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715bd2 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.860770:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2dc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.860783:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.860794:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119492.860815:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 27367412 00000004:00200000:3.0:1787119492.860819:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119492.860835:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.860858:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bd2 expref: 45 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.860874:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bd2 expref: 44 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.860882:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119492.860885:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119492.860889:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c65000, rc 0) 00000100:00100000:3.0:1787119492.860938:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:32727:x1873929633387520:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 293us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119492.860945:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19560 00000100:00100000:3.0:1787119492.860987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.861180:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633387392 00000100:00100000:1.0:1787119492.861185:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633387392 00002000:00100000:1.0:1787119492.861213:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (49946624->49991679) req@ffff92a519cdea00 x1873929633387392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119492.861230:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdea00 with x1873929633387392 ext(49946624->49991679) 00002000:00010000:1.0:1787119492.861234:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdea00 00000100:00100000:1.0:1787119492.861249:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9874 00000100:00100000:1.0:1787119492.861255:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633387392:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.862285:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633387648 00000100:00100000:2.0:1787119492.862294:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633387648 00000100:00100000:2.0:1787119492.862334:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5023 00000100:00100000:2.0:1787119492.862341:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633387648:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119492.869231:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633387392:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7964us (8697us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119492.869245:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9874 00002000:00100000:0.0:1787119492.869258:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (49946624->49991679) req@ffff92a519cdea00 x1873929633387392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.869268:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdea00 with x1873929633387392 ext(49946624->49991679) 00002000:00010000:0.0:1787119492.869274:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdea00 00000100:00100000:1.0:1787119492.877428:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633385600:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 124384us (124491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119492.877462:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5021 00000100:00100000:1.0:1787119492.878066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.878134:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633387776 00000100:00100000:2.0:1787119492.878142:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633387776 00002000:00100000:2.0:1787119492.878182:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (49967104->49988591) req@ffff92a511450a80 x1873929633387776/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.878193:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511450a80 with x1873929633387776 ext(49967104->49988591) 00002000:00010000:2.0:1787119492.878198:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511450a80 00000100:00100000:2.0:1787119492.878224:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9875 00000100:00100000:2.0:1787119492.878232:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633387776:12345-192.168.201.59@tcp:4:fsx.0 00000001:00080000:2.0:1787119492.879173:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968859 is committed 00000100:00100000:1.0:1787119492.882119:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633386752:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 58798us (58999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119492.882135:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5022 00000001:00080000:0.0:1787119492.882242:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969103 is committed 00000100:00100000:2.0:1787119492.887565:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633387776:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9322us (9490us total) trans 4294969105 rc 0/0 00000100:00100000:2.0:1787119492.887582:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9875 00002000:00100000:2.0:1787119492.887598:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (49967104->49988591) req@ffff92a511450a80 x1873929633387776/t4294969105(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/448 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.887609:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511450a80 with x1873929633387776 ext(49967104->49988591) 00002000:00010000:2.0:1787119492.887616:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511450a80 00000100:00100000:1.0:1787119492.895180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.895219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.895249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.895313:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633388032 00000100:00100000:3.0:1787119492.895324:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633388032 00000100:00100000:3.0:1787119492.895381:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633388288 00000100:00100000:3.0:1787119492.895384:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633388288 00000100:00100000:3.0:1787119492.895408:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19561 00000100:00100000:3.0:1787119492.895418:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:32727:x1873929633388032:12345-192.168.201.59@tcp:36:fsx.0 00000100:00100000:1.0:1787119492.898581:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19562 00000100:00100000:1.0:1787119492.898609:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:32728:x1873929633388288:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119492.898630:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119492.898655:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2dc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715bd9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.898741:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2dd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.898755:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.898772:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119492.898796:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 49988592 00000004:00200000:1.0:1787119492.898799:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119492.898817:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.898841:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2dc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bd9 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.898859:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bd9 expref: 46 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.898868:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119492.898871:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119492.898874:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431800, rc 0) 00000100:00100000:1.0:1787119492.898947:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:32728:x1873929633388288:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 351us (3726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119492.898954:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19562 00010000:00010000:3.0:1787119492.899168:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119492.899186:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65000/0xcaba3de8463e2dc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bd2 expref: 45 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.899197:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119492.899201:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119492.899412:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.899422:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.899430:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119492.899527:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976376 00000004:00010000:3.0:1787119492.899554:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000411b786d reply state 00000000b32f322d transno 4294976377 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.899564:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119492.899611:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:32727:x1873929633388032:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 4194us (4441us total) trans 4294976377 rc 0/0 00000100:00100000:3.0:1787119492.899618:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19561 00000020:00080000:3.0:1787119492.899622:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119492.899719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.899749:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633388416 00000100:00100000:3.0:1787119492.899756:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633388416 00000100:00100000:3.0:1787119492.899785:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5024 00000100:00100000:3.0:1787119492.899791:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633388416:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119492.900434:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633388160 00000100:00100000:0.0:1787119492.900460:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633388160 00002000:00100000:0.0:1787119492.900498:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (45076480->45080575) req@ffff92a63eb2bb80 x1873929633388160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.900517:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2bb80 with x1873929633388160 ext(45076480->45080575) 00002000:00010000:0.0:1787119492.900521:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2bb80 00000100:00100000:0.0:1787119492.900543:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9876 00000100:00100000:0.0:1787119492.900557:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633388160:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119492.900770:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633388160:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 219us (5519us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119492.900777:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9876 00002000:00100000:0.0:1787119492.900783:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (45076480->45080575) req@ffff92a63eb2bb80 x1873929633388160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.900792:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2bb80 with x1873929633388160 ext(45076480->45080575) 00002000:00010000:0.0:1787119492.900795:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2bb80 00010000:00010000:2.0:1787119492.920334:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.920349:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.920355:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.920359:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c64200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119492.920363:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.920377:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.920391:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119492.920393:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119492.920396:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119492.920400:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64200/0xcaba3de8463e2dd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.924729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.924748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.924763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.924785:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633388544 00000100:00100000:3.0:1787119492.924793:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633388544 00002000:00010000:3.0:1787119492.924827:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (49988592->18446744073709551615) 00002000:00100000:3.0:1787119492.924830:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf480 with x1873929633388544 ext(49988592->18446744073709551615) 00002000:00010000:3.0:1787119492.924841:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf480. 00000100:00100000:3.0:1787119492.924856:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633388672 00000100:00100000:3.0:1787119492.924857:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633388672 00002000:00100000:3.0:1787119492.924871:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (45080576->45084671) req@ffff92a519cdc700 x1873929633388672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.924878:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdc700 with x1873929633388672 ext(45080576->45084671) 00002000:00010000:3.0:1787119492.924882:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdc700 00000100:00100000:3.0:1787119492.924894:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9877 00000100:00100000:3.0:1787119492.924902:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633388544:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119492.925142:0:20838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 27367412 -> 49988592 00002000:00010000:3.0:1787119492.925145:0:20838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:3.0:1787119492.925146:0:20838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119492.925148:0:20838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:3.0:1787119492.925149:0:20838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1549 -> 1293 00000100:00100000:3.0:1787119492.925195:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633388544:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 294us (476us total) trans 4294969106 rc 0/0 00000100:00100000:3.0:1787119492.925200:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9877 00002000:00010000:3.0:1787119492.925203:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (49988592->18446744073709551615) 00002000:00100000:3.0:1787119492.925205:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf480 with x1873929633388544 ext(49988592->18446744073709551615) 00002000:00010000:3.0:1787119492.925208:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf480. 00000100:00100000:3.0:1787119492.925220:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9878 00000100:00100000:3.0:1787119492.925224:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633388672:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.925355:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633388672:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 130us (605us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.925359:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9878 00002000:00100000:3.0:1787119492.925363:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (45080576->45084671) req@ffff92a519cdc700 x1873929633388672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.925375:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdc700 with x1873929633388672 ext(45080576->45084671) 00002000:00010000:3.0:1787119492.925378:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdc700 00000100:00100000:3.0:1787119492.925394:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633388928 00000100:00100000:3.0:1787119492.925396:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633388928 00000100:00100000:3.0:1787119492.925416:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19563 00000100:00100000:3.0:1787119492.925420:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:32728:x1873929633388928:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119492.925478:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119492.925513:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2dd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bd9 expref: 46 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.925533:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119492.925538:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119492.925655:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.925666:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.925672:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119492.925704:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976378 00000004:00010000:3.0:1787119492.925719:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7419f3b reply state 0000000000666237 transno 4294976379 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.925725:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119492.925760:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:32728:x1873929633388928:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 340us (996us total) trans 4294976379 rc 0/0 00000100:00100000:3.0:1787119492.925765:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19563 00000020:00080000:3.0:1787119492.925767:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119492.928225:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633387648:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 65877us (67230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119492.928234:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5023 00000001:00080000:2.0:1787119492.928261:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968860 is committed 00010000:00010000:3.0:1787119492.936858:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.936874:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.936880:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.936887:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c64e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119492.936891:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.936899:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.936920:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119492.936923:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119492.936928:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.936934:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119492.939088:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633388416:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 39284us (39356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119492.939101:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5024 00000001:00080000:0.0:1787119492.940609:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969105 is committed 00000100:00100000:0.0:1787119492.956590:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.956656:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633389184 00000100:00100000:2.0:1787119492.956667:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633389184 00002000:00100000:2.0:1787119492.956737:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (45056000->45121535) req@ffff92a511630380 x1873929633389184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.956749:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630380 with x1873929633389184 ext(45056000->45121535) 00002000:00010000:2.0:1787119492.956756:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511630380 00000100:00100000:2.0:1787119492.956796:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9879 00000100:00100000:2.0:1787119492.956806:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633389184:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.957107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.957220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.957246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.957272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.957291:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633389056 00000100:00100000:2.0:1787119492.957295:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633389056 00002000:00010000:2.0:1787119492.957313:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (62516461->18446744073709551615) 00002000:00100000:2.0:1787119492.957316:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158700 with x1873929633389056 ext(62516461->18446744073709551615) 00002000:00010000:2.0:1787119492.957328:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158700. 00000100:00100000:2.0:1787119492.957344:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633389440 00000100:00100000:2.0:1787119492.957347:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633389440 00002000:00100000:2.0:1787119492.957363:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (49967104->49971199) req@ffff92a606158000 x1873929633389440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.957371:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158000 with x1873929633389440 ext(49967104->49971199) 00002000:00010000:2.0:1787119492.957375:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158000 00000100:00100000:2.0:1787119492.957387:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633389312 00000100:00100000:2.0:1787119492.957390:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633389312 00002000:00100000:2.0:1787119492.957404:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (6778880->6782975) req@ffff92a606158e00 x1873929633389312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.957412:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158e00 with x1873929633389312 ext(6778880->6782975) 00002000:00010000:2.0:1787119492.957415:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158e00 00000100:00100000:2.0:1787119492.957432:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9880 00000100:00100000:2.0:1787119492.957468:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633389056:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119492.957715:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 49988592 -> 62516461 00002000:00010000:2.0:1787119492.957719:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119492.957721:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119491 00002000:00010000:2.0:1787119492.957723:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119492.957726:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1549 -> 1421 00000100:00100000:2.0:1787119492.957764:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633389056:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 325us (658us total) trans 4294969107 rc 0/0 00000100:00100000:2.0:1787119492.957772:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9880 00002000:00010000:2.0:1787119492.957776:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (62516461->18446744073709551615) 00002000:00100000:2.0:1787119492.957778:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158700 with x1873929633389056 ext(62516461->18446744073709551615) 00002000:00010000:2.0:1787119492.957782:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158700. 00000100:00100000:2.0:1787119492.957798:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9881 00000100:00100000:2.0:1787119492.957805:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633389440:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.957928:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633389440:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 123us (707us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.957935:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9881 00002000:00100000:2.0:1787119492.957941:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (49967104->49971199) req@ffff92a606158000 x1873929633389440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.957949:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158000 with x1873929633389440 ext(49967104->49971199) 00002000:00010000:2.0:1787119492.957953:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158000 00000100:00100000:2.0:1787119492.957968:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9882 00000100:00100000:2.0:1787119492.957974:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633389312:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.958072:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633389312:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 97us (825us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.958078:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9882 00002000:00100000:2.0:1787119492.958084:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (6778880->6782975) req@ffff92a606158e00 x1873929633389312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.958096:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158e00 with x1873929633389312 ext(6778880->6782975) 00002000:00010000:2.0:1787119492.958099:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606158e00 00000100:00100000:1.0:1787119492.958498:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633389568 00000100:00100000:1.0:1787119492.958513:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633389568 00000100:00100000:1.0:1787119492.958556:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19564 00000100:00100000:1.0:1787119492.958563:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:32729:x1873929633389568:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119492.958579:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119492.958596:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2de5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715be0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.958676:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2dec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.958702:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.958714:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119492.958741:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 49988592 00000004:00200000:1.0:1787119492.958745:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119492.958761:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.958787:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e2de5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715be0 expref: 49 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.958804:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715be0 expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119492.958813:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119492.958816:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119492.958819:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119492.958861:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:32729:x1873929633389568:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 298us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119492.958868:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19564 00000100:00100000:1.0:1787119492.973316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.973674:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633389696 00000100:00100000:3.0:1787119492.973683:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633389696 00000100:00100000:3.0:1787119492.973751:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19565 00000100:00100000:3.0:1787119492.973762:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:32728:x1873929633389696:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119492.973788:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119492.973809:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2df3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715be7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.973923:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.973939:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.973951:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119492.973992:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 62516461 00000004:00200000:3.0:1787119492.973997:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119492.974019:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.974049:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2df3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715be7 expref: 50 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.974065:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715be7 expref: 49 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.974074:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119492.974076:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119492.974080:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a507c64e00, rc 0) 00000100:00100000:0.0:1787119492.974892:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633389184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18082us (18321us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119492.974904:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9879 00002000:00100000:0.0:1787119492.974916:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (45056000->45121535) req@ffff92a511630380 x1873929633389184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 504/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119492.974927:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630380 with x1873929633389184 ext(45056000->45121535) 00002000:00010000:0.0:1787119492.974932:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511630380 00000100:00100000:3.0:1787119492.975106:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:32728:x1873929633389696:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1344us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119492.975114:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19565 00000100:00100000:2.0:1787119492.976145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.976261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.979826:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633389952 00000100:00100000:3.0:1787119492.979843:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633389952 00002000:00100000:2.0:1787119492.980559:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (6782976->6787071) req@ffff92a606159f80 x1873929633389952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.980571:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159f80 with x1873929633389952 ext(6782976->6787071) 00002000:00010000:2.0:1787119492.980578:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606159f80 00000100:00100000:2.0:1787119492.980615:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633389824 00000100:00100000:2.0:1787119492.980619:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633389824 00002000:00100000:2.0:1787119492.980638:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (49971200->49975295) req@ffff92a519d27100 x1873929633389824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.980647:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27100 with x1873929633389824 ext(49971200->49975295) 00002000:00010000:2.0:1787119492.980650:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27100 00000100:00100000:2.0:1787119492.980683:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9883 00000100:00100000:2.0:1787119492.980701:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633389952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.981216:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9884 00000100:00100000:3.0:1787119492.981226:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633389824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.981409:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633389824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 183us (5147us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119492.981417:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9884 00002000:00100000:3.0:1787119492.981425:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (49971200->49975295) req@ffff92a519d27100 x1873929633389824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119492.981433:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27100 with x1873929633389824 ext(49971200->49975295) 00002000:00010000:3.0:1787119492.981452:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27100 00000100:00100000:2.0:1787119492.981642:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633389952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 951us (5501us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.981650:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9883 00002000:00100000:2.0:1787119492.981656:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (6782976->6787071) req@ffff92a606159f80 x1873929633389952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.981665:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159f80 with x1873929633389952 ext(6782976->6787071) 00002000:00010000:2.0:1787119492.981668:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606159f80 00000100:00100000:3.0:1787119492.987383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119492.987426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119492.987959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119492.988113:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633390080 00000100:00100000:2.0:1787119492.988124:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633390080 00002000:00100000:2.0:1787119492.988176:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (45121536->45158399) req@ffff92a63dfbb800 x1873929633390080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.988187:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb800 with x1873929633390080 ext(45121536->45158399) 00002000:00010000:2.0:1787119492.988194:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbb800 00000100:00100000:2.0:1787119492.988227:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633390208 00000100:00100000:2.0:1787119492.988230:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633390208 00002000:00100000:2.0:1787119492.988247:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (47022080->47026175) req@ffff92a63dfbb480 x1873929633390208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/0 e 0 to 0 dl 1787119503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.988255:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb480 with x1873929633390208 ext(47022080->47026175) 00002000:00010000:2.0:1787119492.988258:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb480 00000100:00100000:2.0:1787119492.988278:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9885 00000100:00100000:2.0:1787119492.988287:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633390080:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119492.989372:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9886 00000100:00100000:2.0:1787119492.989386:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633390208:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119492.989938:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633390464 00000100:00100000:3.0:1787119492.989946:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633390464 00000100:00100000:3.0:1787119492.990139:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19566 00000100:00100000:3.0:1787119492.990148:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:32729:x1873929633390464:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119492.990188:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119492.990215:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2dec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715be0 expref: 49 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.990234:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119492.990239:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119492.990477:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119492.990953:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633390208:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1567us (3523us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119492.990963:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9886 00002000:00100000:2.0:1787119492.991050:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (47022080->47026175) req@ffff92a63dfbb480 x1873929633390208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/4536 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119492.991059:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb480 with x1873929633390208 ext(47022080->47026175) 00002000:00010000:2.0:1787119492.991064:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb480 00010000:00010000:3.0:1787119492.991620:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119492.991634:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119492.991742:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976380 00000004:00010000:3.0:1787119492.991786:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6ef203a reply state 0000000009ea7742 transno 4294976381 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119492.991796:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119493.003162:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:32729:x1873929633390464:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 13005us (15193us total) trans 4294976381 rc 0/0 00000100:00100000:3.0:1787119493.003175:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19566 00000020:00080000:3.0:1787119493.003183:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119493.008330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.010679:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633390592 00000100:00100000:2.0:1787119493.010697:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633390592 00002000:00100000:2.0:1787119493.010778:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (6758400->6823935) req@ffff92a63dfbad80 x1873929633390592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.010790:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbad80 with x1873929633390592 ext(6758400->6823935) 00002000:00010000:2.0:1787119493.010795:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbad80 00000100:00100000:2.0:1787119493.010836:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9887 00000100:00100000:2.0:1787119493.010848:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633390592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00080000:0.0:1787119493.011187:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119493.017625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.017840:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633390720 00000100:00100000:2.0:1787119493.017850:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633390720 00002000:00100000:2.0:1787119493.018000:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (49946624->49991679) req@ffff92a519cd6680 x1873929633390720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.018012:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6680 with x1873929633390720 ext(49946624->49991679) 00002000:00010000:2.0:1787119493.018018:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6680 00000100:00100000:2.0:1787119493.018051:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9888 00000100:00100000:2.0:1787119493.018062:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633390720:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119493.018618:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.018633:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.018640:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.018646:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c65800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119493.018651:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.018660:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.018677:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119493.018680:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119493.018685:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.018691:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787119493.019326:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119493.022317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.022819:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633390848 00000100:00100000:2.0:1787119493.022830:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633390848 00002000:00010000:2.0:1787119493.023644:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (62516461->18446744073709551615) 00002000:00100000:2.0:1787119493.023653:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfba300 with x1873929633390848 ext(62516461->18446744073709551615) 00002000:00010000:2.0:1787119493.023665:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfba300. 00000100:00100000:2.0:1787119493.023782:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9889 00000100:00100000:2.0:1787119493.023796:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633390848:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119493.024220:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 49988592 -> 62516461 00002000:00010000:2.0:1787119493.024224:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119493.024227:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119491 00002000:00010000:2.0:1787119493.024230:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119493.024232:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1549 -> 1421 00000100:00100000:2.0:1787119493.025100:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633390848:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1304us (2788us total) trans 4294969108 rc 0/0 00000100:00100000:2.0:1787119493.025112:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9889 00002000:00010000:2.0:1787119493.025117:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (62516461->18446744073709551615) 00002000:00100000:2.0:1787119493.025120:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfba300 with x1873929633390848 ext(62516461->18446744073709551615) 00002000:00010000:2.0:1787119493.025126:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfba300. 00000100:00100000:2.0:1787119493.029252:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633390720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11181us (11626us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119493.029268:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9888 00002000:00100000:2.0:1787119493.029281:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (49946624->49991679) req@ffff92a519cd6680 x1873929633390720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.029293:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6680 with x1873929633390720 ext(49946624->49991679) 00002000:00010000:2.0:1787119493.029299:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6680 00000100:00100000:2.0:1787119493.029381:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633390592:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18537us (21061us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119493.029388:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9887 00002000:00100000:2.0:1787119493.029394:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (6758400->6823935) req@ffff92a63dfbad80 x1873929633390592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.029403:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbad80 with x1873929633390592 ext(6758400->6823935) 00002000:00010000:2.0:1787119493.029407:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbad80 00000100:00100000:2.0:1787119493.029515:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633390080:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 41218us (42137us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119493.029523:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9885 00002000:00100000:2.0:1787119493.029529:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (45121536->45158399) req@ffff92a63dfbb800 x1873929633390080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:528/0 lens 488/440 e 0 to 0 dl 1787119503 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.029538:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb800 with x1873929633390080 ext(45121536->45158399) 00002000:00010000:2.0:1787119493.029541:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbb800 00000100:00100000:3.0:1787119493.030396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.030463:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633390976 00000100:00100000:0.0:1787119493.030472:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633390976 00002000:00100000:0.0:1787119493.031111:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (47026176->47030271) req@ffff92a63dfb9f80 x1873929633390976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.031123:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633390976 ext(47026176->47030271) 00002000:00010000:0.0:1787119493.031128:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000100:00100000:0.0:1787119493.031165:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9890 00000100:00100000:0.0:1787119493.031176:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633390976:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.031422:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633390976:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 247us (1029us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.031429:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9890 00002000:00100000:0.0:1787119493.031436:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (47026176->47030271) req@ffff92a63dfb9f80 x1873929633390976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.031466:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633390976 ext(47026176->47030271) 00002000:00010000:0.0:1787119493.031470:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000100:00100000:0.0:1787119493.047738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.047776:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.047926:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633391104 00000100:00100000:1.0:1787119493.047937:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633391104 00000100:00100000:1.0:1787119493.048021:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19567 00000100:00100000:1.0:1787119493.048030:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:32729:x1873929633391104:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119493.048055:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119493.048075:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2e08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715bee expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.048163:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2e0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.048180:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.048192:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119493.048221:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 62516461 00000004:00200000:1.0:1787119493.048225:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119493.048245:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.048270:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2e08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bee expref: 52 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.048286:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2e0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bee expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.048294:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119493.048298:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119493.048302:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431a00, rc 0) 00000100:00100000:1.0:1787119493.048356:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:32729:x1873929633391104:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 327us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.048363:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19567 00000100:00080000:3.0:1787119493.048537:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119493.055080:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633391232 00000100:00100000:2.0:1787119493.055095:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633391232 00002000:00100000:2.0:1787119493.055148:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (47001600->47067135) req@ffff92a511632300 x1873929633391232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.055156:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632300 with x1873929633391232 ext(47001600->47067135) 00002000:00010000:2.0:1787119493.055160:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511632300 00000100:00100000:2.0:1787119493.055217:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9891 00000100:00100000:2.0:1787119493.055224:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633391232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.058051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.064733:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633391360 00000100:00100000:2.0:1787119493.064749:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633391360 00002000:00100000:2.0:1787119493.064804:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (49967104->49988591) req@ffff92a63dfb9500 x1873929633391360/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.064814:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9500 with x1873929633391360 ext(49967104->49988591) 00002000:00010000:2.0:1787119493.064820:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9500 00000100:00100000:2.0:1787119493.064865:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9892 00000100:00100000:2.0:1787119493.064876:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633391360:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119493.065134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.068764:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633391488 00000100:00100000:3.0:1787119493.068781:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633391488 00002000:00100000:3.0:1787119493.068840:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (6823936->6860799) req@ffff92a519d25180 x1873929633391488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.068853:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25180 with x1873929633391488 ext(6823936->6860799) 00002000:00010000:3.0:1787119493.068859:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d25180 00000100:00100000:3.0:1787119493.068895:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9893 00000100:00100000:3.0:1787119493.068904:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633391488:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.073640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.073980:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633391744 00000100:00100000:3.0:1787119493.073993:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633391744 00000100:00100000:3.0:1787119493.074058:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19568 00000100:00100000:3.0:1787119493.074069:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:32724:x1873929633391744:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119493.074125:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119493.074153:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e2d36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ba8 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.074172:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119493.074177:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119493.074412:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.074427:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.074484:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119493.074555:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976382 00000004:00010000:3.0:1787119493.074595:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f88790db reply state 00000000889dfba7 transno 4294976383 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119493.074605:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119493.074705:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:32724:x1873929633391744:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 630us (1068us total) trans 4294976383 rc 0/0 00000100:00100000:3.0:1787119493.074718:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19568 00000020:00080000:3.0:1787119493.074724:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787119493.081717:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.081737:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.081745:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.081753:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c65800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119493.081757:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.081765:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.081782:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119493.081785:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119493.081791:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.081796:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c65800/0xcaba3de8463e2e16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119493.082336:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633391232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 27104us (34551us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119493.082348:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9891 00002000:00100000:0.0:1787119493.082363:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (47001600->47067135) req@ffff92a511632300 x1873929633391232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.082382:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632300 with x1873929633391232 ext(47001600->47067135) 00002000:00010000:0.0:1787119493.082387:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511632300 00000100:00100000:2.0:1787119493.085046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.085199:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633391488:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16295us (20065us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119493.085211:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9893 00002000:00100000:2.0:1787119493.085223:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (6823936->6860799) req@ffff92a519d25180 x1873929633391488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.085233:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25180 with x1873929633391488 ext(6823936->6860799) 00002000:00010000:2.0:1787119493.085239:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d25180 00000100:00100000:2.0:1787119493.085275:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633391872 00000100:00100000:2.0:1787119493.085283:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633391872 00002000:00100000:2.0:1787119493.085316:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (47022080->47026175) req@ffff92a519d24380 x1873929633391872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.085324:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24380 with x1873929633391872 ext(47022080->47026175) 00002000:00010000:2.0:1787119493.085328:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d24380 00000100:00100000:2.0:1787119493.085352:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9894 00000100:00100000:2.0:1787119493.085361:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633391872:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.085992:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633391872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 628us (952us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119493.086001:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9894 00002000:00100000:2.0:1787119493.086009:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (47022080->47026175) req@ffff92a519d24380 x1873929633391872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.086017:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24380 with x1873929633391872 ext(47022080->47026175) 00002000:00010000:2.0:1787119493.086021:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d24380 00000100:00100000:0.0:1787119493.087061:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633391360:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 22181us (29017us total) trans 4294969109 rc 0/0 00000100:00100000:0.0:1787119493.087202:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9892 00002000:00100000:0.0:1787119493.087212:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (49967104->49988591) req@ffff92a63dfb9500 x1873929633391360/t4294969109(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.087222:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9500 with x1873929633391360 ext(49967104->49988591) 00002000:00010000:0.0:1787119493.087227:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9500 00010000:00010000:0.0:1787119493.089624:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119493.092014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.092379:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633392000 00000100:00100000:1.0:1787119493.092390:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633392000 00002000:00010000:1.0:1787119493.092498:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (64521996->18446744073709551615) 00002000:00100000:1.0:1787119493.092511:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24000 with x1873929633392000 ext(64521996->18446744073709551615) 00002000:00010000:1.0:1787119493.092524:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d24000. 00000100:00100000:1.0:1787119493.092561:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9895 00000100:00100000:0.0:1787119493.092638:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633392000:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119493.093103:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 62516461 -> 64521996 00002000:00010000:0.0:1787119493.093107:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119490 -> 1787119491 00002000:00010000:0.0:1787119493.093110:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:0.0:1787119493.093113:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119490 -> 1787119491 00002000:00010000:0.0:1787119493.093115:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1421 -> 1933 00000100:00100000:0.0:1787119493.093185:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633392000:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 613us (1179us total) trans 4294968861 rc 0/0 00000100:00100000:0.0:1787119493.093194:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9895 00002000:00010000:0.0:1787119493.093198:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (64521996->18446744073709551615) 00002000:00100000:0.0:1787119493.093201:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24000 with x1873929633392000 ext(64521996->18446744073709551615) 00002000:00010000:0.0:1787119493.093206:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d24000. 00000100:00100000:3.0:1787119493.094864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.094985:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633392128 00000100:00100000:1.0:1787119493.094995:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633392128 00000100:00100000:1.0:1787119493.095103:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5025 00000100:00100000:1.0:1787119493.095113:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633392128:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119493.098117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.098154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.098190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.098381:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633392256 00000100:00100000:0.0:1787119493.098391:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633392256 00000100:00100000:1.0:1787119493.098469:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633392384 00002000:00100000:0.0:1787119493.098472:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (6778880->6832127) req@ffff92a63dfb8700 x1873929633392256/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787119493.098474:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633392384 00002000:00100000:1.0:1787119493.098514:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (47022080->47054847) req@ffff92a6181adc00 x1873929633392384/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.098524:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adc00 with x1873929633392384 ext(47022080->47054847) 00002000:00010000:1.0:1787119493.098529:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181adc00 00000100:00100000:1.0:1787119493.098547:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633392512 00000100:00100000:1.0:1787119493.098550:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633392512 00002000:00100000:1.0:1787119493.098564:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (47026176->47030271) req@ffff92a6181adf80 x1873929633392512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.098567:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633392256 ext(6778880->6832127) 00002000:00100000:1.0:1787119493.098577:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adf80 with x1873929633392512 ext(47026176->47030271) 00002000:00010000:1.0:1787119493.098582:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181adf80 00000100:00100000:1.0:1787119493.098600:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9896 00000100:00100000:1.0:1787119493.098610:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633392384:12345-192.168.201.59@tcp:4:fsx.0 00002000:00010000:0.0:1787119493.098648:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb8700 00000100:00100000:0.0:1787119493.098670:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9897 00000100:00100000:0.0:1787119493.098679:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633392512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.099165:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9898 00000100:00100000:3.0:1787119493.099175:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633392256:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119493.109771:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633392384:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 11152us (11604us total) trans 4294969110 rc 0/0 00000100:00100000:3.0:1787119493.109787:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9896 00002000:00100000:3.0:1787119493.109801:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (47022080->47054847) req@ffff92a6181adc00 x1873929633392384/t4294969110(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.110285:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adc00 with x1873929633392384 ext(47022080->47054847) 00002000:00010000:3.0:1787119493.110292:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181adc00 00000100:00100000:0.0:1787119493.112054:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633392512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13367us (13853us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.112069:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9897 00002000:00100000:0.0:1787119493.112080:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (47026176->47030271) req@ffff92a6181adf80 x1873929633392512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.112090:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adf80 with x1873929633392512 ext(47026176->47030271) 00002000:00010000:0.0:1787119493.112096:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181adf80 00000100:00100000:2.0:1787119493.112936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.113110:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633392640 00000100:00100000:0.0:1787119493.113120:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633392640 00000100:00100000:0.0:1787119493.113255:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19569 00000100:00100000:0.0:1787119493.113305:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:32724:x1873929633392640:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119493.113326:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119493.113349:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2e1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715bf5 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.113777:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2e24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.113796:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.113807:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119493.113840:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 64521996 00000004:00200000:0.0:1787119493.113845:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119493.113866:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.113970:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2e1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bf5 expref: 54 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.113990:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2e24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bf5 expref: 53 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.113999:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119493.114002:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119493.114006:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa600, rc 0) 00000100:00100000:0.0:1787119493.114063:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:32724:x1873929633392640:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 758us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.114072:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19569 00000100:00100000:0.0:1787119493.115952:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633392256:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 16770us (17836us total) trans 4294968862 rc 0/0 00000100:00100000:0.0:1787119493.115967:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9898 00002000:00100000:0.0:1787119493.115980:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (6778880->6832127) req@ffff92a63dfb8700 x1873929633392256/t4294968862(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.115991:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633392256 ext(6778880->6832127) 00002000:00010000:0.0:1787119493.115998:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb8700 00000100:00100000:1.0:1787119493.121273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.121789:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633392768 00000100:00100000:3.0:1787119493.121799:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633392768 00000100:00100000:3.0:1787119493.121860:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5026 00000100:00100000:3.0:1787119493.121869:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633392768:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119493.138003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.138039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.138342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.138848:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633393024 00000100:00100000:3.0:1787119493.138860:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633393024 00002000:00100000:3.0:1787119493.138903:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (62394368->62406655) req@ffff92a506009880 x1873929633393024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.138913:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009880 with x1873929633393024 ext(62394368->62406655) 00002000:00010000:3.0:1787119493.138919:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506009880 00000100:00100000:3.0:1787119493.138941:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633393152 00000100:00100000:3.0:1787119493.138945:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633393152 00002000:00100000:3.0:1787119493.138962:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (47001600->47067135) req@ffff92a50600b480 x1873929633393152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.138971:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600b480 with x1873929633393152 ext(47001600->47067135) 00002000:00010000:3.0:1787119493.138975:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600b480 00000100:00100000:3.0:1787119493.138994:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9899 00000100:00100000:3.0:1787119493.139003:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633393024:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.144871:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633393024:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5854us (6816us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1787119493.144888:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9899 00002000:00100000:3.0:1787119493.144903:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (62394368->62406655) req@ffff92a506009880 x1873929633393024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/12728 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.144914:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506009880 with x1873929633393024 ext(62394368->62406655) 00002000:00010000:3.0:1787119493.144921:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506009880 00000100:00100000:3.0:1787119493.144958:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9900 00000100:00100000:3.0:1787119493.144975:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633393152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.152201:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633393152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7216us (13842us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.152215:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9900 00002000:00100000:3.0:1787119493.152230:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (47001600->47067135) req@ffff92a50600b480 x1873929633393152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.152243:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600b480 with x1873929633393152 ext(47001600->47067135) 00002000:00010000:3.0:1787119493.152249:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50600b480 00000100:00100000:3.0:1787119493.152358:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.152469:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633393408 00000100:00100000:1.0:1787119493.152478:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633393408 00000100:00100000:1.0:1787119493.152537:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19570 00000100:00100000:1.0:1787119493.152547:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:32724:x1873929633393408:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119493.152611:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119493.152639:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e2e24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bf5 expref: 53 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.152659:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119493.152664:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119493.152885:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.152900:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.152910:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119493.152963:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976384 00000004:00010000:1.0:1787119493.152992:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3e90056 reply state 00000000dbb16553 transno 4294976385 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.153007:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119493.153079:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:32724:x1873929633393408:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 533us (720us total) trans 4294976385 rc 0/0 00000100:00100000:1.0:1787119493.153086:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19570 00000020:00080000:1.0:1787119493.153090:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119493.153875:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633392896 00000100:00100000:2.0:1787119493.153885:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633392896 00000100:00100000:2.0:1787119493.153925:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5027 00000100:00100000:2.0:1787119493.153933:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633392896:12345-192.168.201.59@tcp:16:fsx.0 00010000:00010000:1.0:1787119493.164271:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.164289:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.164297:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.164304:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119493.164309:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.164316:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.164332:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119493.164335:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119493.164340:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.164346:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e2e2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.164399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.164467:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.164497:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633393536 00000100:00100000:1.0:1787119493.164521:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633393536 00002000:00010000:1.0:1787119493.164562:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (10701438->18446744073709551615) 00002000:00100000:1.0:1787119493.164566:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600b100 with x1873929633393536 ext(10701438->18446744073709551615) 00002000:00010000:1.0:1787119493.164588:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50600b100. 00000100:00100000:1.0:1787119493.164611:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633393664 00000100:00100000:1.0:1787119493.164614:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633393664 00002000:00100000:1.0:1787119493.164637:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (47022080->47054847) req@ffff92a63497ad80 x1873929633393664/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.164646:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497ad80 with x1873929633393664 ext(47022080->47054847) 00002000:00010000:1.0:1787119493.164651:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497ad80 00000100:00100000:1.0:1787119493.164703:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9901 00000100:00100000:1.0:1787119493.164713:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633393536:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119493.165169:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 64521996 -> 10701438 00002000:00010000:1.0:1787119493.165174:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119493.165177:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119493.165180:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119493.165182:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119493.165241:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633393536:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 529us (845us total) trans 4294968863 rc 0/0 00000100:00100000:1.0:1787119493.165248:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9901 00002000:00010000:1.0:1787119493.165252:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (10701438->18446744073709551615) 00002000:00100000:1.0:1787119493.165255:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50600b100 with x1873929633393536 ext(10701438->18446744073709551615) 00002000:00010000:1.0:1787119493.165265:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50600b100. 00000100:00100000:1.0:1787119493.165284:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9902 00000100:00100000:1.0:1787119493.165293:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633393664:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119493.185958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.186399:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2373:x1873929633393664:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 21104us (21958us total) trans 4294969111 rc 0/0 00000100:00100000:3.0:1787119493.186411:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9902 00002000:00100000:3.0:1787119493.186424:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (47022080->47054847) req@ffff92a63497ad80 x1873929633393664/t4294969111(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.186434:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497ad80 with x1873929633393664 ext(47022080->47054847) 00002000:00010000:3.0:1787119493.186457:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497ad80 00000100:00100000:0.0:1787119493.187258:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633393792 00000100:00100000:0.0:1787119493.187267:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633393792 00000100:00100000:0.0:1787119493.187315:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19571 00000100:00100000:0.0:1787119493.187324:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:32724:x1873929633393792:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119493.187344:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119493.187373:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2e32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715bfc expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.187456:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.187470:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.187479:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119493.187509:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 10701438 00000004:00200000:0.0:1787119493.187513:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119493.187531:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.187558:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e2e32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bfc expref: 56 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.187576:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bfc expref: 55 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.187584:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119493.187588:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119493.187592:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fba00, rc 0) 00000100:00100000:0.0:1787119493.187636:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:32724:x1873929633393792:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 313us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.187644:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19571 00000100:00100000:0.0:1787119493.190606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.192627:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633393920 00000100:00100000:2.0:1787119493.192647:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633393920 00000100:00100000:2.0:1787119493.192710:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5028 00000100:00100000:2.0:1787119493.192721:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2374:x1873929633393920:12345-192.168.201.59@tcp:16:fsx.0 00000001:00080000:0.0:1787119493.203287:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969109 is committed 00000100:00100000:1.0:1787119493.205124:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633392128:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 110000us (110257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.205139:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5025 00000100:00100000:3.0:1787119493.211204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.211478:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633394048 00000100:00100000:2.0:1787119493.211693:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633394048 00000100:00100000:2.0:1787119493.211770:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19572 00000100:00100000:2.0:1787119493.211782:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:32727:x1873929633394048:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119493.211805:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119493.211829:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2e40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c03 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.211930:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.211945:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.211956:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119493.211987:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 49988592 00000004:00200000:2.0:1787119493.211992:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119493.212013:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.212042:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e2e40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c03 expref: 57 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.212064:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c03 expref: 56 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.212073:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119493.212076:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119493.212080:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0800, rc 0) 00000100:00100000:2.0:1787119493.212151:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:32727:x1873929633394048:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 371us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119493.212159:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19572 00000100:00100000:3.0:1787119493.216342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.218557:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633394304 00000100:00100000:2.0:1787119493.218667:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633394304 00000100:00100000:2.0:1787119493.219680:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19573 00000100:00100000:2.0:1787119493.219693:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:32724:x1873929633394304:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119493.219747:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119493.219777:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bfc expref: 56 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.219800:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119493.219804:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119493.220117:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.220131:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.220141:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119493.220186:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976386 00000004:00010000:2.0:1787119493.220207:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078468450 reply state 0000000084013578 transno 4294976387 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119493.220216:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119493.220309:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+58:32724:x1873929633394304:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 617us (3978us total) trans 4294976387 rc 0/0 00000100:00100000:2.0:1787119493.220316:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19573 00000020:00080000:2.0:1787119493.220320:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119493.224869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119493.224949:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.224977:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.224987:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.224993:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119493.224998:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.225006:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.225022:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119493.225025:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119493.225029:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.225035:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e2e4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119493.225832:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633394432 00000100:00100000:2.0:1787119493.225845:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633394432 00002000:00010000:2.0:1787119493.225888:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (48114906->18446744073709551615) 00002000:00100000:2.0:1787119493.225893:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27480 with x1873929633394432 ext(48114906->18446744073709551615) 00002000:00010000:2.0:1787119493.225904:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d27480. 00000100:00100000:2.0:1787119493.225943:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9903 00000100:00100000:2.0:1787119493.225953:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633394432:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119493.226477:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 10701438 -> 48114906 00002000:00010000:2.0:1787119493.226482:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119493.226485:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:2.0:1787119493.226487:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119493.226489:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119493.226573:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633394432:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 620us (1714us total) trans 4294968864 rc 0/0 00000100:00100000:2.0:1787119493.226585:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9903 00002000:00010000:2.0:1787119493.226588:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (48114906->18446744073709551615) 00002000:00100000:2.0:1787119493.226591:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27480 with x1873929633394432 ext(48114906->18446744073709551615) 00002000:00010000:2.0:1787119493.226596:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d27480. 00000100:00100000:0.0:1787119493.229212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.229522:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633394688 00000100:00100000:3.0:1787119493.229533:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633394688 00000100:00100000:3.0:1787119493.229594:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19574 00000100:00100000:3.0:1787119493.229604:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:32727:x1873929633394688:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119493.229659:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119493.229694:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c03 expref: 57 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.229716:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119493.229721:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119493.230244:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.230260:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.230269:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119493.230362:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976388 00000004:00010000:3.0:1787119493.230715:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056cac4ef reply state 0000000071f0d33c transno 4294976389 ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119493.230730:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119493.230837:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+59:32727:x1873929633394688:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1232us (1633us total) trans 4294976389 rc 0/0 00000100:00100000:3.0:1787119493.230845:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19574 00000020:00080000:3.0:1787119493.230851:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119493.233599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119493.233657:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.233669:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.233677:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.233684:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a507c64400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119493.233688:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.233695:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.233711:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119493.233714:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119493.233718:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.233725:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64400/0xcaba3de8463e2e55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119493.234120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.234150:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633394944 00000100:00100000:3.0:1787119493.234160:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633394944 00002000:00010000:3.0:1787119493.234197:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (62516461->18446744073709551615) 00002000:00100000:3.0:1787119493.234202:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aed80 with x1873929633394944 ext(62516461->18446744073709551615) 00002000:00010000:3.0:1787119493.234213:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181aed80. 00000100:00100000:3.0:1787119493.234244:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9904 00000100:00100000:3.0:1787119493.234253:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633394944:12345-192.168.201.59@tcp:10:fsx.0 00000001:00080000:0.0:1787119493.235137:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968862 is committed 00000100:00100000:2.0:1787119493.235743:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633394816 00000100:00100000:2.0:1787119493.235752:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633394816 00000100:00100000:2.0:1787119493.235796:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19575 00000100:00100000:2.0:1787119493.235803:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+58:32724:x1873929633394816:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119493.235817:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119493.235834:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2e5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c0a expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.235907:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.235920:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.235931:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119493.235954:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 48114906 00000004:00200000:2.0:1787119493.235957:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119493.236117:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.236144:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2e5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c0a expref: 60 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.236160:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c0a expref: 59 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.236168:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119493.236171:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119493.236173:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1600, rc 0) 00000100:00100000:2.0:1787119493.236225:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+59:32724:x1873929633394816:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 423us (2637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119493.236231:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19575 00000100:00100000:2.0:1787119493.236274:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633392896:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 82343us (98283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119493.236279:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5027 00002000:00010000:2.0:1787119493.236791:0:19245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 49988592 -> 62516461 00002000:00010000:2.0:1787119493.236795:0:19245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119493.236796:0:19245:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119490 -> 1787119491 00002000:00010000:2.0:1787119493.236798:0:19245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119493.236800:0:19245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1293 -> 1421 00000100:00100000:2.0:1787119493.236830:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633394944:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 2579us (2713us total) trans 4294969112 rc 0/0 00000100:00100000:2.0:1787119493.236835:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9904 00002000:00010000:2.0:1787119493.236838:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (62516461->18446744073709551615) 00002000:00100000:2.0:1787119493.236841:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aed80 with x1873929633394944 ext(62516461->18446744073709551615) 00002000:00010000:2.0:1787119493.236846:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181aed80. 00000100:00100000:0.0:1787119493.242607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.244008:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633395072 00000100:00100000:1.0:1787119493.244024:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633395072 00002000:00100000:1.0:1787119493.244096:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (25219072->25223167) req@ffff92a511633480 x1873929633395072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.244109:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633480 with x1873929633395072 ext(25219072->25223167) 00002000:00010000:1.0:1787119493.244114:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633480 00000100:00100000:1.0:1787119493.244150:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9905 00000100:00100000:1.0:1787119493.244160:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633395072:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.244456:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633395072:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 279us (1840us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119493.244465:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9905 00002000:00100000:1.0:1787119493.244474:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (25219072->25223167) req@ffff92a511633480 x1873929633395072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.244483:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633480 with x1873929633395072 ext(25219072->25223167) 00002000:00010000:1.0:1787119493.244487:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633480 00000100:00100000:3.0:1787119493.244531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.245141:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633395200 00000100:00100000:1.0:1787119493.245147:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633395200 00002000:00100000:1.0:1787119493.245171:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (45076480->45080575) req@ffff92a6181aea00 x1873929633395200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.245180:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aea00 with x1873929633395200 ext(45076480->45080575) 00002000:00010000:1.0:1787119493.245185:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181aea00 00000100:00100000:1.0:1787119493.245210:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9906 00000100:00100000:1.0:1787119493.245216:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633395200:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.245631:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633395200:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 414us (1102us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119493.245640:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9906 00002000:00100000:1.0:1787119493.245648:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (45076480->45080575) req@ffff92a6181aea00 x1873929633395200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.245657:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aea00 with x1873929633395200 ext(45076480->45080575) 00002000:00010000:1.0:1787119493.245660:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181aea00 00000100:00100000:3.0:1787119493.247840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.248105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.248137:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633395456 00000100:00100000:3.0:1787119493.248146:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633395456 00002000:00100000:3.0:1787119493.248190:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (25223168->25227263) req@ffff92a6181afb80 x1873929633395456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.248202:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181afb80 with x1873929633395456 ext(25223168->25227263) 00002000:00010000:3.0:1787119493.248208:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181afb80 00000100:00100000:3.0:1787119493.248234:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9907 00000100:00100000:3.0:1787119493.248244:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633395456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.248323:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633395328 00000100:00100000:1.0:1787119493.248328:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633395328 00000100:00100000:1.0:1787119493.248367:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19576 00000100:00100000:1.0:1787119493.248375:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+59:32727:x1873929633395328:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119493.248394:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119493.248414:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2e6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c11 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.248530:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2e71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.248544:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.248554:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119493.248579:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 62516461 00000004:00200000:1.0:1787119493.248583:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119493.248600:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.248622:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e2e6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c11 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.248643:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2e71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c11 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.248651:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119493.248654:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119493.248657:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430e00, rc 0) 00000100:00100000:1.0:1787119493.248716:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+60:32727:x1873929633395328:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 341us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.248722:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19576 00000100:00100000:3.0:1787119493.249197:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633395456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 952us (1090us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.249206:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9907 00002000:00100000:3.0:1787119493.249214:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (25223168->25227263) req@ffff92a6181afb80 x1873929633395456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.249231:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181afb80 with x1873929633395456 ext(25223168->25227263) 00002000:00010000:3.0:1787119493.249235:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181afb80 00000100:00100000:1.0:1787119493.252195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.252263:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633395584 00000100:00100000:2.0:1787119493.252273:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633395584 00002000:00100000:2.0:1787119493.252313:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (45080576->45084671) req@ffff92a63497aa00 x1873929633395584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.252324:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497aa00 with x1873929633395584 ext(45080576->45084671) 00002000:00010000:2.0:1787119493.252329:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63497aa00 00000100:00100000:2.0:1787119493.252357:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9908 00000100:00100000:2.0:1787119493.252415:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633395584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.252658:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633395584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 292us (471us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119493.252665:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9908 00002000:00100000:2.0:1787119493.252671:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (45080576->45084671) req@ffff92a63497aa00 x1873929633395584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.252677:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497aa00 with x1873929633395584 ext(45080576->45084671) 00002000:00010000:2.0:1787119493.252681:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63497aa00 00000100:00100000:2.0:1787119493.254937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.254976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.255023:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633395712 00000100:00100000:3.0:1787119493.255036:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633395712 00000100:00100000:0.0:1787119493.255057:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633395840 00000100:00100000:0.0:1787119493.255064:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633395840 00002000:00100000:3.0:1787119493.255085:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (47022080->47026175) req@ffff92a519d25500 x1873929633395712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.255091:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (25198592->25264127) req@ffff92a519d26300 x1873929633395840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.255110:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25500 with x1873929633395712 ext(47022080->47026175) 00002000:00100000:0.0:1787119493.255114:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26300 with x1873929633395840 ext(25198592->25264127) 00002000:00010000:3.0:1787119493.255117:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25500 00002000:00010000:0.0:1787119493.255121:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d26300 00000100:00100000:3.0:1787119493.255156:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9909 00000100:00100000:3.0:1787119493.255165:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633395712:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.255613:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633395712:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 274us (508us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.255622:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9909 00002000:00100000:3.0:1787119493.255630:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (47022080->47026175) req@ffff92a519d25500 x1873929633395712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.255639:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25500 with x1873929633395712 ext(47022080->47026175) 00002000:00010000:3.0:1787119493.255643:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25500 00000100:00100000:3.0:1787119493.255661:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9910 00000100:00100000:3.0:1787119493.255668:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633395840:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.259952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.260168:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633395968 00000100:00100000:3.0:1787119493.260181:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633395968 00002000:00100000:3.0:1787119493.260231:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (45056000->45121535) req@ffff92a511633b80 x1873929633395968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.260249:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633b80 with x1873929633395968 ext(45056000->45121535) 00002000:00010000:3.0:1787119493.260256:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633b80 00000100:00100000:3.0:1787119493.260282:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9911 00000100:00100000:3.0:1787119493.260292:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633395968:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.260644:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633395840:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4974us (5665us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119493.260653:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9910 00002000:00100000:0.0:1787119493.260660:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (25198592->25264127) req@ffff92a519d26300 x1873929633395840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.260670:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26300 with x1873929633395840 ext(25198592->25264127) 00002000:00010000:0.0:1787119493.260675:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d26300 00000100:00100000:3.0:1787119493.263043:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633395968:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2741us (3091us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.263055:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9911 00002000:00100000:3.0:1787119493.263066:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (45056000->45121535) req@ffff92a511633b80 x1873929633395968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.263076:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633b80 with x1873929633395968 ext(45056000->45121535) 00002000:00010000:3.0:1787119493.263081:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633b80 00000100:00100000:3.0:1787119493.263425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.265299:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633396096 00000100:00100000:0.0:1787119493.265312:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633396096 00002000:00100000:0.0:1787119493.265363:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (47026176->47030271) req@ffff92a6181ac700 x1873929633396096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.265375:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ac700 with x1873929633396096 ext(47026176->47030271) 00002000:00010000:0.0:1787119493.265381:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ac700 00000100:00100000:0.0:1787119493.265411:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9912 00000100:00100000:0.0:1787119493.265421:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633396096:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.265665:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633396096:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 243us (2239us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.265674:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9912 00002000:00100000:0.0:1787119493.265680:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (47026176->47030271) req@ffff92a6181ac700 x1873929633396096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.265687:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ac700 with x1873929633396096 ext(47026176->47030271) 00002000:00010000:0.0:1787119493.265691:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ac700 00000100:00100000:2.0:1787119493.269524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.269566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.270089:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633396224 00000100:00100000:2.0:1787119493.270113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.270144:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633396480 00000100:00100000:2.0:1787119493.270154:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633396480 00000100:00100000:0.0:1787119493.270157:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633396352 00000100:00100000:0.0:1787119493.270164:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633396352 00002000:00100000:2.0:1787119493.270207:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (45121536->45158399) req@ffff92a519d25c00 x1873929633396480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.270207:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (47001600->47067135) req@ffff92a519d27b80 x1873929633396352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.270241:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25c00 with x1873929633396480 ext(45121536->45158399) 00002000:00100000:0.0:1787119493.270242:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27b80 with x1873929633396352 ext(47001600->47067135) 00002000:00010000:2.0:1787119493.270250:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d25c00 00002000:00010000:0.0:1787119493.270250:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27b80 00000100:00100000:0.0:1787119493.270290:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9913 00000100:00100000:0.0:1787119493.270302:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633396352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.270705:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9914 00000100:00100000:1.0:1787119493.270708:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633396224 00000100:00100000:2.0:1787119493.270716:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633396480:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:1.0:1787119493.270747:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (25264128->25300991) req@ffff92a519d26a00 x1873929633396224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.270756:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26a00 with x1873929633396224 ext(25264128->25300991) 00002000:00010000:1.0:1787119493.270761:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d26a00 00000100:00100000:1.0:1787119493.270785:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9915 00000100:00100000:1.0:1787119493.270795:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633396224:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.279276:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633396480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8549us (9150us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119493.279291:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9914 00000100:00100000:1.0:1787119493.279300:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633396224:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8505us (9797us total) trans 0 rc 36864/36864 00002000:00100000:2.0:1787119493.279306:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (45121536->45158399) req@ffff92a519d25c00 x1873929633396480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787119493.279314:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9915 00002000:00100000:2.0:1787119493.279323:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25c00 with x1873929633396480 ext(45121536->45158399) 00002000:00100000:1.0:1787119493.279326:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (25264128->25300991) req@ffff92a519d26a00 x1873929633396224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00010000:2.0:1787119493.279331:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d25c00 00002000:00100000:1.0:1787119493.279347:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26a00 with x1873929633396224 ext(25264128->25300991) 00002000:00010000:1.0:1787119493.279351:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d26a00 00000100:00100000:3.0:1787119493.280762:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633396352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10455us (11186us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.280773:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9913 00002000:00100000:3.0:1787119493.280782:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (47001600->47067135) req@ffff92a519d27b80 x1873929633396352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.280792:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27b80 with x1873929633396352 ext(47001600->47067135) 00002000:00010000:3.0:1787119493.280797:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27b80 00000100:00100000:0.0:1787119493.282919:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787119493.282943:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653566464:0@lo:400:kworker.0 00000100:00100000:0.0:1787119493.283029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119493.283241:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653566592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119493.283278:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119493.283335:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787119493.283342:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653566720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119493.283367:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119493.283399:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653566592 00000100:00100000:3.0:1787119493.283407:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653566592 00000100:00100000:3.0:1787119493.284698:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653566720 00000100:00100000:3.0:1787119493.284709:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653566720 00000100:00100000:3.0:1787119493.284744:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787119493.284751:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653566592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119493.284775:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 813760512 pending 3407872 free 3828350976 avail 3825205248 00000100:00100000:3.0:1787119493.284832:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653566592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119493.284838:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787119493.284856:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787119493.284863:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653566720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787119493.284873:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 289472512 pending 0 free 3856662528 avail 3846176768 00000100:00100000:3.0:1787119493.284900:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653566720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119493.284906:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:3.0:1787119493.284927:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787119493.284931:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119493.284976:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653566720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119493.284992:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653566592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119493.285173:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787119493.285347:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653566976:0@lo:400:kworker.0 00000100:00100000:2.0:1787119493.286224:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119493.286313:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653566848:0@lo:400:kworker.0 00000100:00100000:2.0:1787119493.286342:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119493.286554:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653566976 00000100:00100000:0.0:1787119493.286560:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653566976 00000100:00100000:0.0:1787119493.286603:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653566848 00000100:00100000:0.0:1787119493.286607:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653566848 00000100:00100000:0.0:1787119493.286630:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1787119493.286639:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653566976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119493.286687:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653566976:12345-0@lo:400:kworker.0 Request processed in 49us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.286695:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1787119493.286709:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1787119493.286715:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653566848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119493.286746:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653566848:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.286752:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1787119493.286777:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787119493.286786:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653567104:0@lo:400:kworker.0 00000100:00100000:0.0:1787119493.286820:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787119493.286865:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119493.286950:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653566976:0@lo:400:kworker.0 00000100:00100000:0.0:1787119493.286962:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653566848:0@lo:400:kworker.0 00000100:00100000:0.0:1787119493.286989:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653567104 00000100:00100000:0.0:1787119493.286992:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653567104 00000100:00100000:0.0:1787119493.287020:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1787119493.287027:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653567104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119493.287062:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653567104:12345-0@lo:400:kworker.0 Request processed in 35us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.287068:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1787119493.287091:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653567104:0@lo:400:kworker.0 00000100:00080000:0.0:1787119493.287109:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119493.288774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.288832:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653566464 00000100:00100000:1.0:1787119493.288839:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653566464 00000100:00100000:1.0:1787119493.288888:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1787119493.288897:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653566464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119493.289042:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653566464:12345-0@lo:400:kworker.0 Request processed in 146us (6013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.289050:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1787119493.289191:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633396608 00000100:00100000:3.0:1787119493.289196:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633396608 00002000:00100000:3.0:1787119493.289233:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (41299968->41316351) req@ffff92a508cff480 x1873929633396608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.289251:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff480 with x1873929633396608 ext(41299968->41316351) 00002000:00010000:3.0:1787119493.289258:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cff480 00000100:00100000:3.0:1787119493.289286:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9916 00000100:00100000:3.0:1787119493.289294:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633396608:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.289649:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653566464:0@lo:400:kworker.0 00000100:00100000:3.0:1787119493.289976:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633396608:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 681us (1209us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119493.289984:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9916 00002000:00100000:3.0:1787119493.289991:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (41299968->41316351) req@ffff92a508cff480 x1873929633396608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/16824 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.290000:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff480 with x1873929633396608 ext(41299968->41316351) 00002000:00010000:3.0:1787119493.290003:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cff480 00000100:00100000:1.0:1787119493.294763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.295012:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633396736 00000100:00100000:2.0:1787119493.295022:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633396736 00002000:00100000:2.0:1787119493.295074:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (47022080->47054847) req@ffff92a63497a300 x1873929633396736/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.295085:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633396736 ext(47022080->47054847) 00002000:00010000:2.0:1787119493.295092:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497a300 00000100:00100000:2.0:1787119493.295124:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9917 00000100:00100000:2.0:1787119493.295135:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633396736:12345-192.168.201.59@tcp:4:fsx.0 00000001:00080000:0.0:1787119493.295145:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969111 is committed 00000100:00100000:3.0:1787119493.296075:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633392768:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 174200us (174806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119493.296089:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5026 00000100:00100000:3.0:1787119493.296142:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633393920:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 103423us (105546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119493.296149:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5028 00000100:00100000:1.0:1787119493.302571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.302839:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633396992 00000100:00100000:2.0:1787119493.302851:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633396992 00000100:00100000:2.0:1787119493.302920:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19577 00000100:00100000:2.0:1787119493.302930:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+60:32720:x1873929633396992:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119493.302999:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119493.303028:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64c00/0xcaba3de8463e2d75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bbd expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.303047:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119493.303052:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119493.303816:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.303831:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.303842:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119493.304190:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976390 00000004:00010000:2.0:1787119493.304228:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067851c9e reply state 000000006f67b414 transno 4294976391 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119493.304579:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119493.304740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.304770:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633397248 00000100:00100000:0.0:1787119493.304779:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633397248 00000100:00100000:0.0:1787119493.304826:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19578 00000100:00100000:0.0:1787119493.304836:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+62:32724:x1873929633397248:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119493.304878:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119493.304901:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e2e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c0a expref: 62 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.304917:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119493.304921:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119493.305076:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.305088:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.305097:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119493.305143:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976392 00000004:00010000:0.0:1787119493.305168:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007067640d reply state 0000000047a7a92d transno 4294976393 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119493.305176:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119493.305226:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+65:32720:x1873929633396992:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2295us (2663us total) trans 4294976391 rc 0/0 00000100:00100000:0.0:1787119493.305229:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+65:32724:x1873929633397248:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 392us (490us total) trans 4294976393 rc 0/0 00000100:00100000:0.0:1787119493.305238:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19578 00000020:00080000:0.0:1787119493.305243:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119493.305728:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633396736:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 10594us (10974us total) trans 4294969113 rc 0/0 00000100:00100000:0.0:1787119493.305738:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9917 00002000:00100000:0.0:1787119493.305749:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (47022080->47054847) req@ffff92a63497a300 x1873929633396736/t4294969113(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.305759:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633396736 ext(47022080->47054847) 00002000:00010000:0.0:1787119493.305765:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497a300 00000100:00100000:3.0:1787119493.305992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.306161:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19577 00000020:00080000:2.0:1787119493.306166:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119493.307085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.307170:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633397504 00000100:00100000:1.0:1787119493.307179:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633397504 00002000:00100000:1.0:1787119493.307225:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (21311488->21315583) req@ffff92a63dc07480 x1873929633397504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.307236:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07480 with x1873929633397504 ext(21311488->21315583) 00002000:00010000:1.0:1787119493.307242:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07480 00000100:00100000:1.0:1787119493.307264:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633397376 00000100:00100000:1.0:1787119493.307267:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633397376 00002000:00100000:1.0:1787119493.307281:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (21311488->21315583) req@ffff92a63dc04000 x1873929633397376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.307288:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633397376 ext(21311488->21315583) 00002000:00010000:1.0:1787119493.307291:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04000 00000100:00100000:1.0:1787119493.307328:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9918 00000100:00100000:1.0:1787119493.307339:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633397504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.307825:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9919 00000100:00100000:2.0:1787119493.307837:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633397376:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.308314:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633397504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 976us (2323us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119493.308323:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9918 00002000:00100000:1.0:1787119493.308330:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (21311488->21315583) req@ffff92a63dc07480 x1873929633397504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.308339:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07480 with x1873929633397504 ext(21311488->21315583) 00002000:00010000:1.0:1787119493.308343:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07480 00000100:00100000:2.0:1787119493.310134:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633397376:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2289us (3042us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119493.310151:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9919 00002000:00100000:2.0:1787119493.310163:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (21311488->21315583) req@ffff92a63dc04000 x1873929633397376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.310173:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633397376 ext(21311488->21315583) 00002000:00010000:2.0:1787119493.310179:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04000 00000100:00100000:0.0:1787119493.310300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.310327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.310349:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633397760 00000100:00100000:0.0:1787119493.310356:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633397760 00002000:00010000:0.0:1787119493.310386:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (53296850->18446744073709551615) 00002000:00100000:0.0:1787119493.310390:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127480 with x1873929633397760 ext(53296850->18446744073709551615) 00002000:00010000:0.0:1787119493.310400:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a127480. 00000100:00100000:0.0:1787119493.310420:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633397632 00000100:00100000:0.0:1787119493.310423:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633397632 00002000:00010000:0.0:1787119493.310433:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (64521996->18446744073709551615) 00002000:00100000:0.0:1787119493.310436:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125180 with x1873929633397632 ext(64521996->18446744073709551615) 00002000:00010000:0.0:1787119493.310466:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a125180. 00000100:00100000:0.0:1787119493.310982:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9920 00000100:00100000:0.0:1787119493.310994:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633397760:12345-192.168.201.59@tcp:10:fsx.0 00010000:00010000:2.0:1787119493.311015:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.311027:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.311034:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.311041:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119493.311046:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.311054:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.311073:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119493.311076:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119493.311082:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.311089:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e2e7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119493.311214:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 48114906 -> 53296850 00002000:00010000:0.0:1787119493.311218:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:0.0:1787119493.311221:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:0.0:1787119493.311223:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:0.0:1787119493.311225:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:0.0:1787119493.311463:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633397760:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 471us (1163us total) trans 4294968865 rc 0/0 00000100:00100000:0.0:1787119493.311470:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9920 00002000:00010000:0.0:1787119493.311474:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (53296850->18446744073709551615) 00002000:00100000:0.0:1787119493.314415:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127480 with x1873929633397760 ext(53296850->18446744073709551615) 00002000:00010000:0.0:1787119493.314428:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a127480. 00010000:00010000:3.0:1787119493.314671:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.314682:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119493.314753:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9921 00000100:00100000:0.0:1787119493.314770:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633397632:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119493.315043:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 62516461 -> 64521996 00002000:00010000:0.0:1787119493.315047:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:0.0:1787119493.315049:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:0.0:1787119493.315051:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:0.0:1787119493.315053:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1421 -> 1933 00000100:00100000:0.0:1787119493.315117:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633397632:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 353us (4787us total) trans 4294968866 rc 0/0 00000100:00100000:2.0:1787119493.315766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.315873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.315991:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633397888 00000100:00100000:1.0:1787119493.316000:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633397888 00000100:00100000:1.0:1787119493.316053:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5029 00000100:00100000:1.0:1787119493.316062:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633397888:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119493.316138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.316166:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633398016 00000100:00100000:2.0:1787119493.316171:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633398016 00000100:00100000:0.0:1787119493.316209:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9921 00002000:00010000:0.0:1787119493.316215:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (64521996->18446744073709551615) 00002000:00100000:0.0:1787119493.316219:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125180 with x1873929633397632 ext(64521996->18446744073709551615) 00002000:00010000:0.0:1787119493.316227:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a125180. 00000100:00100000:0.0:1787119493.316244:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633398144 00000100:00100000:0.0:1787119493.316247:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633398144 00002000:00100000:0.0:1787119493.316270:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (21315584->21319679) req@ffff92a508cfd880 x1873929633398144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.316281:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (21315584->21319679) req@ffff92a508cfd500 x1873929633398016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.316282:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd880 with x1873929633398144 ext(21315584->21319679) 00002000:00010000:0.0:1787119493.316291:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd880 00002000:00100000:2.0:1787119493.316296:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd500 with x1873929633398016 ext(21315584->21319679) 00002000:00010000:2.0:1787119493.316302:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd500 00000100:00100000:0.0:1787119493.316315:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9922 00000100:00100000:2.0:1787119493.316327:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9923 00000100:00100000:0.0:1787119493.316328:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633398144:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.316339:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633398016:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119493.316635:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.316644:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119493.316649:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.316657:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.316672:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119493.316675:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119493.316679:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.316696:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2e78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119493.317128:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633398016:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 789us (1251us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119493.317136:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9923 00002000:00100000:2.0:1787119493.317144:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (21315584->21319679) req@ffff92a508cfd500 x1873929633398016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.317152:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd500 with x1873929633398016 ext(21315584->21319679) 00002000:00010000:2.0:1787119493.317156:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd500 00000100:00100000:0.0:1787119493.317648:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633398144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1323us (1745us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.317657:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9922 00002000:00100000:0.0:1787119493.317665:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (21315584->21319679) req@ffff92a508cfd880 x1873929633398144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.317674:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd880 with x1873929633398144 ext(21315584->21319679) 00002000:00010000:0.0:1787119493.317678:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfd880 00000100:00100000:1.0:1787119493.317860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.318118:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633398272 00000100:00100000:2.0:1787119493.318126:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633398272 00000100:00100000:2.0:1787119493.318203:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19579 00000100:00100000:2.0:1787119493.318212:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+62:32724:x1873929633398272:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119493.318230:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119493.318248:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2e86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.318324:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.318338:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.318349:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119493.318390:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 53296850 00000004:00200000:2.0:1787119493.318395:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119493.318420:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.319146:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2e86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c18 expref: 64 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.319168:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c18 expref: 63 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.319177:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119493.319180:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119493.319183:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0800, rc 0) 00000100:00100000:2.0:1787119493.319242:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+63:32724:x1873929633398272:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1031us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119493.319250:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19579 00000100:00100000:1.0:1787119493.329083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.329130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.329160:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633398400 00000100:00100000:1.0:1787119493.329170:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633398400 00002000:00100000:1.0:1787119493.329216:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (21291008->21356543) req@ffff92a634979500 x1873929633398400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.329226:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979500 with x1873929633398400 ext(21291008->21356543) 00002000:00010000:1.0:1787119493.329232:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979500 00000100:00100000:1.0:1787119493.329259:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9924 00000100:00100000:1.0:1787119493.329270:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633398400:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.330817:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633398528 00000100:00100000:1.0:1787119493.330828:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633398528 00000100:00100000:1.0:1787119493.330875:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19580 00000100:00100000:1.0:1787119493.330883:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+63:32720:x1873929633398528:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119493.331768:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119493.331797:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2e94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c1f expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.331885:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e2e9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.331971:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e2e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.331985:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e2e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119493.332013:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 64521996 00000004:00200000:1.0:1787119493.332018:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119493.332037:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e2e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.332067:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e2e94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c1f expref: 65 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.332086:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e2e9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c1f expref: 64 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.332095:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119493.332098:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119493.332101:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430400, rc 0) 00000100:00100000:1.0:1787119493.332175:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+64:32720:x1873929633398528:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1292us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.332183:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19580 00000100:00100000:0.0:1787119493.336262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.336785:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633398656 00000100:00100000:3.0:1787119493.336797:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633398656 00002000:00100000:3.0:1787119493.336843:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (21291008->21356543) req@ffff92a62a126d80 x1873929633398656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.336854:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126d80 with x1873929633398656 ext(21291008->21356543) 00002000:00010000:3.0:1787119493.336860:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126d80 00000100:00100000:3.0:1787119493.336888:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9925 00000100:00100000:3.0:1787119493.337338:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633398656:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.339959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.340053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633398912 00000100:00100000:0.0:1787119493.340063:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633398912 00000100:00100000:0.0:1787119493.340122:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19581 00000100:00100000:0.0:1787119493.340132:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+64:32724:x1873929633398912:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119493.340185:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119493.340213:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2e8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c18 expref: 64 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.340232:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119493.340238:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119493.340432:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.340882:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.340894:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119493.340963:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976394 00000004:00010000:0.0:1787119493.341051:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a902d168 reply state 00000000db488be1 transno 4294976395 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119493.341063:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119493.341159:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+66:32724:x1873929633398912:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1026us (1208us total) trans 4294976395 rc 0/0 00000100:00100000:0.0:1787119493.341168:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19581 00000020:00080000:0.0:1787119493.341174:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787119493.345515:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.345534:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.345543:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.345550:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119493.345554:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.345562:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.345587:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119493.345590:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119493.345595:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.345755:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2ea2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.346954:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633398400:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17677us (17873us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119493.346967:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9924 00002000:00100000:1.0:1787119493.346980:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (21291008->21356543) req@ffff92a634979500 x1873929633398400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.346991:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979500 with x1873929633398400 ext(21291008->21356543) 00002000:00010000:1.0:1787119493.346997:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979500 00000100:00100000:1.0:1787119493.347079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.347156:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633399040 00000100:00100000:1.0:1787119493.347164:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633399040 00002000:00010000:1.0:1787119493.347193:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (25736352->18446744073709551615) 00002000:00100000:1.0:1787119493.347197:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497b480 with x1873929633399040 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119493.347207:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63497b480. 00000100:00100000:1.0:1787119493.347233:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9926 00000100:00100000:1.0:1787119493.347243:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633399040:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119493.347860:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 53296850 -> 25736352 00002000:00010000:1.0:1787119493.347864:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119493.347867:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119493.347869:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119493.347872:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119493.347930:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633399040:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 688us (851us total) trans 4294968867 rc 0/0 00000100:00100000:1.0:1787119493.347939:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9926 00002000:00010000:1.0:1787119493.347943:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (25736352->18446744073709551615) 00002000:00100000:1.0:1787119493.347946:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497b480 with x1873929633399040 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119493.347952:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63497b480. 00000100:00100000:1.0:1787119493.354152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.354286:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633399168 00000100:00100000:0.0:1787119493.354298:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633399168 00002000:00100000:0.0:1787119493.354349:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (62394368->62406655) req@ffff92a62a121500 x1873929633399168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.354590:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121500 with x1873929633399168 ext(62394368->62406655) 00002000:00010000:0.0:1787119493.354597:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a121500 00000100:00100000:3.0:1787119493.354698:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633398656:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17798us (18443us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.354713:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9925 00002000:00100000:3.0:1787119493.354722:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (21291008->21356543) req@ffff92a62a126d80 x1873929633398656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.354731:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126d80 with x1873929633398656 ext(21291008->21356543) 00002000:00010000:3.0:1787119493.354735:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126d80 00000100:00100000:3.0:1787119493.354918:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9927 00000100:00100000:3.0:1787119493.354929:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633399168:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.355155:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633399168:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 227us (1014us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1787119493.355162:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9927 00002000:00100000:3.0:1787119493.355169:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (62394368->62406655) req@ffff92a62a121500 x1873929633399168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/12728 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.355178:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121500 with x1873929633399168 ext(62394368->62406655) 00002000:00010000:3.0:1787119493.355182:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a121500 00000100:00100000:1.0:1787119493.356808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.360198:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633399296 00000100:00100000:3.0:1787119493.360216:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633399296 00002000:00100000:3.0:1787119493.360275:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (21356544->21393407) req@ffff92a62a120700 x1873929633399296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.360287:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120700 with x1873929633399296 ext(21356544->21393407) 00002000:00010000:3.0:1787119493.360293:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120700 00000100:00100000:3.0:1787119493.360328:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9928 00000100:00100000:3.0:1787119493.360338:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633399296:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.363672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.363721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.363856:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633399424 00000100:00100000:3.0:1787119493.363867:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633399424 00002000:00100000:3.0:1787119493.363913:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (21356544->21393407) req@ffff92a508cfe680 x1873929633399424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.363924:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfe680 with x1873929633399424 ext(21356544->21393407) 00002000:00010000:3.0:1787119493.363930:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfe680 00000100:00100000:3.0:1787119493.366929:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9929 00000100:00100000:3.0:1787119493.366950:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633399424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.367262:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633399680 00000100:00100000:3.0:1787119493.367270:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633399680 00000100:00100000:3.0:1787119493.367319:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19582 00000100:00100000:3.0:1787119493.367327:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+65:32720:x1873929633399680:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119493.367376:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119493.367405:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e2e9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c1f expref: 65 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.367424:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119493.367429:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119493.367922:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.367937:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.367947:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119493.368078:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976396 00000100:00100000:1.0:1787119493.368368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.368693:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633399296:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8354us (11893us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119493.368705:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9928 00002000:00100000:1.0:1787119493.368717:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (21356544->21393407) req@ffff92a62a120700 x1873929633399296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.368728:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120700 with x1873929633399296 ext(21356544->21393407) 00002000:00010000:1.0:1787119493.368734:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120700 00000100:00100000:1.0:1787119493.368763:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633399808 00000100:00100000:1.0:1787119493.368769:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633399808 00000100:00100000:1.0:1787119493.368807:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19583 00000100:00100000:1.0:1787119493.368816:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+67:32724:x1873929633399808:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119493.368830:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119493.368846:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2eb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c26 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.368930:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2eb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.368941:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.368949:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119493.368969:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 25736352 00000004:00200000:1.0:1787119493.369182:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119493.369207:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.369235:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2eb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c26 expref: 69 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.369251:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c26 expref: 68 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.369259:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119493.369262:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119493.369266:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119493.369296:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+68:32724:x1873929633399808:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 481us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.369304:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19583 00000004:00010000:3.0:1787119493.369791:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008d2681b reply state 00000000954acea2 transno 4294976397 ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119493.369802:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119493.369969:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+68:32720:x1873929633399680:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2640us (6245us total) trans 4294976397 rc 0/0 00000100:00100000:3.0:1787119493.369988:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19582 00000020:00080000:3.0:1787119493.369993:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119493.388040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.388962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.389172:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633399424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22228us (25507us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119493.389185:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9929 00002000:00100000:2.0:1787119493.389201:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (21356544->21393407) req@ffff92a508cfe680 x1873929633399424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.389211:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfe680 with x1873929633399424 ext(21356544->21393407) 00002000:00010000:2.0:1787119493.389217:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfe680 00000100:00100000:2.0:1787119493.389247:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633400192 00000100:00100000:2.0:1787119493.389254:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633400192 00002000:00100000:2.0:1787119493.389289:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (21311488->21364735) req@ffff92a508cffb80 x1873929633400192/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.389299:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cffb80 with x1873929633400192 ext(21311488->21364735) 00002000:00010000:2.0:1787119493.389303:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cffb80 00000100:00100000:0.0:1787119493.389342:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9930 00000100:00100000:0.0:1787119493.389355:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633400192:12345-192.168.201.59@tcp:4:fsx.0 00010000:00010000:0.0:1787119493.391729:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.391748:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.391761:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.391768:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a611f6e000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119493.391773:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.391781:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.391799:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119493.391803:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119493.391807:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.391814:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2ea9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.391915:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633400064 00000100:00100000:1.0:1787119493.391926:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633400064 00000100:00100000:1.0:1787119493.391982:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19584 00000100:00100000:1.0:1787119493.391992:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+67:32724:x1873929633400064:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119493.392046:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119493.392064:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2eb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c26 expref: 67 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.392076:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119493.392080:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119493.392292:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.392306:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.392318:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119493.392381:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976398 00000004:00010000:1.0:1787119493.392415:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f08e2de reply state 00000000685044b2 transno 4294976399 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.392425:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119493.392565:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+69:32724:x1873929633400064:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 573us (4537us total) trans 4294976399 rc 0/0 00000100:00100000:1.0:1787119493.392574:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19584 00000020:00080000:1.0:1787119493.392580:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119493.394736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.395374:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633400320 00000100:00100000:0.0:1787119493.395385:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633400320 00002000:00010000:0.0:1787119493.395749:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (10701438->18446744073709551615) 00002000:00100000:0.0:1787119493.395754:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633400320 ext(10701438->18446744073709551615) 00002000:00010000:0.0:1787119493.395766:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05f80. 00000100:00100000:0.0:1787119493.395791:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9931 00000100:00100000:0.0:1787119493.395800:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633400320:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119493.396170:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 64521996 -> 10701438 00002000:00010000:0.0:1787119493.396174:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119491 -> 1787119492 00002000:00010000:0.0:1787119493.396177:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:0.0:1787119493.396180:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119491 -> 1787119492 00002000:00010000:0.0:1787119493.396182:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:0.0:1787119493.396243:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633400320:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 443us (1517us total) trans 4294968868 rc 0/0 00000100:00100000:0.0:1787119493.396251:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9931 00002000:00010000:0.0:1787119493.396254:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (10701438->18446744073709551615) 00002000:00100000:0.0:1787119493.396257:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633400320 ext(10701438->18446744073709551615) 00002000:00010000:0.0:1787119493.396262:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05f80. 00000100:00100000:2.0:1787119493.398324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.398517:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633400448 00000100:00100000:3.0:1787119493.398527:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633400448 00002000:00100000:3.0:1787119493.398576:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (21311488->21364735) req@ffff92a508cfc380 x1873929633400448/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.398587:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc380 with x1873929633400448 ext(21311488->21364735) 00002000:00010000:3.0:1787119493.398593:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc380 00000100:00100000:3.0:1787119493.398629:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9932 00000100:00100000:0.0:1787119493.398640:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633400192:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9285us (9680us total) trans 4294969114 rc 0/0 00000100:00100000:3.0:1787119493.398641:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633400448:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119493.398655:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9930 00002000:00100000:0.0:1787119493.398662:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (21311488->21364735) req@ffff92a508cffb80 x1873929633400192/t4294969114(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.398672:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cffb80 with x1873929633400192 ext(21311488->21364735) 00002000:00010000:0.0:1787119493.398676:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cffb80 00010000:00010000:1.0:1787119493.399035:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.399046:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.399053:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.399059:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119493.399064:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.399071:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.399086:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119493.399089:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119493.399093:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.399099:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ebe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.399287:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633397888:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 83225us (83521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.399295:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5029 00000001:00080000:3.0:1787119493.399428:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969113 is committed 00000100:00100000:0.0:1787119493.401030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.401092:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633400576 00000100:00100000:1.0:1787119493.401100:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633400576 00002000:00010000:1.0:1787119493.401131:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (15491427->18446744073709551615) 00002000:00100000:1.0:1787119493.401136:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124700 with x1873929633400576 ext(15491427->18446744073709551615) 00002000:00010000:1.0:1787119493.401148:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a124700. 00000100:00100000:1.0:1787119493.401180:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9933 00000100:00100000:1.0:1787119493.401190:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633400576:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119493.401508:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 25736352 -> 15491427 00002000:00010000:1.0:1787119493.401512:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119491 -> 1787119492 00002000:00010000:1.0:1787119493.401515:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119493.401517:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119491 -> 1787119492 00002000:00010000:1.0:1787119493.401519:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119493.401580:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633400576:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 391us (556us total) trans 4294968869 rc 0/0 00000100:00100000:1.0:1787119493.401587:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9933 00002000:00010000:1.0:1787119493.401591:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (15491427->18446744073709551615) 00002000:00100000:1.0:1787119493.401593:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124700 with x1873929633400576 ext(15491427->18446744073709551615) 00002000:00010000:1.0:1787119493.401597:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a124700. 00000100:00100000:3.0:1787119493.411254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.411295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.411362:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633400704 00000100:00100000:1.0:1787119493.411366:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633400832 00000100:00100000:2.0:1787119493.411374:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633400704 00000100:00100000:1.0:1787119493.411375:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633400832 00000100:00100000:2.0:1787119493.411485:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19585 00000100:00100000:2.0:1787119493.411504:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+68:32720:x1873929633400704:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119493.411529:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119493.411551:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e2ec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c2d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.411627:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2ecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.411641:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.411651:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119493.411675:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 10701438 00000004:00200000:2.0:1787119493.411680:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119493.411708:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.411733:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e2ec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c2d expref: 70 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.411767:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5030 00000100:00100000:1.0:1787119493.411777:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633400832:12345-192.168.201.59@tcp:16:fsx.0 00010000:00010000:2.0:1787119493.411980:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c2d expref: 69 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.411993:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119493.411997:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119493.412000:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6069f4a00, rc 0) 00000100:00100000:2.0:1787119493.412062:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+69:32720:x1873929633400704:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 567us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119493.412071:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19585 00000100:00100000:0.0:1787119493.419983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.420075:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.420106:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633400960 00000100:00100000:0.0:1787119493.420117:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633400960 00002000:00100000:0.0:1787119493.420171:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (21311488->21315583) req@ffff92a62a127b80 x1873929633400960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.420183:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127b80 with x1873929633400960 ext(21311488->21315583) 00002000:00010000:0.0:1787119493.420190:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127b80 00000100:00100000:0.0:1787119493.420219:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9934 00000100:00100000:0.0:1787119493.420229:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633400960:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.422001:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633400960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1763us (2018us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.422012:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9934 00002000:00100000:0.0:1787119493.422022:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (21311488->21315583) req@ffff92a62a127b80 x1873929633400960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.422031:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127b80 with x1873929633400960 ext(21311488->21315583) 00002000:00010000:0.0:1787119493.422036:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127b80 00000100:00100000:0.0:1787119493.422780:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633401088 00000100:00100000:0.0:1787119493.422790:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633401088 00000100:00100000:0.0:1787119493.422844:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19586 00000100:00100000:0.0:1787119493.422854:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+69:32724:x1873929633401088:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119493.422870:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787119493.423338:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633400448:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 24699us (25021us total) trans 4294969115 rc 0/0 00000100:00100000:3.0:1787119493.423348:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9932 00002000:00100000:3.0:1787119493.423372:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (21311488->21364735) req@ffff92a508cfc380 x1873929633400448/t4294969115(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.423389:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc380 with x1873929633400448 ext(21311488->21364735) 00002000:00010000:3.0:1787119493.423394:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc380 00010000:00010000:0.0:1787119493.423485:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2ed3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c34 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.423583:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2eda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.423597:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.423622:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119493.423647:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 15491427 00000004:00200000:0.0:1787119493.423652:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119493.423672:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.423982:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2ed3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c34 expref: 71 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.424000:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2eda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c34 expref: 70 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.424009:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119493.424012:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119493.424015:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fae00, rc 0) 00000100:00100000:0.0:1787119493.424045:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+70:32724:x1873929633401088:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1193us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.424053:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19586 00000100:00100000:3.0:1787119493.426790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.426997:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633401216 00000100:00100000:0.0:1787119493.427010:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633401216 00002000:00100000:0.0:1787119493.427073:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (21315584->21319679) req@ffff92a63dc05c00 x1873929633401216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.427086:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05c00 with x1873929633401216 ext(21315584->21319679) 00002000:00010000:0.0:1787119493.427091:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05c00 00000100:00100000:0.0:1787119493.427116:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9935 00000100:00100000:0.0:1787119493.427125:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633401216:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.427624:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633401216:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 498us (845us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.427632:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9935 00002000:00100000:0.0:1787119493.427639:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (21315584->21319679) req@ffff92a63dc05c00 x1873929633401216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.427649:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05c00 with x1873929633401216 ext(21315584->21319679) 00002000:00010000:0.0:1787119493.427652:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05c00 00000100:00100000:3.0:1787119493.433879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.434978:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633401344 00000100:00100000:1.0:1787119493.434993:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633401344 00002000:00100000:1.0:1787119493.435051:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (21291008->21356543) req@ffff92a63dc07b80 x1873929633401344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.435063:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07b80 with x1873929633401344 ext(21291008->21356543) 00002000:00010000:1.0:1787119493.435069:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07b80 00000100:00100000:1.0:1787119493.435107:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9936 00000100:00100000:1.0:1787119493.435117:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633401344:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.446213:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.446256:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633401472 00000100:00100000:2.0:1787119493.446267:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633401472 00000100:00100000:2.0:1787119493.446326:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5031 00000100:00100000:2.0:1787119493.446337:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633401472:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119493.449519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.450009:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633401728 00000100:00100000:1.0:1787119493.450019:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633401728 00000100:00100000:1.0:1787119493.450077:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19587 00000100:00100000:1.0:1787119493.450088:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+70:32724:x1873929633401728:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119493.450141:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119493.450170:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e2eda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c34 expref: 70 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.450191:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119493.450196:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119493.450395:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.450409:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.450419:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119493.451301:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976400 00000004:00010000:1.0:1787119493.451341:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009408f0ea reply state 00000000d37d2d0f transno 4294976401 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.451354:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119493.451464:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+72:32724:x1873929633401728:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1376us (1952us total) trans 4294976401 rc 0/0 00000100:00100000:1.0:1787119493.451594:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19587 00000020:00080000:1.0:1787119493.451601:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119493.451923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.451952:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633401984 00000100:00100000:3.0:1787119493.451959:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633401984 00000100:00100000:3.0:1787119493.452005:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19588 00000100:00100000:3.0:1787119493.452014:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+72:32720:x1873929633401984:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119493.452051:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119493.452072:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2ecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c2d expref: 72 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.452088:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119493.452093:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119493.452221:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.452235:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.452245:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119493.452286:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976402 00000004:00010000:3.0:1787119493.452309:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed114b24 reply state 000000009dd3a43c transno 4294976403 ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119493.452321:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119493.452373:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+74:32720:x1873929633401984:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 360us (451us total) trans 4294976403 rc 0/0 00000100:00100000:3.0:1787119493.452380:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19588 00000020:00080000:3.0:1787119493.452384:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787119493.456813:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.456827:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.456832:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.456837:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a611f6f000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119493.456841:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.456845:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.456859:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119493.456861:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119493.456864:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.456868:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2ee8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.456898:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.456908:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.456914:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.456920:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119493.456924:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119493.456929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119493.456936:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.456949:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119493.456952:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119493.456955:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.456961:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e2ee1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119493.456987:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633402112 00000100:00100000:3.0:1787119493.456998:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633402112 00002000:00010000:3.0:1787119493.457031:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (48114906->18446744073709551615) 00002000:00100000:3.0:1787119493.457035:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125f80 with x1873929633402112 ext(48114906->18446744073709551615) 00002000:00010000:3.0:1787119493.457046:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a125f80. 00000100:00100000:3.0:1787119493.457081:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9937 00000100:00100000:3.0:1787119493.457090:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633402112:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119493.457914:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 10701438 -> 48114906 00002000:00010000:3.0:1787119493.457921:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119493.457923:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119493.457925:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119493.457928:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:0.0:1787119493.457986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.457989:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633402112:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 896us (1060us total) trans 4294968870 rc 0/0 00000100:00100000:3.0:1787119493.457999:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9937 00002000:00010000:3.0:1787119493.458004:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (48114906->18446744073709551615) 00000100:00100000:0.0:1787119493.458006:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633402240 00002000:00100000:3.0:1787119493.458008:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125f80 with x1873929633402112 ext(48114906->18446744073709551615) 00000100:00100000:0.0:1787119493.458011:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633402240 00002000:00010000:3.0:1787119493.458016:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a125f80. 00002000:00010000:0.0:1787119493.458028:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (34212788->18446744073709551615) 00002000:00100000:0.0:1787119493.458033:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125c00 with x1873929633402240 ext(34212788->18446744073709551615) 00002000:00010000:0.0:1787119493.458038:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a125c00. 00000100:00100000:0.0:1787119493.458054:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9938 00000100:00100000:0.0:1787119493.458059:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633402240:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119493.458170:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 15491427 -> 34212788 00002000:00010000:0.0:1787119493.458174:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119493.458176:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:0.0:1787119493.458178:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119493.458180:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:0.0:1787119493.458202:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633402240:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 142us (220us total) trans 4294968871 rc 0/0 00000100:00100000:0.0:1787119493.458210:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9938 00002000:00010000:0.0:1787119493.458213:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (34212788->18446744073709551615) 00002000:00100000:0.0:1787119493.458217:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125c00 with x1873929633402240 ext(34212788->18446744073709551615) 00002000:00010000:0.0:1787119493.458222:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a125c00. 00000100:00100000:1.0:1787119493.458466:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633401344:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 23324us (24577us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119493.458547:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9936 00002000:00100000:1.0:1787119493.458559:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (21291008->21356543) req@ffff92a63dc07b80 x1873929633401344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.458569:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07b80 with x1873929633401344 ext(21291008->21356543) 00002000:00010000:1.0:1787119493.458574:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07b80 00000100:00100000:0.0:1787119493.468316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.468414:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633402368 00000100:00100000:0.0:1787119493.468425:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633402368 00002000:00100000:0.0:1787119493.468519:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (21356544->21393407) req@ffff92a62a124a80 x1873929633402368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.468531:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124a80 with x1873929633402368 ext(21356544->21393407) 00002000:00010000:0.0:1787119493.468538:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a124a80 00000100:00100000:0.0:1787119493.468562:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9939 00000100:00100000:0.0:1787119493.468573:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633402368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.468980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.469019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.469980:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633402624 00000100:00100000:1.0:1787119493.469988:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633402496 00000100:00100000:3.0:1787119493.469992:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633402624 00000100:00100000:1.0:1787119493.469996:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633402496 00002000:00100000:1.0:1787119493.470039:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (34181120->34185215) req@ffff92a62a124000 x1873929633402496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.470051:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124000 with x1873929633402496 ext(34181120->34185215) 00002000:00010000:1.0:1787119493.470057:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a124000 00000100:00100000:1.0:1787119493.470084:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9940 00000100:00100000:3.0:1787119493.470100:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19589 00000100:00100000:3.0:1787119493.470111:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+72:32720:x1873929633402624:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119493.470131:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787119493.470150:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633402496:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119493.470153:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2eef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c3b expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.470239:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e2ef6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.470254:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e2ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.470266:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e2ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119493.470290:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 48114906 00000004:00200000:3.0:1787119493.470295:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119493.470314:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e2ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.470342:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2eef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c3b expref: 74 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.470360:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e2ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c3b expref: 73 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.470368:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119493.470372:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119493.470376:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6069f5a00, rc 0) 00000100:00100000:1.0:1787119493.470378:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633402496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 283us (1398us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119493.470388:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9940 00002000:00100000:1.0:1787119493.470395:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (34181120->34185215) req@ffff92a62a124000 x1873929633402496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119493.470409:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+73:32720:x1873929633402624:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 299us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119493.470415:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19589 00002000:00100000:1.0:1787119493.470706:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124000 with x1873929633402496 ext(34181120->34185215) 00002000:00010000:1.0:1787119493.470710:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a124000 00000100:00100000:3.0:1787119493.475431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.477152:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633402752 00000100:00100000:0.0:1787119493.477166:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633402752 00002000:00100000:0.0:1787119493.477219:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (25219072->25223167) req@ffff92a6181ae680 x1873929633402752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.477230:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ae680 with x1873929633402752 ext(25219072->25223167) 00002000:00010000:0.0:1787119493.477237:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181ae680 00000100:00100000:0.0:1787119493.477283:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9941 00000100:00100000:0.0:1787119493.477293:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633402752:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.477590:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633402752:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 297us (2168us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.477598:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9941 00002000:00100000:0.0:1787119493.477605:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (25219072->25223167) req@ffff92a6181ae680 x1873929633402752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.477613:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ae680 with x1873929633402752 ext(25219072->25223167) 00002000:00010000:0.0:1787119493.477617:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6181ae680 00000100:00100000:0.0:1787119493.477717:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633402368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9147us (9416us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119493.477725:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9939 00002000:00100000:0.0:1787119493.477731:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (21356544->21393407) req@ffff92a62a124a80 x1873929633402368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.477740:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124a80 with x1873929633402368 ext(21356544->21393407) 00002000:00010000:0.0:1787119493.477744:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a124a80 00000100:00100000:3.0:1787119493.480779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.480950:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633402880 00000100:00100000:1.0:1787119493.480960:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633402880 00002000:00100000:1.0:1787119493.481004:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (34185216->34189311) req@ffff92a5066dca80 x1873929633402880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.481016:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dca80 with x1873929633402880 ext(34185216->34189311) 00002000:00010000:1.0:1787119493.481022:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dca80 00000100:00100000:1.0:1787119493.481053:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9942 00000100:00100000:1.0:1787119493.481064:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633402880:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.481346:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633402880:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 283us (576us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119493.481368:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9942 00002000:00100000:1.0:1787119493.481376:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (34185216->34189311) req@ffff92a5066dca80 x1873929633402880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.481386:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dca80 with x1873929633402880 ext(34185216->34189311) 00002000:00010000:1.0:1787119493.481389:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dca80 00000100:00100000:2.0:1787119493.484808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.484968:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633403008 00000100:00100000:1.0:1787119493.484978:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633403008 00002000:00100000:1.0:1787119493.485027:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (25223168->25227263) req@ffff92a63eb2e680 x1873929633403008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.485038:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2e680 with x1873929633403008 ext(25223168->25227263) 00002000:00010000:1.0:1787119493.485044:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2e680 00000100:00100000:1.0:1787119493.485081:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9943 00000100:00100000:1.0:1787119493.485090:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633403008:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.485338:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633403008:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 247us (541us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119493.485346:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9943 00002000:00100000:1.0:1787119493.485353:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (25223168->25227263) req@ffff92a63eb2e680 x1873929633403008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.485373:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2e680 with x1873929633403008 ext(25223168->25227263) 00002000:00010000:1.0:1787119493.485376:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2e680 00000100:00100000:0.0:1787119493.490183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.490844:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633403264 00000100:00100000:2.0:1787119493.490858:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633403264 00002000:00100000:2.0:1787119493.491058:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (21311488->21364735) req@ffff92a62a126a00 x1873929633403264/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.491068:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126a00 with x1873929633403264 ext(21311488->21364735) 00002000:00010000:2.0:1787119493.491074:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126a00 00000100:00100000:2.0:1787119493.491114:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9944 00000100:00100000:2.0:1787119493.491125:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633403264:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119493.492225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.493278:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633403136 00000100:00100000:3.0:1787119493.493289:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633403136 00000100:00100000:3.0:1787119493.493880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.494053:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633403392 00000100:00100000:3.0:1787119493.494058:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633403392 00002000:00100000:3.0:1787119493.494096:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (25198592->25264127) req@ffff92a5066dc000 x1873929633403392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.494107:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633403392 ext(25198592->25264127) 00002000:00010000:3.0:1787119493.494113:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dc000 00000100:00100000:3.0:1787119493.494143:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9945 00000100:00100000:3.0:1787119493.494154:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633403392:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:2.0:1787119493.494977:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (34160640->34213887) req@ffff92a63eb2fb80 x1873929633403136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.494989:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2fb80 with x1873929633403136 ext(34160640->34213887) 00002000:00010000:2.0:1787119493.494994:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2fb80 00000100:00100000:2.0:1787119493.495025:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9946 00000100:00100000:2.0:1787119493.495033:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633403136:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.498278:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633403264:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 7145us (8096us total) trans 4294969116 rc 0/0 00000100:00100000:2.0:1787119493.498293:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9944 00002000:00100000:2.0:1787119493.498305:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (21311488->21364735) req@ffff92a62a126a00 x1873929633403264/t4294969116(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.498316:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126a00 with x1873929633403264 ext(21311488->21364735) 00002000:00010000:2.0:1787119493.498324:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126a00 00000100:00100000:3.0:1787119493.499047:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633403392:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4892us (5165us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.499057:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9945 00002000:00100000:3.0:1787119493.499065:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (25198592->25264127) req@ffff92a5066dc000 x1873929633403392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.499074:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633403392 ext(25198592->25264127) 00002000:00010000:3.0:1787119493.499078:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dc000 00000100:00100000:3.0:1787119493.499384:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633403136:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4349us (7162us total) trans 0 rc 45056/45056 00000100:00100000:3.0:1787119493.499392:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9946 00002000:00100000:3.0:1787119493.499399:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (34160640->34213887) req@ffff92a63eb2fb80 x1873929633403136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.499407:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2fb80 with x1873929633403136 ext(34160640->34213887) 00002000:00010000:3.0:1787119493.499411:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2fb80 00000001:00080000:3.0:1787119493.504391:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969114 is committed 00000100:00100000:0.0:1787119493.504829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.505041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.505139:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633403648 00000100:00100000:2.0:1787119493.505149:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633403648 00002000:00100000:2.0:1787119493.505198:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (25264128->25300991) req@ffff92a511633100 x1873929633403648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.505211:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633100 with x1873929633403648 ext(25264128->25300991) 00002000:00010000:2.0:1787119493.505217:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633100 00000100:00100000:2.0:1787119493.505242:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9947 00000100:00100000:2.0:1787119493.505252:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633403648:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.506016:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633403520 00000100:00100000:3.0:1787119493.506024:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633403520 00000100:00100000:3.0:1787119493.506058:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5032 00000100:00100000:3.0:1787119493.506066:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633403520:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119493.506198:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633400832:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 94423us (94902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119493.506206:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5030 00000100:00100000:2.0:1787119493.510246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.511186:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633403776 00000100:00100000:1.0:1787119493.511200:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633403776 00002000:00100000:1.0:1787119493.511254:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (34181120->34212787) req@ffff92a63eb2d880 x1873929633403776/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.511266:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2d880 with x1873929633403776 ext(34181120->34212787) 00002000:00010000:1.0:1787119493.511273:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2d880 00000100:00100000:1.0:1787119493.511302:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9948 00000100:00100000:1.0:1787119493.511312:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633403776:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119493.517881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.518205:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633403904 00000100:00100000:0.0:1787119493.518216:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633403904 00002000:00100000:0.0:1787119493.518263:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (6778880->6782975) req@ffff92a63eb2dc00 x1873929633403904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.518275:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2dc00 with x1873929633403904 ext(6778880->6782975) 00002000:00010000:0.0:1787119493.518281:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2dc00 00000100:00100000:0.0:1787119493.518308:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9949 00000100:00100000:0.0:1787119493.518318:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633403904:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.519315:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633403904:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 993us (1437us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.519326:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9949 00002000:00100000:0.0:1787119493.519334:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (6778880->6782975) req@ffff92a63eb2dc00 x1873929633403904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.519345:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2dc00 with x1873929633403904 ext(6778880->6782975) 00002000:00010000:0.0:1787119493.519349:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2dc00 00000100:00100000:2.0:1787119493.520157:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633403648:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14902us (15110us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119493.520167:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9947 00002000:00100000:2.0:1787119493.520175:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (25264128->25300991) req@ffff92a511633100 x1873929633403648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.520183:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633100 with x1873929633403648 ext(25264128->25300991) 00002000:00010000:2.0:1787119493.520187:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633100 00000100:00100000:1.0:1787119493.523193:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633403776:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 11873us (12947us total) trans 4294968872 rc 0/0 00000100:00100000:1.0:1787119493.523207:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9948 00002000:00100000:1.0:1787119493.523220:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (34181120->34212787) req@ffff92a63eb2d880 x1873929633403776/t4294968872(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.523231:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2d880 with x1873929633403776 ext(34181120->34212787) 00002000:00010000:1.0:1787119493.523236:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2d880 00000100:00100000:3.0:1787119493.535250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.535286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.535307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.535329:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633404032 00000100:00100000:3.0:1787119493.535339:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633404032 00002000:00100000:3.0:1787119493.535398:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (6782976->6787071) req@ffff92a5066dd880 x1873929633404032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.535544:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd880 with x1873929633404032 ext(6782976->6787071) 00002000:00010000:3.0:1787119493.535550:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd880 00000100:00100000:3.0:1787119493.535571:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633404288 00000100:00100000:3.0:1787119493.535574:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633404288 00002000:00100000:3.0:1787119493.535593:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (41299968->41316351) req@ffff92a5066df100 x1873929633404288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.535612:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df100 with x1873929633404288 ext(41299968->41316351) 00002000:00010000:3.0:1787119493.535616:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066df100 00000100:00100000:3.0:1787119493.535632:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9950 00000100:00100000:3.0:1787119493.535641:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633404032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.535867:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633404032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 225us (626us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.535874:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9950 00002000:00100000:3.0:1787119493.535881:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (6782976->6787071) req@ffff92a5066dd880 x1873929633404032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.536019:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd880 with x1873929633404032 ext(6782976->6787071) 00002000:00010000:3.0:1787119493.536022:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd880 00000100:00100000:3.0:1787119493.536039:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9951 00000100:00100000:3.0:1787119493.536046:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633404288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.536165:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633404288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 118us (856us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119493.536172:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9951 00002000:00100000:3.0:1787119493.536177:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (41299968->41316351) req@ffff92a5066df100 x1873929633404288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/16824 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.536185:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df100 with x1873929633404288 ext(41299968->41316351) 00002000:00010000:3.0:1787119493.536188:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066df100 00000100:00100000:1.0:1787119493.537388:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633404160 00000100:00100000:1.0:1787119493.537398:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633404160 00000100:00100000:1.0:1787119493.537767:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5033 00000100:00100000:1.0:1787119493.537776:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633404160:12345-192.168.201.59@tcp:16:fsx.0 00000001:00080000:0.0:1787119493.547213:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969116 is committed 00000100:00100000:1.0:1787119493.554085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.554133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.554160:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633404416 00000100:00100000:1.0:1787119493.554168:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633404416 00002000:00100000:1.0:1787119493.554211:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (6758400->6823935) req@ffff92a62a123480 x1873929633404416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.554223:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123480 with x1873929633404416 ext(6758400->6823935) 00002000:00010000:1.0:1787119493.554228:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123480 00000100:00100000:1.0:1787119493.554255:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9952 00000100:00100000:1.0:1787119493.554264:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633404416:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.554567:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633404672 00000100:00100000:1.0:1787119493.554571:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633404672 00000100:00100000:1.0:1787119493.554715:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19590 00000100:00100000:1.0:1787119493.554723:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+73:32720:x1873929633404672:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119493.554765:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119493.554793:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e2ef6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c3b expref: 73 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.554812:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119493.554817:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119493.555084:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.555098:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.555110:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119493.555159:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976404 00000004:00010000:1.0:1787119493.555186:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc55b4d8 reply state 00000000c348cce0 transno 4294976405 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.555195:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119493.555278:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+75:32720:x1873929633404672:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 555us (1144us total) trans 4294976405 rc 0/0 00000100:00100000:1.0:1787119493.555286:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19590 00000020:00080000:1.0:1787119493.555291:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119493.556953:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633403520:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 50877us (52118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.556967:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5032 00000100:00100000:2.0:1787119493.558770:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633401472:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 112422us (112559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119493.558783:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5031 00010000:00010000:3.0:1787119493.561732:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.561751:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.561759:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.561766:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119493.561771:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.561779:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.561801:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119493.561804:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119493.561808:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.561815:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2efd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119493.562383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.562574:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633404800 00000100:00100000:3.0:1787119493.562584:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633404800 00002000:00010000:3.0:1787119493.562637:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (53296850->18446744073709551615) 00002000:00100000:3.0:1787119493.562641:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630a80 with x1873929633404800 ext(53296850->18446744073709551615) 00002000:00010000:3.0:1787119493.562651:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511630a80. 00000100:00100000:3.0:1787119493.562677:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9953 00000100:00100000:3.0:1787119493.562687:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633404800:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119493.562978:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 48114906 -> 53296850 00002000:00010000:3.0:1787119493.562982:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119493.562984:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119493.562986:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119493.562987:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 909 00000100:00100000:3.0:1787119493.563041:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633404800:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 355us (662us total) trans 4294968873 rc 0/0 00000100:00100000:3.0:1787119493.563048:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9953 00002000:00010000:3.0:1787119493.563052:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (53296850->18446744073709551615) 00002000:00100000:3.0:1787119493.563054:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630a80 with x1873929633404800 ext(53296850->18446744073709551615) 00002000:00010000:3.0:1787119493.563058:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511630a80. 00000100:00100000:3.0:1787119493.563684:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633404416:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9419us (9607us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.563692:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9952 00002000:00100000:3.0:1787119493.563701:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (6758400->6823935) req@ffff92a62a123480 x1873929633404416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.563711:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123480 with x1873929633404416 ext(6758400->6823935) 00002000:00010000:3.0:1787119493.563716:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123480 00000100:00100000:2.0:1787119493.573306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.573512:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633404928 00000100:00100000:3.0:1787119493.573523:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633404928 00002000:00100000:3.0:1787119493.573572:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (6778880->6782975) req@ffff92a63eb2c380 x1873929633404928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.573584:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c380 with x1873929633404928 ext(6778880->6782975) 00002000:00010000:3.0:1787119493.573590:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2c380 00000100:00100000:3.0:1787119493.573628:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9954 00000100:00100000:3.0:1787119493.573637:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633404928:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.573892:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633404928:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 256us (599us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.574070:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9954 00002000:00100000:3.0:1787119493.574078:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (6778880->6782975) req@ffff92a63eb2c380 x1873929633404928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.574086:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c380 with x1873929633404928 ext(6778880->6782975) 00002000:00010000:3.0:1787119493.574089:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2c380 00000100:00100000:0.0:1787119493.580774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.581207:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633405056 00000100:00100000:3.0:1787119493.581218:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633405056 00000100:00100000:3.0:1787119493.581271:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19591 00000100:00100000:3.0:1787119493.581281:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+74:32720:x1873929633405056:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119493.581304:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119493.581325:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e2f04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.581434:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2f0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.581471:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.581482:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119493.581539:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 53296850 00000004:00200000:3.0:1787119493.581544:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119493.581562:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.581588:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e2f04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c42 expref: 76 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.581618:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c42 expref: 75 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.581628:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119493.581631:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119493.581634:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6069f4a00, rc 0) 00000100:00100000:3.0:1787119493.581694:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+75:32720:x1873929633405056:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 414us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119493.581702:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19591 00000100:00100000:0.0:1787119493.582053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.582318:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633405184 00000100:00100000:3.0:1787119493.582323:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633405184 00002000:00100000:3.0:1787119493.582366:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (6823936->6860799) req@ffff92a509135180 x1873929633405184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.582376:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135180 with x1873929633405184 ext(6823936->6860799) 00002000:00010000:3.0:1787119493.582381:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135180 00000100:00100000:3.0:1787119493.582529:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9955 00000100:00100000:3.0:1787119493.582540:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633405184:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.584084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.587194:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633404160:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 49407us (51896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.587209:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5033 00000100:00100000:3.0:1787119493.588268:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.588302:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633405312 00000100:00100000:0.0:1787119493.588312:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633405312 00002000:00100000:0.0:1787119493.588366:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (6782976->6787071) req@ffff92a5066dfb80 x1873929633405312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.588376:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dfb80 with x1873929633405312 ext(6782976->6787071) 00002000:00010000:0.0:1787119493.588382:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dfb80 00000100:00100000:0.0:1787119493.588699:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9956 00000100:00100000:0.0:1787119493.588711:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633405312:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.588964:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633405312:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 255us (4890us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.588972:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9956 00002000:00100000:0.0:1787119493.588980:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (6782976->6787071) req@ffff92a5066dfb80 x1873929633405312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.588988:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dfb80 with x1873929633405312 ext(6782976->6787071) 00002000:00010000:0.0:1787119493.588992:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dfb80 00000001:00080000:0.0:1787119493.589546:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968871 is committed 00000001:00080000:0.0:1787119493.589565:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968872 is committed 00000100:00100000:1.0:1787119493.590030:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633405440 00000100:00100000:1.0:1787119493.590039:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633405440 00002000:00100000:1.0:1787119493.590077:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (6778880->6782975) req@ffff92a5066ded80 x1873929633405440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.590087:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633405440 ext(6778880->6782975) 00002000:00010000:1.0:1787119493.590091:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ded80 00000100:00100000:1.0:1787119493.590149:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9957 00000100:00100000:1.0:1787119493.590158:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633405440:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.590364:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633405440:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 199us (2092us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119493.590371:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9957 00002000:00100000:1.0:1787119493.590377:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (6778880->6782975) req@ffff92a5066ded80 x1873929633405440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.590385:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633405440 ext(6778880->6782975) 00002000:00010000:1.0:1787119493.590388:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ded80 00000100:00100000:3.0:1787119493.594696:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633405184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12147us (12632us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119493.594710:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9955 00002000:00100000:3.0:1787119493.594722:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (6823936->6860799) req@ffff92a509135180 x1873929633405184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.594732:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135180 with x1873929633405184 ext(6823936->6860799) 00002000:00010000:3.0:1787119493.594738:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135180 00000100:00100000:1.0:1787119493.602215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.602257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.602343:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633405696 00000100:00100000:0.0:1787119493.602361:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633405696 00002000:00100000:0.0:1787119493.602419:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (6758400->6823935) req@ffff92a62a123800 x1873929633405696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.602431:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123800 with x1873929633405696 ext(6758400->6823935) 00002000:00010000:0.0:1787119493.602466:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123800 00000100:00100000:0.0:1787119493.602505:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9958 00000100:00100000:0.0:1787119493.602514:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633405696:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.603063:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633405568 00000100:00100000:3.0:1787119493.603069:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633405568 00000100:00100000:3.0:1787119493.603107:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19592 00000100:00100000:3.0:1787119493.603114:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+75:32724:x1873929633405568:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119493.603127:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119493.603146:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e2f12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c49 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.604132:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.604151:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.604163:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119493.604192:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 34212788 00000004:00200000:0.0:1787119493.604196:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119493.604215:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.604245:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e2f12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c49 expref: 77 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.604263:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c49 expref: 76 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.604273:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119493.604276:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119493.604280:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa800, rc 0) 00000100:00100000:0.0:1787119493.604390:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+76:32724:x1873929633405568:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1275us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.604398:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19592 00000100:00100000:3.0:1787119493.629676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.629720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.630226:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633405824 00000100:00100000:2.0:1787119493.630237:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633405824 00002000:00100000:2.0:1787119493.630289:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (6782976->6787071) req@ffff92a5066dc380 x1873929633405824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.630300:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc380 with x1873929633405824 ext(6782976->6787071) 00002000:00010000:2.0:1787119493.630305:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dc380 00000100:00100000:2.0:1787119493.630334:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633405952 00000100:00100000:2.0:1787119493.630337:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633405952 00002000:00100000:2.0:1787119493.630362:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (6778880->6832127) req@ffff92a5066dd180 x1873929633405952/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.630370:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633405952 ext(6778880->6832127) 00002000:00010000:2.0:1787119493.630374:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:2.0:1787119493.630401:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9959 00000100:00100000:2.0:1787119493.630410:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633405824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.630705:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633405824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 295us (1039us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119493.630713:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9959 00002000:00100000:2.0:1787119493.630720:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (6782976->6787071) req@ffff92a5066dc380 x1873929633405824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.630729:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc380 with x1873929633405824 ext(6782976->6787071) 00002000:00010000:2.0:1787119493.630732:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dc380 00000100:00100000:2.0:1787119493.630750:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9960 00000100:00100000:2.0:1787119493.630756:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633405952:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119493.630912:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633405696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 28396us (28651us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119493.630921:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9958 00002000:00100000:0.0:1787119493.630928:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (6758400->6823935) req@ffff92a62a123800 x1873929633405696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.630944:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123800 with x1873929633405696 ext(6758400->6823935) 00002000:00010000:0.0:1787119493.630948:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123800 00000100:00100000:1.0:1787119493.635530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.636641:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633406208 00000100:00100000:2.0:1787119493.636656:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633406208 00000100:00100000:2.0:1787119493.636734:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19593 00000100:00100000:2.0:1787119493.636745:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+76:32720:x1873929633406208:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119493.636799:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119493.636828:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e2f0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c42 expref: 76 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.636848:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119493.636853:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119493.637239:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.637254:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.637265:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119493.637326:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976406 00000004:00010000:2.0:1787119493.637352:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4728a97 reply state 000000000d85b85d transno 4294976407 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119493.638395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.638432:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633406336 00000100:00100000:3.0:1787119493.638466:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633406336 00002000:00100000:3.0:1787119493.638515:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (6758400->6823935) req@ffff92a5066de680 x1873929633406336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.638526:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de680 with x1873929633406336 ext(6758400->6823935) 00002000:00010000:3.0:1787119493.638532:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de680 00000100:00100000:3.0:1787119493.638556:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9961 00000100:00100000:3.0:1787119493.638564:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633406336:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.639690:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119493.639809:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+78:32720:x1873929633406208:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 3064us (4287us total) trans 4294976407 rc 0/0 00000100:00100000:2.0:1787119493.639818:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19593 00000020:00080000:2.0:1787119493.639823:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119493.641849:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633405952:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 11084us (12120us total) trans 4294969117 rc 0/0 00000100:00100000:2.0:1787119493.641863:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9960 00002000:00100000:2.0:1787119493.641875:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (6778880->6832127) req@ffff92a5066dd180 x1873929633405952/t4294969117(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.641885:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633405952 ext(6778880->6832127) 00002000:00010000:2.0:1787119493.641890:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:3.0:1787119493.644052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.644554:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633406464 00000100:00100000:2.0:1787119493.644563:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633406464 00000100:00100000:1.0:1787119493.644910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119493.644936:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.644947:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.644954:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.644965:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119493.644969:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.644977:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.644994:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119493.644997:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119493.645001:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.645007:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e2f20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.645031:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633406592 00000100:00100000:1.0:1787119493.645036:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633406592 00002000:00010000:1.0:1787119493.645053:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (25736352->18446744073709551615) 00002000:00100000:1.0:1787119493.645057:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123b80 with x1873929633406592 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119493.645068:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a123b80. 00000100:00100000:1.0:1787119493.645092:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9962 00000100:00100000:1.0:1787119493.645101:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633406592:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119493.645728:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 53296850 -> 25736352 00002000:00010000:1.0:1787119493.645733:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119493.645735:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:1.0:1787119493.645738:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119493.645740:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 909 -> 909 00000100:00100000:1.0:1787119493.645799:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633406592:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 698us (890us total) trans 4294968874 rc 0/0 00000100:00100000:1.0:1787119493.645808:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9962 00002000:00010000:1.0:1787119493.645812:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (25736352->18446744073709551615) 00002000:00100000:1.0:1787119493.645815:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123b80 with x1873929633406592 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119493.645820:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a123b80. 00000100:00100000:3.0:1787119493.646208:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633406336:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7642us (7817us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.646216:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9961 00002000:00100000:3.0:1787119493.646225:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (6758400->6823935) req@ffff92a5066de680 x1873929633406336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.646288:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de680 with x1873929633406336 ext(6758400->6823935) 00002000:00010000:3.0:1787119493.646293:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de680 00002000:00100000:2.0:1787119493.646460:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (9064448->9068543) req@ffff92a5066dd500 x1873929633406464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.646470:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633406464 ext(9064448->9068543) 00002000:00010000:2.0:1787119493.646475:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dd500 00000100:00100000:2.0:1787119493.646505:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9963 00000100:00100000:2.0:1787119493.646515:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633406464:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.647536:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633406464:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1018us (3487us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119493.647545:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9963 00002000:00100000:2.0:1787119493.647552:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (9064448->9068543) req@ffff92a5066dd500 x1873929633406464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.647560:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633406464 ext(9064448->9068543) 00002000:00010000:2.0:1787119493.647564:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dd500 00000100:00100000:2.0:1787119493.652757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.653070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.653120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.653182:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633406976 00000100:00100000:1.0:1787119493.653192:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633406976 00000100:00100000:1.0:1787119493.653241:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19594 00000100:00100000:1.0:1787119493.653248:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+77:32720:x1873929633406976:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119493.653268:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119493.653288:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2f27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.653384:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.653395:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.653402:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119493.653428:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 25736352 00000004:00200000:1.0:1787119493.653453:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119493.653473:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.653508:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2f27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c50 expref: 79 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.653529:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c50 expref: 78 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.653537:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119493.653539:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119493.653542:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119493.653591:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+78:32720:x1873929633406976:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 343us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.653606:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19594 00000100:00100000:0.0:1787119493.653995:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633406848 00000100:00100000:0.0:1787119493.654000:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633406848 00000100:00100000:0.0:1787119493.654033:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5034 00000100:00100000:0.0:1787119493.654038:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633406848:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119493.662164:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633406720 00000100:00100000:3.0:1787119493.662178:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633406720 00002000:00100000:3.0:1787119493.662235:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (6823936->6860799) req@ffff92a63eb2f100 x1873929633406720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.662253:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2f100 with x1873929633406720 ext(6823936->6860799) 00002000:00010000:3.0:1787119493.662258:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2f100 00000100:00100000:3.0:1787119493.662295:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9964 00000100:00100000:3.0:1787119493.662304:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633406720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119493.665054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.665291:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633407104 00000100:00100000:3.0:1787119493.665302:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633407104 00002000:00100000:3.0:1787119493.665346:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (9068544->9072639) req@ffff92a63eb2c000 x1873929633407104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787119493.665555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.665577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.665596:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633407488 00000100:00100000:1.0:1787119493.665609:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633407488 00002000:00100000:1.0:1787119493.665627:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (6823936->6860799) req@ffff92a62a121f80 x1873929633407488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.665637:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121f80 with x1873929633407488 ext(6823936->6860799) 00002000:00010000:1.0:1787119493.665642:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121f80 00000100:00100000:1.0:1787119493.665669:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9965 00000100:00100000:1.0:1787119493.665677:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633407488:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:3.0:1787119493.666185:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c000 with x1873929633407104 ext(9068544->9072639) 00002000:00010000:3.0:1787119493.666190:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2c000 00000100:00100000:3.0:1787119493.666217:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9966 00000100:00100000:3.0:1787119493.666226:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633407104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.666351:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633407104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 127us (1307us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.666473:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9966 00002000:00100000:3.0:1787119493.666481:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (9068544->9072639) req@ffff92a63eb2c000 x1873929633407104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.666499:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2c000 with x1873929633407104 ext(9068544->9072639) 00002000:00010000:3.0:1787119493.666503:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2c000 00000100:00100000:2.0:1787119493.667202:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633407360 00000100:00100000:2.0:1787119493.667210:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633407360 00000100:00100000:2.0:1787119493.667253:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19595 00000100:00100000:2.0:1787119493.667261:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+78:32720:x1873929633407360:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119493.667302:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119493.667327:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e2f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c50 expref: 78 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.667345:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119493.667350:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119493.667590:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.667758:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.667769:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119493.667824:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976408 00000004:00010000:2.0:1787119493.667851:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009aea7a3f reply state 000000002631e3e2 transno 4294976409 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119493.667860:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119493.669761:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+80:32720:x1873929633407360:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2489us (4195us total) trans 4294976409 rc 0/0 00000100:00100000:2.0:1787119493.669773:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19595 00000020:00080000:2.0:1787119493.669779:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119493.679698:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633406720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17377us (26931us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119493.679712:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9964 00002000:00100000:3.0:1787119493.679725:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (6823936->6860799) req@ffff92a63eb2f100 x1873929633406720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.679736:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2f100 with x1873929633406720 ext(6823936->6860799) 00002000:00010000:3.0:1787119493.679742:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2f100 00000100:00100000:3.0:1787119493.680722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119493.682766:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.682782:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.682790:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.682796:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119493.682801:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.682809:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.682825:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119493.682828:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119493.682833:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.682838:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e2f35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.683307:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633407616 00000100:00100000:1.0:1787119493.683319:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633407616 00002000:00100000:1.0:1787119493.683879:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (9043968->9109503) req@ffff92a5066df480 x1873929633407616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.683966:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633407616 ext(9043968->9109503) 00002000:00010000:1.0:1787119493.683973:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:1.0:1787119493.684005:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9967 00000100:00100000:1.0:1787119493.684018:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633407616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.685853:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633407488:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20164us (20262us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119493.685868:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9965 00002000:00100000:1.0:1787119493.685880:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (6823936->6860799) req@ffff92a62a121f80 x1873929633407488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.685891:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121f80 with x1873929633407488 ext(6823936->6860799) 00002000:00010000:1.0:1787119493.686888:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121f80 00000100:00100000:0.0:1787119493.707141:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633406848:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 53091us (54059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.707157:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5034 00000001:00080000:0.0:1787119493.707195:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969117 is committed 00000100:00100000:2.0:1787119493.722507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.722608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.722870:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633407744 00000100:00100000:0.0:1787119493.722881:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633407744 00002000:00010000:0.0:1787119493.722932:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (15491427->18446744073709551615) 00002000:00100000:0.0:1787119493.722937:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ea00 with x1873929633407744 ext(15491427->18446744073709551615) 00002000:00010000:0.0:1787119493.722949:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ea00. 00000100:00100000:0.0:1787119493.723017:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633407872 00000100:00100000:0.0:1787119493.723021:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633407872 00002000:00100000:0.0:1787119493.723044:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (6778880->6832127) req@ffff92a63eb2ce00 x1873929633407872/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.723055:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ce00 with x1873929633407872 ext(6778880->6832127) 00002000:00010000:0.0:1787119493.723059:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ce00 00000100:00100000:3.0:1787119493.723089:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9968 00000100:00100000:3.0:1787119493.723099:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633407744:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119493.723393:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 25736352 -> 15491427 00002000:00010000:3.0:1787119493.723397:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119493.723400:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:3.0:1787119493.723402:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119493.723404:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 909 -> 909 00000100:00100000:3.0:1787119493.723500:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633407744:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 391us (1001us total) trans 4294968875 rc 0/0 00000100:00100000:3.0:1787119493.723508:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9968 00002000:00010000:3.0:1787119493.723512:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (15491427->18446744073709551615) 00002000:00100000:3.0:1787119493.723514:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ea00 with x1873929633407744 ext(15491427->18446744073709551615) 00002000:00010000:3.0:1787119493.723519:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ea00. 00000100:00100000:3.0:1787119493.723536:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9969 00000100:00100000:3.0:1787119493.723543:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633407872:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119493.725876:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633407616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 41852us (45150us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119493.725888:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9967 00002000:00100000:1.0:1787119493.725905:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (9043968->9109503) req@ffff92a5066df480 x1873929633407616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.725915:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633407616 ext(9043968->9109503) 00002000:00010000:1.0:1787119493.725921:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:2.0:1787119493.727187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.727265:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633408000 00000100:00100000:3.0:1787119493.727275:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633408000 00002000:00100000:3.0:1787119493.727316:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (45076480->45080575) req@ffff92a63eb2e300 x1873929633408000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.727327:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2e300 with x1873929633408000 ext(45076480->45080575) 00002000:00010000:3.0:1787119493.727332:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2e300 00000100:00100000:3.0:1787119493.727373:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9970 00000100:00100000:3.0:1787119493.727382:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633408000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.727669:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633408000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 286us (488us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.727677:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9970 00002000:00100000:3.0:1787119493.727684:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (45076480->45080575) req@ffff92a63eb2e300 x1873929633408000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.727692:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2e300 with x1873929633408000 ext(45076480->45080575) 00002000:00010000:3.0:1787119493.727695:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2e300 00000100:00100000:3.0:1787119493.733202:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633407872:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9647us (10583us total) trans 4294969118 rc 0/0 00000100:00100000:3.0:1787119493.733217:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9969 00002000:00100000:3.0:1787119493.733230:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (6778880->6832127) req@ffff92a63eb2ce00 x1873929633407872/t4294969118(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.733240:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ce00 with x1873929633407872 ext(6778880->6832127) 00002000:00010000:3.0:1787119493.733246:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ce00 00000100:00100000:0.0:1787119493.747568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.747622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.747726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.748402:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633408384 00000100:00100000:1.0:1787119493.748413:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633408384 00000100:00100000:1.0:1787119493.748507:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19596 00000100:00100000:1.0:1787119493.748517:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+79:32720:x1873929633408384:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119493.748540:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119493.748572:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2f3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c57 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.748660:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2f43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.748674:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.748694:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119493.748720:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 15491427 00000004:00200000:1.0:1787119493.748725:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119493.748742:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.748767:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e2f3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c57 expref: 81 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.748784:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c57 expref: 80 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.748793:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119493.748796:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119493.748799:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119493.748851:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+80:32720:x1873929633408384:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 335us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.748859:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19596 00000100:00100000:3.0:1787119493.753559:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633408128 00000100:00100000:3.0:1787119493.753575:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633408128 00002000:00100000:3.0:1787119493.753641:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (6778880->6832127) req@ffff92a509134e00 x1873929633408128/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.753653:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134e00 with x1873929633408128 ext(6778880->6832127) 00002000:00010000:3.0:1787119493.753659:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509134e00 00000100:00100000:3.0:1787119493.753763:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633408256 00000100:00100000:3.0:1787119493.753767:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633408256 00002000:00100000:3.0:1787119493.753782:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (45080576->45084671) req@ffff92a509134380 x1873929633408256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.753789:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134380 with x1873929633408256 ext(45080576->45084671) 00002000:00010000:3.0:1787119493.753792:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509134380 00000100:00100000:3.0:1787119493.753811:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9971 00000100:00100000:3.0:1787119493.753819:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633408128:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119493.754207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.756126:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633408512 00000100:00100000:2.0:1787119493.756139:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633408512 00000100:00100000:3.0:1787119493.756414:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9972 00000100:00100000:3.0:1787119493.756431:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633408256:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.756743:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633408256:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 316us (9118us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.756751:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9972 00002000:00100000:3.0:1787119493.756761:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (45080576->45084671) req@ffff92a509134380 x1873929633408256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.756772:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134380 with x1873929633408256 ext(45080576->45084671) 00002000:00010000:3.0:1787119493.756777:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509134380 00002000:00100000:0.0:1787119493.757676:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (9064448->9097215) req@ffff92a509136680 x1873929633408512/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.757838:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136680 with x1873929633408512 ext(9064448->9097215) 00002000:00010000:0.0:1787119493.757842:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509136680 00000100:00100000:0.0:1787119493.757867:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9973 00000100:00100000:0.0:1787119493.757876:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633408512:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119493.769871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.770073:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633408640 00000100:00100000:1.0:1787119493.770083:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633408640 00000100:00100000:1.0:1787119493.770141:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5035 00000100:00100000:1.0:1787119493.770150:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633408640:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119493.773586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.774008:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633408768 00000100:00100000:3.0:1787119493.774018:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633408768 00002000:00100000:3.0:1787119493.774066:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (45056000->45121535) req@ffff92a63eb2ed80 x1873929633408768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.774078:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ed80 with x1873929633408768 ext(45056000->45121535) 00002000:00010000:3.0:1787119493.774084:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ed80 00000100:00100000:3.0:1787119493.774159:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9974 00000100:00100000:3.0:1787119493.774169:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633408768:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.779510:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633408128:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 25669us (31930us total) trans 4294969119 rc 0/0 00000100:00100000:3.0:1787119493.779526:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9971 00002000:00100000:3.0:1787119493.779543:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (6778880->6832127) req@ffff92a509134e00 x1873929633408128/t4294969119(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.779555:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134e00 with x1873929633408128 ext(6778880->6832127) 00002000:00010000:3.0:1787119493.779562:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509134e00 00000100:00100000:1.0:1787119493.786307:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.786349:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633408512:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 28472us (32140us total) trans 4294968876 rc 0/0 00000100:00100000:0.0:1787119493.786361:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9973 00002000:00100000:0.0:1787119493.786375:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (9064448->9097215) req@ffff92a509136680 x1873929633408512/t4294968876(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787119493.786385:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633409024 00002000:00100000:0.0:1787119493.786385:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136680 with x1873929633408512 ext(9064448->9097215) 00002000:00010000:0.0:1787119493.786390:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509136680 00000100:00100000:2.0:1787119493.786392:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633409024 00000100:00100000:2.0:1787119493.786430:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19597 00000100:00100000:2.0:1787119493.786457:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+80:32720:x1873929633409024:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119493.786516:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119493.786544:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e2f43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c57 expref: 80 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.786560:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119493.786564:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119493.786770:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.786783:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.786792:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119493.786841:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976410 00000004:00010000:2.0:1787119493.786866:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008203de25 reply state 000000004ce2207a transno 4294976411 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119493.786875:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119493.787757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.787780:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633409152 00000100:00100000:1.0:1787119493.787793:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633409152 00000100:00100000:1.0:1787119493.787828:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5036 00000100:00100000:1.0:1787119493.787836:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633409152:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119493.788414:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633408768:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14244us (14835us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.788423:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9974 00002000:00100000:3.0:1787119493.788434:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (45056000->45121535) req@ffff92a63eb2ed80 x1873929633408768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.788464:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ed80 with x1873929633408768 ext(45056000->45121535) 00002000:00010000:3.0:1787119493.788469:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ed80 00000100:00100000:2.0:1787119493.792064:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+82:32720:x1873929633409024:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 5612us (5752us total) trans 4294976411 rc 0/0 00000100:00100000:2.0:1787119493.792077:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19597 00000020:00080000:2.0:1787119493.792086:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119493.802690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.802770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.802823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.805853:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633409408 00000100:00100000:1.0:1787119493.805870:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633409408 00000100:00100000:1.0:1787119493.805936:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5037 00000100:00100000:1.0:1787119493.805945:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633409408:12345-192.168.201.59@tcp:16:fsx.0 00010000:00010000:0.0:1787119493.810700:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.810721:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.810730:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.810737:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119493.810742:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.810761:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119493.810773:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633409280 00010000:00010000:0.0:1787119493.810778:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119493.810781:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787119493.810783:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633409280 00010000:00010000:0.0:1787119493.810785:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.810792:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2f4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787119493.810865:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (45121536->45158399) req@ffff92a509135c00 x1873929633409280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119493.810874:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135c00 with x1873929633409280 ext(45121536->45158399) 00002000:00010000:2.0:1787119493.810878:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135c00 00000100:00100000:2.0:1787119493.811002:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633409536 00000100:00100000:2.0:1787119493.811006:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633409536 00002000:00010000:2.0:1787119493.811021:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (34212788->18446744073709551615) 00002000:00100000:2.0:1787119493.811025:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509137480 with x1873929633409536 ext(34212788->18446744073709551615) 00002000:00010000:2.0:1787119493.811033:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509137480. 00000100:00100000:1.0:1787119493.811082:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9975 00000100:00100000:1.0:1787119493.811094:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633409280:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.814524:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9976 00000100:00100000:0.0:1787119493.814631:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633409536:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119493.815250:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 15491427 -> 34212788 00002000:00010000:0.0:1787119493.815255:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119493.815257:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119490 00002000:00010000:0.0:1787119493.815259:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119493.815262:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 909 -> 909 00000100:00100000:0.0:1787119493.815326:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633409536:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 789us (12502us total) trans 4294968877 rc 0/0 00000100:00100000:0.0:1787119493.815335:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9976 00002000:00010000:0.0:1787119493.815340:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (34212788->18446744073709551615) 00002000:00100000:0.0:1787119493.815343:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509137480 with x1873929633409536 ext(34212788->18446744073709551615) 00002000:00010000:0.0:1787119493.815349:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509137480. 00000100:00100000:1.0:1787119493.826341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.826853:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633409664 00000100:00100000:3.0:1787119493.826864:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633409664 00002000:00100000:3.0:1787119493.826912:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (34181120->34185215) req@ffff92a62041f800 x1873929633409664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.826924:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f800 with x1873929633409664 ext(34181120->34185215) 00002000:00010000:3.0:1787119493.826930:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041f800 00000100:00100000:3.0:1787119493.826957:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9977 00000100:00100000:3.0:1787119493.826967:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633409664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.827642:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633409664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 673us (1308us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.827651:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9977 00002000:00100000:3.0:1787119493.827659:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (34181120->34185215) req@ffff92a62041f800 x1873929633409664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.827668:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f800 with x1873929633409664 ext(34181120->34185215) 00002000:00010000:3.0:1787119493.827672:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041f800 00000100:00100000:0.0:1787119493.829105:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633409280:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18005us (26421us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119493.829119:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9975 00002000:00100000:0.0:1787119493.829132:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (45121536->45158399) req@ffff92a509135c00 x1873929633409280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.829141:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135c00 with x1873929633409280 ext(45121536->45158399) 00002000:00010000:0.0:1787119493.829146:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135c00 00000001:00080000:0.0:1787119493.842065:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969118 is committed 00000100:00100000:0.0:1787119493.842906:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633408640:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 72750us (73038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.842917:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5035 00000100:00100000:3.0:1787119493.842972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.843104:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.843304:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633409792 00000100:00100000:0.0:1787119493.843312:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633409792 00002000:00100000:0.0:1787119493.843356:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (34185216->34189311) req@ffff92a5066de300 x1873929633409792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.843366:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de300 with x1873929633409792 ext(34185216->34189311) 00002000:00010000:0.0:1787119493.843371:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066de300 00000100:00100000:0.0:1787119493.843433:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9978 00000100:00100000:0.0:1787119493.843469:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633409792:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.843679:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633409792:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 212us (707us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119493.843687:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9978 00002000:00100000:0.0:1787119493.843693:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (34185216->34189311) req@ffff92a5066de300 x1873929633409792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.843701:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de300 with x1873929633409792 ext(34185216->34189311) 00002000:00010000:0.0:1787119493.843704:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066de300 00000100:00100000:2.0:1787119493.844222:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633410048 00000100:00100000:2.0:1787119493.844227:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633410048 00000100:00100000:2.0:1787119493.844261:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19598 00000100:00100000:2.0:1787119493.844269:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+81:32728:x1873929633410048:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119493.844310:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119493.844335:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a507c64e00/0xcaba3de8463e2dfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715be7 expref: 81 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.844522:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119493.844528:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119493.844730:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.844744:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.844754:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119493.844803:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976412 00000004:00010000:2.0:1787119493.844826:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e75c2dc reply state 000000001c00de56 transno 4294976413 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119493.844835:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119493.844897:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+83:32728:x1873929633410048:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 629us (1792us total) trans 4294976413 rc 0/0 00000100:00100000:2.0:1787119493.844904:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19598 00000020:00080000:2.0:1787119493.844908:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119493.853357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.853388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.853621:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633410176 00000100:00100000:0.0:1787119493.853630:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633410176 00002000:00100000:0.0:1787119493.853675:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (45076480->45080575) req@ffff92a606157800 x1873929633410176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.853686:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157800 with x1873929633410176 ext(45076480->45080575) 00002000:00010000:0.0:1787119493.853692:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157800 00000100:00100000:0.0:1787119493.853713:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633410304 00000100:00100000:0.0:1787119493.853716:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633410304 00002000:00100000:0.0:1787119493.853732:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (34160640->34213887) req@ffff92a606156d80 x1873929633410304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.853740:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156d80 with x1873929633410304 ext(34160640->34213887) 00002000:00010000:0.0:1787119493.853743:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606156d80 00010000:00010000:2.0:1787119493.854026:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.854037:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.854044:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.854051:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119493.854055:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.854062:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.854076:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119493.854078:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119493.854083:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.854092:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.854233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.855575:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633410432 00000100:00100000:3.0:1787119493.855587:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633410432 00002000:00010000:3.0:1787119493.855628:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (64521996->18446744073709551615) 00002000:00100000:3.0:1787119493.855633:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ed80 with x1873929633410432 ext(64521996->18446744073709551615) 00002000:00010000:3.0:1787119493.855645:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ed80. 00000100:00100000:3.0:1787119493.855686:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9979 00000100:00100000:3.0:1787119493.855696:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633410176:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.856136:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9980 00000100:00100000:1.0:1787119493.856510:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633410304:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.856806:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9981 00000100:00100000:0.0:1787119493.856817:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633410432:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119493.857180:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 62516461 -> 64521996 00002000:00010000:0.0:1787119493.857184:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119491 -> 1787119492 00002000:00010000:0.0:1787119493.857186:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:0.0:1787119493.857188:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119491 -> 1787119492 00002000:00010000:0.0:1787119493.857192:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1421 -> 1933 00000100:00100000:3.0:1787119493.859164:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633410176:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3457us (5805us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.859176:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9979 00002000:00100000:3.0:1787119493.859186:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (45076480->45080575) req@ffff92a606157800 x1873929633410176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.859193:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157800 with x1873929633410176 ext(45076480->45080575) 00002000:00010000:3.0:1787119493.859198:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157800 00000100:00100000:0.0:1787119493.859374:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633410432:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 2557us (5139us total) trans 4294969120 rc 0/0 00000100:00100000:0.0:1787119493.859383:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9981 00002000:00010000:0.0:1787119493.859387:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (64521996->18446744073709551615) 00002000:00100000:0.0:1787119493.859390:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ed80 with x1873929633410432 ext(64521996->18446744073709551615) 00002000:00010000:0.0:1787119493.859400:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ed80. 00000100:00100000:1.0:1787119493.865320:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633410304:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8804us (11920us total) trans 0 rc 45056/45056 00000100:00100000:1.0:1787119493.865334:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9980 00002000:00100000:1.0:1787119493.865348:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (34160640->34213887) req@ffff92a606156d80 x1873929633410304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.866482:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156d80 with x1873929633410304 ext(34160640->34213887) 00002000:00010000:1.0:1787119493.866497:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606156d80 00000100:00100000:3.0:1787119493.869241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.869328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.869357:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633410688 00000100:00100000:3.0:1787119493.869366:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633410688 00000100:00100000:3.0:1787119493.869416:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19599 00000100:00100000:3.0:1787119493.869557:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+82:32728:x1873929633410688:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119493.869581:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119493.869606:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e200/0xcaba3de8463e2f58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c5e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.869698:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e600/0xcaba3de8463e2f5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.869713:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e600/0xcaba3de8463e2f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.869723:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e600/0xcaba3de8463e2f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119493.869749:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 64521996 00000004:00200000:3.0:1787119493.869752:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119493.869769:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e600/0xcaba3de8463e2f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.869796:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e200/0xcaba3de8463e2f58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c5e expref: 84 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.869813:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e600/0xcaba3de8463e2f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c5e expref: 83 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.869821:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119493.869824:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119493.869828:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e600, rc 0) 00000100:00100000:3.0:1787119493.869885:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+83:32728:x1873929633410688:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 332us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119493.869892:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19599 00000100:00100000:3.0:1787119493.869929:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633410560 00000100:00100000:3.0:1787119493.869934:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633410560 00002000:00100000:3.0:1787119493.869959:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (45080576->45084671) req@ffff92a5066dea00 x1873929633410560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.869968:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633410560 ext(45080576->45084671) 00002000:00010000:3.0:1787119493.869974:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dea00 00000100:00100000:3.0:1787119493.869993:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9982 00000100:00100000:3.0:1787119493.870000:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633410560:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.870198:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633410560:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 197us (1311us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.870205:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9982 00002000:00100000:3.0:1787119493.870211:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (45080576->45084671) req@ffff92a5066dea00 x1873929633410560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.870218:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633410560 ext(45080576->45084671) 00002000:00010000:3.0:1787119493.870221:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dea00 00000100:00100000:0.0:1787119493.875841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.876367:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633409408:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 70420us (73593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119493.876380:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5037 00000001:00080000:1.0:1787119493.876419:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968876 is committed 00000100:00100000:3.0:1787119493.877259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.877353:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633410816 00000100:00100000:3.0:1787119493.877362:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633410816 00002000:00100000:3.0:1787119493.877405:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (34181120->34212787) req@ffff92a606155f80 x1873929633410816/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.877417:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155f80 with x1873929633410816 ext(34181120->34212787) 00002000:00010000:3.0:1787119493.877422:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155f80 00000100:00100000:3.0:1787119493.877594:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633410944 00000100:00100000:3.0:1787119493.877598:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633410944 00002000:00100000:3.0:1787119493.877619:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (45056000->45121535) req@ffff92a633e3d880 x1873929633410944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.877626:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3d880 with x1873929633410944 ext(45056000->45121535) 00002000:00010000:3.0:1787119493.877629:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3d880 00000100:00100000:3.0:1787119493.877649:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9983 00000100:00100000:3.0:1787119493.877656:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633410816:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119493.877779:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9984 00000100:00100000:3.0:1787119493.877786:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633410944:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.882508:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633410816:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 4831us (6656us total) trans 4294968878 rc 0/0 00000100:00100000:3.0:1787119493.882524:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9983 00002000:00100000:3.0:1787119493.882536:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (34181120->34212787) req@ffff92a606155f80 x1873929633410816/t4294968878(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/448 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.882548:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155f80 with x1873929633410816 ext(34181120->34212787) 00002000:00010000:3.0:1787119493.882554:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155f80 00000100:00100000:3.0:1787119493.883320:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633410944:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5530us (6061us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.883329:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9984 00002000:00100000:3.0:1787119493.883337:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (45056000->45121535) req@ffff92a633e3d880 x1873929633410944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.883345:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3d880 with x1873929633410944 ext(45056000->45121535) 00002000:00010000:3.0:1787119493.883358:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3d880 00000100:00100000:3.0:1787119493.887097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.887243:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633411072 00000100:00100000:1.0:1787119493.887252:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633411072 00002000:00100000:1.0:1787119493.887298:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (62394368->62406655) req@ffff92a633e3c000 x1873929633411072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.887308:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3c000 with x1873929633411072 ext(62394368->62406655) 00002000:00010000:1.0:1787119493.887315:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3c000 00000100:00100000:1.0:1787119493.887346:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9985 00000100:00100000:1.0:1787119493.887361:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633411072:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.887812:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633411072:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 456us (725us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119493.887820:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9985 00002000:00100000:1.0:1787119493.887827:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (62394368->62406655) req@ffff92a633e3c000 x1873929633411072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/12728 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.887834:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3c000 with x1873929633411072 ext(62394368->62406655) 00002000:00010000:1.0:1787119493.887837:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3c000 00000100:00100000:3.0:1787119493.897582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.897778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.897809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.899219:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633411200 00000100:00100000:0.0:1787119493.899232:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633411200 00002000:00100000:0.0:1787119493.899282:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (45121536->45158399) req@ffff92a633e3f800 x1873929633411200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.899293:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f800 with x1873929633411200 ext(45121536->45158399) 00002000:00010000:0.0:1787119493.899299:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3f800 00000100:00100000:0.0:1787119493.899466:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9986 00000100:00100000:0.0:1787119493.899475:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633411200:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119493.899834:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633411328 00000100:00100000:0.0:1787119493.899839:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633411328 00000100:00100000:0.0:1787119493.899864:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5038 00000100:00100000:0.0:1787119493.899870:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633411328:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119493.899970:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633411584 00000100:00100000:0.0:1787119493.900166:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633411584 00000100:00100000:0.0:1787119493.900198:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19600 00000100:00100000:0.0:1787119493.900204:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+83:32724:x1873929633411584:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119493.900241:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119493.900266:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c49 expref: 83 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.900284:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119493.900289:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119493.901003:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.901022:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.901032:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119493.901092:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976414 00000004:00010000:0.0:1787119493.901119:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d7eaddc reply state 000000003d69e010 transno 4294976415 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119493.901312:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119493.901541:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+85:32724:x1873929633411584:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1334us (3728us total) trans 4294976415 rc 0/0 00000100:00100000:0.0:1787119493.901549:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19600 00000020:00080000:0.0:1787119493.901554:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119493.905081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.905221:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633411840 00000100:00100000:1.0:1787119493.905233:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633411840 00000100:00100000:1.0:1787119493.905288:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19601 00000100:00100000:1.0:1787119493.905297:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+85:32728:x1873929633411840:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119493.905349:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119493.905376:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e600/0xcaba3de8463e2f5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c5e expref: 85 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.905394:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119493.905399:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119493.905690:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.905705:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.905715:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119493.905768:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976416 00000004:00010000:1.0:1787119493.905795:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000944b79d1 reply state 000000004e2e44c5 transno 4294976417 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.905804:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119493.905885:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+87:32728:x1873929633411840:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 588us (812us total) trans 4294976417 rc 0/0 00000100:00100000:1.0:1787119493.906887:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19601 00000020:00080000:1.0:1787119493.907671:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119493.908363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119493.908416:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.908427:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.908434:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.908707:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119493.908712:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.908720:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119493.908725:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969119 is committed 00010000:00010000:1.0:1787119493.908736:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119493.908739:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119493.908744:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119493.908750:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2f66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119493.908872:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633409152:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 121034us (121125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119493.908882:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5036 00000100:00100000:0.0:1787119493.909379:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633411968 00000100:00100000:0.0:1787119493.909387:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633411968 00002000:00010000:0.0:1787119493.909411:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (39439060->18446744073709551615) 00002000:00100000:0.0:1787119493.909414:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ca80 with x1873929633411968 ext(39439060->18446744073709551615) 00002000:00010000:0.0:1787119493.909422:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ca80. 00000100:00100000:0.0:1787119493.909466:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9987 00000100:00100000:0.0:1787119493.909475:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633411968:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119493.909687:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 34212788 -> 39439060 00002000:00010000:0.0:1787119493.909690:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119493.909692:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119490 -> 1787119491 00002000:00010000:0.0:1787119493.909694:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119493.909695:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1293 00000100:00100000:0.0:1787119493.909728:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633411968:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 254us (1371us total) trans 4294968879 rc 0/0 00000100:00100000:0.0:1787119493.909735:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9987 00002000:00010000:0.0:1787119493.909738:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (39439060->18446744073709551615) 00002000:00100000:0.0:1787119493.909741:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ca80 with x1873929633411968 ext(39439060->18446744073709551615) 00002000:00010000:0.0:1787119493.909745:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2ca80. 00000100:00100000:2.0:1787119493.917632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.917666:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633412096 00000100:00100000:2.0:1787119493.917675:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633412096 00002000:00010000:2.0:1787119493.917712:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (10701438->18446744073709551615) 00002000:00100000:2.0:1787119493.917718:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b4380 with x1873929633412096 ext(10701438->18446744073709551615) 00002000:00010000:2.0:1787119493.917729:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b4380. 00000100:00100000:2.0:1787119493.917758:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9988 00000100:00100000:2.0:1787119493.917768:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633412096:12345-192.168.201.59@tcp:10:fsx.0 00010000:00010000:3.0:1787119493.917969:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.917983:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.917990:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.917996:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119493.918001:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.918007:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.918023:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119493.918026:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119493.918030:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.918035:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e2f6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119493.918077:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 64521996 -> 10701438 00002000:00010000:2.0:1787119493.918080:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119493.918083:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119493.918085:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119493.918087:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119493.918147:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633412096:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 380us (525us total) trans 4294969121 rc 0/0 00000100:00100000:2.0:1787119493.918155:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9988 00002000:00010000:2.0:1787119493.918158:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (10701438->18446744073709551615) 00002000:00100000:2.0:1787119493.918161:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b4380 with x1873929633412096 ext(10701438->18446744073709551615) 00002000:00010000:2.0:1787119493.918166:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b4380. 00000100:00100000:3.0:1787119493.928675:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633411200:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 29190us (31091us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119493.928688:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9986 00002000:00100000:3.0:1787119493.928702:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (45121536->45158399) req@ffff92a633e3f800 x1873929633411200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.928713:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f800 with x1873929633411200 ext(45121536->45158399) 00002000:00010000:3.0:1787119493.928719:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3f800 00000100:00100000:2.0:1787119493.936212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.936263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.936286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.936619:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633412480 00000100:00100000:3.0:1787119493.936629:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633412480 00002000:00100000:3.0:1787119493.936682:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (45076480->45080575) req@ffff92a5068b4700 x1873929633412480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.936695:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b4700 with x1873929633412480 ext(45076480->45080575) 00002000:00010000:3.0:1787119493.936701:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b4700 00000100:00100000:3.0:1787119493.936721:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633412352 00000100:00100000:3.0:1787119493.936725:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633412352 00002000:00100000:3.0:1787119493.936740:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (39383040->39387135) req@ffff92a5068b6a00 x1873929633412352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.936749:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6a00 with x1873929633412352 ext(39383040->39387135) 00002000:00010000:3.0:1787119493.936752:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5068b6a00 00000100:00100000:3.0:1787119493.936776:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9989 00000100:00100000:3.0:1787119493.936785:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633412480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.937157:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633412480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 371us (891us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.937164:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9989 00002000:00100000:3.0:1787119493.937171:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (45076480->45080575) req@ffff92a5068b4700 x1873929633412480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.937180:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b4700 with x1873929633412480 ext(45076480->45080575) 00002000:00010000:3.0:1787119493.937184:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b4700 00000100:00100000:3.0:1787119493.937201:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9990 00000100:00100000:3.0:1787119493.937208:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633412352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.937301:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633412352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 93us (1015us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.937310:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9990 00002000:00100000:3.0:1787119493.937316:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (39383040->39387135) req@ffff92a5068b6a00 x1873929633412352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.937325:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6a00 with x1873929633412352 ext(39383040->39387135) 00002000:00010000:3.0:1787119493.937328:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5068b6a00 00000100:00100000:2.0:1787119493.937429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.937685:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633412224 00000100:00100000:3.0:1787119493.937691:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633412224 00000100:00100000:3.0:1787119493.937726:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633412736 00000100:00100000:3.0:1787119493.937729:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633412736 00000100:00100000:3.0:1787119493.938398:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19602 00000100:00100000:3.0:1787119493.938409:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+86:32728:x1873929633412224:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119493.938427:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119493.938468:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e200/0xcaba3de8463e2f74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c65 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.938561:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2f7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.938575:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.938589:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119493.940834:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 10701438 00000004:00200000:3.0:1787119493.940845:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119493.940874:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.941716:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e200/0xcaba3de8463e2f74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c65 expref: 88 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.941739:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c65 expref: 87 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.941750:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119493.941753:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119493.941757:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e000, rc 0) 00000100:00100000:3.0:1787119493.941825:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+87:32728:x1873929633412224:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 3417us (6228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119493.941834:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19602 00000100:00100000:3.0:1787119493.942051:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19603 00000100:00100000:3.0:1787119493.942061:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+86:32727:x1873929633412736:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119493.942098:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119493.942113:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e2e71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c11 expref: 86 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.942122:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119493.942124:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119493.942274:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.942284:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.942291:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119493.942325:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976418 00000004:00010000:3.0:1787119493.942340:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a57b1bec reply state 000000006ac2960a transno 4294976419 ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119493.942405:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119493.942496:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+88:32727:x1873929633412736:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 427us (5056us total) trans 4294976419 rc 0/0 00000100:00100000:3.0:1787119493.942503:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19603 00000020:00080000:3.0:1787119493.942507:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119493.942813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119493.943841:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633412864 00000100:00100000:1.0:1787119493.943851:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633412864 00002000:00100000:1.0:1787119493.943892:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (45080576->45084671) req@ffff92a5068b7480 x1873929633412864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.943902:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b7480 with x1873929633412864 ext(45080576->45084671) 00002000:00010000:1.0:1787119493.943908:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b7480 00000100:00100000:1.0:1787119493.943938:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9991 00000100:00100000:1.0:1787119493.943946:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633412864:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.944662:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633412864:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 709us (1842us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119493.944672:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9991 00002000:00100000:1.0:1787119493.944683:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (45080576->45084671) req@ffff92a5068b7480 x1873929633412864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.944692:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b7480 with x1873929633412864 ext(45080576->45084671) 00002000:00010000:1.0:1787119493.944695:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b7480 00000100:00100000:2.0:1787119493.947991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119493.948055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119493.948081:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.948093:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.948100:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.948107:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a611f6f000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119493.948112:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.948120:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.948137:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119493.948140:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119493.948145:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.948150:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6f000/0xcaba3de8463e2f82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119493.948288:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633412992 00000100:00100000:1.0:1787119493.948298:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633412992 00002000:00100000:1.0:1787119493.948345:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (39387136->39391231) req@ffff92a5068b4a80 x1873929633412992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.948355:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b4a80 with x1873929633412992 ext(39387136->39391231) 00002000:00010000:1.0:1787119493.948359:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5068b4a80 00000100:00100000:1.0:1787119493.948385:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633413120 00000100:00100000:1.0:1787119493.948388:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633413120 00002000:00010000:1.0:1787119493.948402:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (64521996->18446744073709551615) 00002000:00100000:1.0:1787119493.948405:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6300 with x1873929633413120 ext(64521996->18446744073709551615) 00002000:00010000:1.0:1787119493.948415:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b6300. 00000100:00100000:1.0:1787119493.948434:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9992 00000100:00100000:1.0:1787119493.948466:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633412992:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.948563:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9993 00000100:00100000:3.0:1787119493.948572:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633413120:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:1.0:1787119493.948728:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633412992:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 262us (747us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119493.948735:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9992 00002000:00100000:1.0:1787119493.948741:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (39387136->39391231) req@ffff92a5068b4a80 x1873929633412992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.948749:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b4a80 with x1873929633412992 ext(39387136->39391231) 00002000:00010000:1.0:1787119493.948753:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5068b4a80 00002000:00010000:3.0:1787119493.949681:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 62516461 -> 64521996 00002000:00010000:3.0:1787119493.949690:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119491 -> 1787119492 00002000:00010000:3.0:1787119493.949693:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:3.0:1787119493.949695:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119491 -> 1787119492 00002000:00010000:3.0:1787119493.949697:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1421 -> 1933 00000100:00100000:3.0:1787119493.949759:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633413120:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1184us (1699us total) trans 4294969122 rc 0/0 00000100:00100000:3.0:1787119493.949768:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9993 00002000:00010000:3.0:1787119493.949772:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (64521996->18446744073709551615) 00002000:00100000:3.0:1787119493.949775:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6300 with x1873929633413120 ext(64521996->18446744073709551615) 00002000:00010000:3.0:1787119493.949781:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b6300. 00000100:00100000:1.0:1787119493.952465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.959551:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633413248 00000100:00100000:0.0:1787119493.959568:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633413248 00002000:00100000:0.0:1787119493.959621:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (45056000->45121535) req@ffff92a62041f100 x1873929633413248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.959632:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f100 with x1873929633413248 ext(45056000->45121535) 00002000:00010000:0.0:1787119493.959638:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041f100 00000100:00100000:0.0:1787119493.959667:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9994 00000100:00100000:0.0:1787119493.959677:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633413248:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.963812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000001:00080000:1.0:1787119493.964763:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968877 is committed 00000001:00080000:1.0:1787119493.964779:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968878 is committed 00000100:00100000:1.0:1787119493.964804:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633413376 00000100:00100000:1.0:1787119493.964813:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633413376 00000100:00100000:1.0:1787119493.964871:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19604 00000100:00100000:1.0:1787119493.964881:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+87:32727:x1873929633413376:12345-192.168.201.59@tcp:101:fsx.0 00000100:00100000:0.0:1787119493.964950:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633411328:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 65078us (67170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.964960:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5038 00010000:00010000:1.0:1787119493.965288:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119493.965309:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e2f89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c6c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.966929:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.966951:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.966963:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119493.966994:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 64521996 00000004:00200000:0.0:1787119493.966998:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119493.967015:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.967047:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e2f89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c6c expref: 89 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.967065:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c6c expref: 88 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.967073:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119493.967076:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119493.967080:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa800, rc 0) 00000100:00100000:0.0:1787119493.967155:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+88:32727:x1873929633413376:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 2274us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.967164:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19604 00000100:00100000:3.0:1787119493.967547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.967674:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633413632 00000100:00100000:0.0:1787119493.967682:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633413632 00000100:00100000:0.0:1787119493.967731:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19605 00000100:00100000:0.0:1787119493.967740:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+88:32728:x1873929633413632:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119493.967791:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119493.967811:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a611f6e000/0xcaba3de8463e2f7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c65 expref: 88 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.967823:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119493.967828:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119493.968014:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.968026:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.968034:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119493.968086:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976420 00000004:00010000:0.0:1787119493.968114:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f382a5e reply state 000000008d940e2a transno 4294976421 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119493.968124:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119493.968195:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+90:32728:x1873929633413632:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 455us (649us total) trans 4294976421 rc 0/0 00000100:00100000:0.0:1787119493.968202:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19605 00000020:00080000:0.0:1787119493.968206:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119493.968473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.968588:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633413760 00000100:00100000:0.0:1787119493.968593:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633413760 00002000:00100000:0.0:1787119493.968625:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (39362560->39428095) req@ffff92a633e3ca80 x1873929633413760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.968635:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3ca80 with x1873929633413760 ext(39362560->39428095) 00002000:00010000:0.0:1787119493.968640:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3ca80 00000100:00100000:0.0:1787119493.968661:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9995 00000100:00100000:0.0:1787119493.968670:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633413760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119493.975894:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633413248:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16206us (23450us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119493.975909:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9994 00002000:00100000:1.0:1787119493.975923:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (45056000->45121535) req@ffff92a62041f100 x1873929633413248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119493.975934:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f100 with x1873929633413248 ext(45056000->45121535) 00002000:00010000:1.0:1787119493.975941:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041f100 00000100:00100000:3.0:1787119493.976158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119493.976253:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.976263:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.976270:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.976276:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119493.976281:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.976289:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.976304:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119493.976307:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119493.976312:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119493.976317:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e2f97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119493.976973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.977002:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633414016 00000100:00100000:3.0:1787119493.977011:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633414016 00002000:00100000:3.0:1787119493.977050:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (62394368->62406655) req@ffff92a633e3f480 x1873929633414016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.977060:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f480 with x1873929633414016 ext(62394368->62406655) 00002000:00010000:3.0:1787119493.977065:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3f480 00000100:00100000:3.0:1787119493.977085:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9996 00000100:00100000:3.0:1787119493.977093:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633414016:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.977372:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633414016:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 278us (400us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1787119493.977380:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9996 00002000:00100000:3.0:1787119493.977387:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (62394368->62406655) req@ffff92a633e3f480 x1873929633414016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/12728 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.977395:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3f480 with x1873929633414016 ext(62394368->62406655) 00002000:00010000:3.0:1787119493.977398:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3f480 00000100:00100000:3.0:1787119493.977460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.977559:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633414144 00000100:00100000:3.0:1787119493.977563:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633414144 00002000:00010000:3.0:1787119493.977578:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (48114906->18446744073709551615) 00002000:00100000:3.0:1787119493.977581:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55500 with x1873929633414144 ext(48114906->18446744073709551615) 00002000:00010000:3.0:1787119493.977604:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55500. 00000100:00100000:3.0:1787119493.977624:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9997 00000100:00100000:3.0:1787119493.977632:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633414144:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119493.977816:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 10701438 -> 48114906 00002000:00010000:3.0:1787119493.977820:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119493.977822:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:3.0:1787119493.977824:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119493.977827:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:3.0:1787119493.977854:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633414144:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 223us (393us total) trans 4294969123 rc 0/0 00000100:00100000:3.0:1787119493.977861:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9997 00002000:00010000:3.0:1787119493.977864:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (48114906->18446744073709551615) 00002000:00100000:3.0:1787119493.977867:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55500 with x1873929633414144 ext(48114906->18446744073709551615) 00002000:00010000:3.0:1787119493.977872:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55500. 00000100:00100000:2.0:1787119493.978612:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633413888 00000100:00100000:2.0:1787119493.978618:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633413888 00000100:00100000:2.0:1787119493.978657:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19606 00000100:00100000:2.0:1787119493.978666:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+89:32720:x1873929633413888:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119493.978689:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119493.978706:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c73 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.978788:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2fa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.978801:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.978812:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119493.978834:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 34212788 00000004:00200000:2.0:1787119493.978838:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119493.978854:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.978879:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2f9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c73 expref: 91 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.979114:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c73 expref: 90 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119493.979123:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119493.979126:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119493.979130:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:2.0:1787119493.979166:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+90:32720:x1873929633413888:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 501us (3010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119493.979173:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19606 00000100:00100000:3.0:1787119493.984802:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633413760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16123us (16318us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119493.984816:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9995 00002000:00100000:3.0:1787119493.984828:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (39362560->39428095) req@ffff92a633e3ca80 x1873929633413760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 504/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.984838:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3ca80 with x1873929633413760 ext(39362560->39428095) 00002000:00010000:3.0:1787119493.984844:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3ca80 00000100:00100000:3.0:1787119493.989436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.989495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.990692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119493.990723:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633414400 00000100:00100000:3.0:1787119493.990732:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633414400 00002000:00100000:3.0:1787119493.990778:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (45121536->45158399) req@ffff92a511f54700 x1873929633414400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.990789:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54700 with x1873929633414400 ext(45121536->45158399) 00002000:00010000:3.0:1787119493.990796:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f54700 00000100:00100000:3.0:1787119493.990817:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633414528 00000100:00100000:3.0:1787119493.990820:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633414528 00002000:00100000:3.0:1787119493.990836:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (9064448->9068543) req@ffff92a511f56300 x1873929633414528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/0 e 0 to 0 dl 1787119504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.990850:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56300 with x1873929633414528 ext(9064448->9068543) 00002000:00010000:3.0:1787119493.990854:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f56300 00000100:00100000:3.0:1787119493.990872:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9998 00000100:00100000:3.0:1787119493.990881:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633414400:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.991241:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 9999 00000100:00100000:3.0:1787119493.991249:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633414528:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119493.991563:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633414528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 314us (876us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119493.991569:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9999 00002000:00100000:3.0:1787119493.991576:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (9064448->9068543) req@ffff92a511f56300 x1873929633414528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/4536 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119493.991584:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56300 with x1873929633414528 ext(9064448->9068543) 00002000:00010000:3.0:1787119493.992034:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f56300 00000100:00100000:3.0:1787119493.995982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119493.996046:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633414400:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5164us (6617us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119493.996061:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 9998 00002000:00100000:0.0:1787119493.996072:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (45121536->45158399) req@ffff92a511f54700 x1873929633414400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:529/0 lens 488/440 e 0 to 0 dl 1787119504 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119493.996082:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54700 with x1873929633414400 ext(45121536->45158399) 00002000:00010000:0.0:1787119493.996089:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f54700 00000100:00100000:0.0:1787119493.996136:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633414272 00000100:00100000:0.0:1787119493.996145:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633414272 00000100:00100000:0.0:1787119493.996184:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633414784 00000100:00100000:0.0:1787119493.996187:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633414784 00000100:00100000:0.0:1787119493.996213:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19607 00000100:00100000:0.0:1787119493.996220:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+91:32728:x1873929633414272:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119493.996240:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119493.996262:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fbe00/0xcaba3de8463e2fac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c7a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.996345:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e2fb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.996359:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e2fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.996370:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e2fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119493.996396:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 48114906 00000004:00200000:0.0:1787119493.996400:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119493.996415:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e2fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.996469:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fbe00/0xcaba3de8463e2fac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c7a expref: 93 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.996497:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e2fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c7a expref: 92 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.996506:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119493.996509:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119493.996513:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb400, rc 0) 00000100:00100000:0.0:1787119493.996536:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+92:32728:x1873929633414272:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 316us (7050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119493.996542:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19607 00000100:00100000:0.0:1787119493.996558:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19608 00000100:00100000:0.0:1787119493.996565:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+91:32727:x1873929633414784:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119493.996593:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119493.996609:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2f90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c6c expref: 91 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.996620:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119493.996623:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119493.996794:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.996804:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119493.996823:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119493.996874:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976422 00000004:00010000:0.0:1787119493.996898:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b398452 reply state 000000001a455507 transno 4294976423 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119493.996907:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119493.997076:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+93:32727:x1873929633414784:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 511us (1103us total) trans 4294976423 rc 0/0 00000100:00100000:0.0:1787119493.997083:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19608 00000020:00080000:0.0:1787119493.997087:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787119494.001366:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.001385:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.001393:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.001400:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038faa00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119494.001405:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.001413:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.001430:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119494.001434:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119494.001454:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.001462:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.007399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.008412:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633414912 00000100:00100000:1.0:1787119494.008425:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633414912 00002000:00100000:1.0:1787119494.008512:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (39428096->39440383) req@ffff92a511f54000 x1873929633414912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.008523:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633414912 ext(39428096->39440383) 00002000:00010000:1.0:1787119494.008529:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54000 00000100:00100000:3.0:1787119494.008552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.008580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.008618:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633415168 00000100:00100000:1.0:1787119494.008623:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633415168 00000100:00100000:2.0:1787119494.008639:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10000 00002000:00100000:1.0:1787119494.008640:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (9068544->9072639) req@ffff92a511f57800 x1873929633415168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787119494.008649:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633414912:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:1.0:1787119494.008649:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633415168 ext(9068544->9072639) 00002000:00010000:1.0:1787119494.008653:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f57800 00000100:00100000:1.0:1787119494.008669:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10001 00000100:00100000:1.0:1787119494.008675:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633415168:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.008925:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633414912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 276us (1535us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119494.008933:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10000 00002000:00100000:2.0:1787119494.008939:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (39428096->39440383) req@ffff92a511f54000 x1873929633414912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/12728 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.008947:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633414912 ext(39428096->39440383) 00002000:00010000:2.0:1787119494.008950:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54000 00000100:00100000:0.0:1787119494.012737:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633415040 00000100:00100000:0.0:1787119494.012765:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633415040 00002000:00100000:0.0:1787119494.012836:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (25219072->25223167) req@ffff92a511f56a00 x1873929633415040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.012848:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56a00 with x1873929633415040 ext(25219072->25223167) 00002000:00010000:0.0:1787119494.012854:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f56a00 00000100:00100000:0.0:1787119494.012901:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10002 00000100:00100000:0.0:1787119494.012910:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633415040:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.013338:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633415168:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4659us (4783us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.013348:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10001 00002000:00100000:1.0:1787119494.013357:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (9068544->9072639) req@ffff92a511f57800 x1873929633415168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.013365:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633415168 ext(9068544->9072639) 00002000:00010000:1.0:1787119494.013369:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f57800 00000100:00100000:3.0:1787119494.013969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.014496:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633415296 00000100:00100000:1.0:1787119494.014504:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633415296 00002000:00010000:1.0:1787119494.014534:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (10701438->18446744073709551615) 00002000:00100000:1.0:1787119494.014538:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54380 with x1873929633415296 ext(10701438->18446744073709551615) 00002000:00010000:1.0:1787119494.014550:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f54380. 00000100:00100000:1.0:1787119494.014580:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10003 00000100:00100000:1.0:1787119494.014589:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633415296:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.015149:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 64521996 -> 10701438 00002000:00010000:1.0:1787119494.015153:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.015156:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119494.015159:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.015161:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119494.015228:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633415296:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 639us (1260us total) trans 4294969124 rc 0/0 00000100:00100000:1.0:1787119494.015238:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10003 00002000:00010000:1.0:1787119494.015241:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (10701438->18446744073709551615) 00002000:00100000:1.0:1787119494.015244:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54380 with x1873929633415296 ext(10701438->18446744073709551615) 00002000:00010000:1.0:1787119494.015249:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f54380. 00000100:00100000:3.0:1787119494.021536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.021578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.021615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.021640:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633415680 00000100:00100000:3.0:1787119494.021648:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633415680 00000100:00100000:2.0:1787119494.021707:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633415552 00000100:00100000:2.0:1787119494.021712:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633415552 00000100:00100000:2.0:1787119494.021763:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19609 00000100:00100000:2.0:1787119494.021773:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+92:32729:x1873929633415552:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119494.021841:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119494.021868:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2e0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715bee expref: 92 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.021887:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119494.021892:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1787119494.022038:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (39383040->39439059) req@ffff92a511f57480 x1873929633415680/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.022048:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633415680 ext(39383040->39439059) 00002000:00010000:3.0:1787119494.022053:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f57480 00000100:00100000:3.0:1787119494.022069:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633415808 00000100:00100000:3.0:1787119494.022072:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633415808 00002000:00100000:3.0:1787119494.022085:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (9043968->9109503) req@ffff92a511f55180 x1873929633415808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.022093:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55180 with x1873929633415808 ext(9043968->9109503) 00002000:00010000:3.0:1787119494.022096:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f55180 00010000:00010000:2.0:1787119494.022096:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.022110:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.022111:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10004 00000100:00100000:3.0:1787119494.022117:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633415680:12345-192.168.201.59@tcp:4:fsx.0 00010000:00010000:2.0:1787119494.022120:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119494.022170:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976424 00000004:00010000:2.0:1787119494.022194:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b8ba29b reply state 000000000b4104e4 transno 4294976425 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119494.022202:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119494.022258:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+94:32729:x1873929633415552:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 486us (733us total) trans 4294976425 rc 0/0 00000100:00100000:3.0:1787119494.022264:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10005 00000100:00100000:2.0:1787119494.022265:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19609 00000020:00080000:2.0:1787119494.022270:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119494.022271:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633415808:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.023382:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633415040:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10466us (14793us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.023392:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10002 00002000:00100000:1.0:1787119494.023399:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (25219072->25223167) req@ffff92a511f56a00 x1873929633415040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.023408:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56a00 with x1873929633415040 ext(25219072->25223167) 00002000:00010000:1.0:1787119494.023413:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f56a00 00000100:00100000:3.0:1787119494.026223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.026524:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633415936 00000100:00100000:0.0:1787119494.026534:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633415936 00000100:00100000:0.0:1787119494.026596:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19610 00000100:00100000:0.0:1787119494.026606:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+94:32727:x1873929633415936:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119494.026625:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119494.026648:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.026735:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.026748:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.026770:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119494.026798:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 10701438 00000004:00200000:0.0:1787119494.026803:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119494.026830:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.026856:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e2fc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c81 expref: 96 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.026872:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c81 expref: 95 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.026881:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119494.026884:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119494.026887:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa800, rc 0) 00000100:00100000:0.0:1787119494.026950:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+95:32727:x1873929633415936:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 345us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.026957:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19610 00000100:00100000:3.0:1787119494.032093:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633415808:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9811us (10466us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119494.032107:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10005 00002000:00100000:3.0:1787119494.032119:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (9043968->9109503) req@ffff92a511f55180 x1873929633415808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.032130:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55180 with x1873929633415808 ext(9043968->9109503) 00002000:00010000:3.0:1787119494.032136:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f55180 00010000:00010000:3.0:1787119494.034618:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.034641:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.034649:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.034655:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119494.034660:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.034667:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.034696:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119494.034700:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119494.034704:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.034711:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e2fc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.053181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.053652:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633416064 00000100:00100000:1.0:1787119494.053662:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633416064 00002000:00010000:1.0:1787119494.053712:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (64521996->18446744073709551615) 00002000:00100000:1.0:1787119494.053717:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c380 with x1873929633416064 ext(64521996->18446744073709551615) 00002000:00010000:1.0:1787119494.053731:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c380. 00000100:00100000:1.0:1787119494.053760:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10006 00000100:00100000:1.0:1787119494.053770:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633416064:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.054032:0:20838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 62516461 -> 64521996 00002000:00010000:1.0:1787119494.054037:0:20838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119491 -> 1787119492 00002000:00010000:1.0:1787119494.054039:0:20838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119494.054042:0:20838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119491 -> 1787119492 00002000:00010000:1.0:1787119494.054044:0:20838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1421 -> 1933 00000100:00100000:1.0:1787119494.054110:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633416064:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 341us (940us total) trans 4294969125 rc 0/0 00000100:00100000:1.0:1787119494.054118:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10006 00002000:00010000:1.0:1787119494.054121:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (64521996->18446744073709551615) 00002000:00100000:1.0:1787119494.054124:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c380 with x1873929633416064 ext(64521996->18446744073709551615) 00002000:00010000:1.0:1787119494.054129:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c380. 00000100:00100000:3.0:1787119494.058017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.058131:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633416192 00000100:00100000:0.0:1787119494.058141:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633416192 00002000:00100000:0.0:1787119494.058192:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (25223168->25227263) req@ffff92a50986ed80 x1873929633416192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.058205:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ed80 with x1873929633416192 ext(25223168->25227263) 00002000:00010000:0.0:1787119494.058211:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ed80 00000100:00100000:0.0:1787119494.058246:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10007 00000100:00100000:0.0:1787119494.058256:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633416192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.058551:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633416192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 296us (543us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119494.058558:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10007 00002000:00100000:0.0:1787119494.058565:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (25223168->25227263) req@ffff92a50986ed80 x1873929633416192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.058573:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ed80 with x1873929633416192 ext(25223168->25227263) 00002000:00010000:0.0:1787119494.058576:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ed80 00000100:00100000:3.0:1787119494.060821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.060994:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.061867:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633415680:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 39745us (40283us total) trans 4294968880 rc 0/0 00000100:00100000:3.0:1787119494.061880:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10004 00002000:00100000:3.0:1787119494.061900:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (39383040->39439059) req@ffff92a511f57480 x1873929633415680/t4294968880(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.061919:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633415680 ext(39383040->39439059) 00002000:00010000:3.0:1787119494.061925:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f57480 00000100:00100000:3.0:1787119494.061947:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633416320 00000100:00100000:3.0:1787119494.061953:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633416320 00002000:00100000:3.0:1787119494.062066:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (9064448->9097215) req@ffff92a50986f800 x1873929633416320/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.062076:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986f800 with x1873929633416320 ext(9064448->9097215) 00002000:00010000:3.0:1787119494.062080:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986f800 00000100:00100000:3.0:1787119494.062102:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10008 00000100:00100000:3.0:1787119494.062112:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633416320:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119494.062243:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633416576 00000100:00100000:0.0:1787119494.062248:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633416576 00000100:00100000:0.0:1787119494.062278:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19611 00000100:00100000:0.0:1787119494.062285:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+94:32727:x1873929633416576:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119494.062331:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119494.062363:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e2fcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c81 expref: 94 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.062381:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119494.062387:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119494.062655:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.062669:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.062686:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119494.062733:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976426 00000004:00010000:1.0:1787119494.062756:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb155b40 reply state 000000007a1556ed transno 4294976427 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.062764:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119494.062825:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+96:32727:x1873929633416576:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 540us (1831us total) trans 4294976427 rc 0/0 00000100:00100000:1.0:1787119494.062832:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19611 00000020:00080000:1.0:1787119494.062835:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119494.066094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.066332:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633416704 00000100:00100000:0.0:1787119494.066343:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633416704 00000100:00100000:0.0:1787119494.066414:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19612 00000100:00100000:0.0:1787119494.066424:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+96:32729:x1873929633416704:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119494.066474:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119494.066504:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2fdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c88 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.066590:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2fe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.066604:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.066621:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119494.066647:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 64521996 00000004:00200000:0.0:1787119494.066651:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119494.066670:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.066711:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e2fdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c88 expref: 98 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.066729:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c88 expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.066738:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119494.066742:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119494.066746:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fba00, rc 0) 00000100:00100000:0.0:1787119494.066825:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+97:32729:x1873929633416704:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 401us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.066833:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19612 00010000:00010000:1.0:1787119494.074403:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.074420:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.074428:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.074436:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119494.074456:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.074463:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.074481:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119494.074494:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119494.074499:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.074505:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e2fd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.076065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.076096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.076527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.076626:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633416832 00000100:00100000:1.0:1787119494.076636:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633416832 00002000:00010000:1.0:1787119494.076675:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (48114906->18446744073709551615) 00002000:00100000:1.0:1787119494.076681:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ca80 with x1873929633416832 ext(48114906->18446744073709551615) 00002000:00010000:1.0:1787119494.076694:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ca80. 00000100:00100000:1.0:1787119494.076719:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633416960 00000100:00100000:1.0:1787119494.076723:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633416960 00002000:00100000:1.0:1787119494.076743:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (25198592->25264127) req@ffff92a50986c700 x1873929633416960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.076752:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c700 with x1873929633416960 ext(25198592->25264127) 00002000:00010000:1.0:1787119494.076757:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c700 00000100:00100000:1.0:1787119494.076772:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10009 00000100:00100000:1.0:1787119494.076780:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633416832:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.077018:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 10701438 -> 48114906 00002000:00010000:1.0:1787119494.077021:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.077024:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119494.077026:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.077027:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119494.079541:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633416832:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 2749us (3478us total) trans 4294969126 rc 0/0 00000100:00100000:1.0:1787119494.079556:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10009 00002000:00010000:1.0:1787119494.079562:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (48114906->18446744073709551615) 00002000:00100000:1.0:1787119494.079566:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ca80 with x1873929633416832 ext(48114906->18446744073709551615) 00002000:00010000:1.0:1787119494.079576:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ca80. 00000100:00100000:1.0:1787119494.079619:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10010 00000100:00100000:1.0:1787119494.079633:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633416960:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.079784:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633416320:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 17672us (18970us total) trans 4294968881 rc 0/0 00000100:00100000:2.0:1787119494.079792:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10008 00002000:00100000:2.0:1787119494.079801:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (9064448->9097215) req@ffff92a50986f800 x1873929633416320/t4294968881(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119494.079959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:2.0:1787119494.080010:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986f800 with x1873929633416320 ext(9064448->9097215) 00002000:00010000:2.0:1787119494.080016:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986f800 00000100:00100000:2.0:1787119494.080034:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633417216 00000100:00100000:2.0:1787119494.080041:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633417216 00002000:00100000:2.0:1787119494.080071:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (62394368->62406655) req@ffff92a50986d180 x1873929633417216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.080085:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986d180 with x1873929633417216 ext(62394368->62406655) 00002000:00010000:2.0:1787119494.080088:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986d180 00000100:00100000:2.0:1787119494.080163:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10011 00000100:00100000:2.0:1787119494.080171:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633417216:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.080405:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633417216:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 235us (447us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119494.080412:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10011 00002000:00100000:2.0:1787119494.080418:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (62394368->62406655) req@ffff92a50986d180 x1873929633417216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/12728 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.080425:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986d180 with x1873929633417216 ext(62394368->62406655) 00002000:00010000:2.0:1787119494.080428:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986d180 00000100:00100000:0.0:1787119494.085193:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633417088 00000100:00100000:0.0:1787119494.085209:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633417088 00000100:00100000:0.0:1787119494.085280:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5039 00000100:00100000:0.0:1787119494.085291:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633417088:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119494.089872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.091280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.091332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.091388:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633417344 00000100:00100000:3.0:1787119494.091397:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633417344 00000100:00100000:3.0:1787119494.091456:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633417728 00000100:00100000:3.0:1787119494.091460:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633417728 00000100:00100000:3.0:1787119494.091495:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19613 00000100:00100000:3.0:1787119494.091505:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+97:32727:x1873929633417344:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119494.091529:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119494.091551:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2feb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.091649:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.091663:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.091686:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119494.091712:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 48114906 00000004:00200000:3.0:1787119494.091715:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119494.091733:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.091758:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e2feb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c8f expref: 99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.091777:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c8f expref: 98 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.091785:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119494.091788:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119494.091792:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00000100:00100000:3.0:1787119494.091846:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+98:32727:x1873929633417344:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 343us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119494.091853:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19613 00000100:00100000:3.0:1787119494.091871:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19614 00000100:00100000:3.0:1787119494.091878:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+97:32729:x1873929633417728:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119494.091974:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119494.091992:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e2fe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c88 expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.092004:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119494.092007:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119494.092190:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.092199:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.092206:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119494.092255:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976428 00000004:00010000:3.0:1787119494.092280:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a67059df reply state 000000004e7a6251 transno 4294976429 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.092289:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119494.092332:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+99:32729:x1873929633417728:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 455us (1000us total) trans 4294976429 rc 0/0 00000100:00100000:3.0:1787119494.092339:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19614 00000020:00080000:3.0:1787119494.092342:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119494.093505:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633417472 00000100:00100000:0.0:1787119494.093518:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633417472 00000100:00100000:0.0:1787119494.093579:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5040 00000100:00100000:0.0:1787119494.093587:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633417472:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119494.100263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.100308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119494.100334:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.101071:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633417856 00000100:00100000:3.0:1787119494.101081:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633417856 00002000:00010000:3.0:1787119494.101117:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (10701438->18446744073709551615) 00002000:00100000:3.0:1787119494.101122:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b7b80 with x1873929633417856 ext(10701438->18446744073709551615) 00002000:00010000:3.0:1787119494.101133:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b7b80. 00000100:00100000:3.0:1787119494.101162:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633417984 00000100:00100000:3.0:1787119494.101166:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633417984 00002000:00100000:3.0:1787119494.101186:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (25219072->25223167) req@ffff92a5068b6680 x1873929633417984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.101195:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6680 with x1873929633417984 ext(25219072->25223167) 00002000:00010000:3.0:1787119494.101199:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b6680 00000100:00100000:3.0:1787119494.101214:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10012 00000100:00100000:3.0:1787119494.101224:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633417856:12345-192.168.201.59@tcp:10:fsx.0 00010000:00010000:2.0:1787119494.102539:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.102551:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.102558:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119494.102562:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.102576:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.102666:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119494.102736:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119494.102742:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.102749:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e2ff9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119494.103077:0:19246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 64521996 -> 10701438 00002000:00010000:3.0:1787119494.103082:0:19246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119494.103084:0:19246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:3.0:1787119494.103087:0:19246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119494.103089:0:19246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:3.0:1787119494.103168:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633417856:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1940us (2910us total) trans 4294969127 rc 0/0 00000100:00100000:3.0:1787119494.103178:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10012 00002000:00010000:3.0:1787119494.103183:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (10701438->18446744073709551615) 00002000:00100000:3.0:1787119494.103186:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b7b80 with x1873929633417856 ext(10701438->18446744073709551615) 00002000:00010000:3.0:1787119494.103192:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b7b80. 00000100:00100000:3.0:1787119494.103222:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10013 00000100:00100000:3.0:1787119494.103234:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633417984:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.106329:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633417984:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3087us (6008us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.107156:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10013 00002000:00100000:3.0:1787119494.107177:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (25219072->25223167) req@ffff92a5068b6680 x1873929633417984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.107188:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5068b6680 with x1873929633417984 ext(25219072->25223167) 00002000:00010000:3.0:1787119494.107194:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5068b6680 00010000:00010000:2.0:1787119494.114309:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119494.117621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.117808:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633418112 00000100:00100000:1.0:1787119494.117826:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633418112 00000100:00100000:1.0:1787119494.117895:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19615 00000100:00100000:1.0:1787119494.117905:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5068b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+98:32729:x1873929633418112:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119494.117927:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119494.117948:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e3000 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c96 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.118037:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e3007 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.118050:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e3007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.118062:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e3007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119494.118089:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 10701438 00000004:00200000:1.0:1787119494.118093:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119494.118113:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e3007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.118138:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e3000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c96 expref: 100 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.118154:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e3007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c96 expref: 99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.118163:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119494.118166:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119494.118169:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431e00, rc 0) 00000100:00100000:1.0:1787119494.118231:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5068b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+99:32729:x1873929633418112:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 327us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.118238:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19615 00000100:00100000:0.0:1787119494.134822:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633416960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 55180us (58711us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119494.134836:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10010 00002000:00100000:0.0:1787119494.134850:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (25198592->25264127) req@ffff92a50986c700 x1873929633416960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.134860:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c700 with x1873929633416960 ext(25198592->25264127) 00002000:00010000:0.0:1787119494.134867:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c700 00000100:00100000:0.0:1787119494.140587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.141703:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633418240 00000100:00100000:3.0:1787119494.141716:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633418240 00002000:00100000:3.0:1787119494.141767:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (25223168->25227263) req@ffff92a606155500 x1873929633418240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.141779:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155500 with x1873929633418240 ext(25223168->25227263) 00002000:00010000:3.0:1787119494.141784:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606155500 00000100:00100000:3.0:1787119494.141819:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10014 00000100:00100000:3.0:1787119494.141828:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633418240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.142084:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633418240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 256us (1508us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.142091:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10014 00002000:00100000:3.0:1787119494.142099:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (25223168->25227263) req@ffff92a606155500 x1873929633418240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.142107:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155500 with x1873929633418240 ext(25223168->25227263) 00002000:00010000:3.0:1787119494.142110:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606155500 00000100:00100000:0.0:1787119494.154659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.154923:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633418496 00000100:00100000:3.0:1787119494.154933:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633418496 00000100:00100000:3.0:1787119494.155003:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19616 00000100:00100000:3.0:1787119494.155014:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+99:32729:x1873929633418496:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119494.155069:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119494.155096:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e3007 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c96 expref: 99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.155114:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119494.155118:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119494.155318:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.155333:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.155343:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119494.155410:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976430 00000004:00010000:3.0:1787119494.155436:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4a4d207 reply state 0000000079774fef transno 4294976431 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.155505:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119494.155609:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+101:32729:x1873929633418496:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 596us (961us total) trans 4294976431 rc 0/0 00000100:00100000:3.0:1787119494.155617:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19616 00000020:00080000:3.0:1787119494.155622:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119494.160183:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633417472:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 66585us (68898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.160197:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5040 00000100:00100000:1.0:1787119494.162639:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633417088:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 77339us (86102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.162652:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5039 00000001:00080000:1.0:1787119494.162697:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968879 is committed 00000001:00080000:1.0:1787119494.162712:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968881 is committed 00000100:00100000:1.0:1787119494.165992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.166030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.166138:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633418624 00000100:00100000:3.0:1787119494.166149:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633418624 00002000:00100000:3.0:1787119494.166195:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (25264128->25300991) req@ffff92a62041ca80 x1873929633418624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.166207:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ca80 with x1873929633418624 ext(25264128->25300991) 00002000:00010000:3.0:1787119494.166212:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ca80 00000100:00100000:3.0:1787119494.166240:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633418752 00000100:00100000:3.0:1787119494.166244:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633418752 00002000:00100000:3.0:1787119494.166258:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (25198592->25264127) req@ffff92a62041e300 x1873929633418752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.166265:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041e300 with x1873929633418752 ext(25198592->25264127) 00002000:00010000:3.0:1787119494.166268:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041e300 00000100:00100000:3.0:1787119494.166287:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10015 00000100:00100000:3.0:1787119494.166296:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633418624:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.166579:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10016 00000100:00100000:3.0:1787119494.166600:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633418752:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:0.0:1787119494.166974:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.166985:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.166992:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.166998:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119494.167003:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.167011:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.167032:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119494.167035:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119494.167040:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.167045:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e300e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.177864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.177893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.178101:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633418752:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11511us (12066us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119494.178112:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10016 00002000:00100000:1.0:1787119494.178125:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (25198592->25264127) req@ffff92a62041e300 x1873929633418752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.178134:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041e300 with x1873929633418752 ext(25198592->25264127) 00002000:00010000:1.0:1787119494.178141:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041e300 00000100:00100000:1.0:1787119494.178168:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633419008 00000100:00100000:1.0:1787119494.178175:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633419008 00002000:00010000:1.0:1787119494.178201:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (48114906->18446744073709551615) 00002000:00100000:1.0:1787119494.178205:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ce00 with x1873929633419008 ext(48114906->18446744073709551615) 00002000:00010000:1.0:1787119494.178216:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ce00. 00000100:00100000:1.0:1787119494.178239:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10017 00000100:00100000:1.0:1787119494.178249:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633419008:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.178508:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 10701438 -> 48114906 00002000:00010000:1.0:1787119494.178513:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.178515:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119494.178518:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.178520:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119494.178543:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633419008:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 295us (649us total) trans 4294969128 rc 0/0 00000100:00100000:1.0:1787119494.178551:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10017 00002000:00010000:1.0:1787119494.178554:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (48114906->18446744073709551615) 00002000:00100000:1.0:1787119494.178558:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ce00 with x1873929633419008 ext(48114906->18446744073709551615) 00002000:00010000:1.0:1787119494.178563:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ce00. 00000100:00100000:2.0:1787119494.178968:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633418880 00000100:00100000:2.0:1787119494.178973:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633418880 00000100:00100000:2.0:1787119494.179012:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19617 00000100:00100000:2.0:1787119494.179020:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+100:32724:x1873929633418880:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119494.179032:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119494.179049:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3015 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715c9d expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.179123:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e301c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.179139:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e301c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.179149:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e301c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119494.179176:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 39439060 00000004:00200000:2.0:1787119494.179181:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119494.179197:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e301c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.179223:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3015 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c9d expref: 102 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.179238:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e301c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c9d expref: 101 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.179247:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119494.179250:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119494.179254:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93000, rc 0) 00000100:00100000:2.0:1787119494.179286:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+101:32724:x1873929633418880:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 267us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119494.179292:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19617 00000100:00100000:3.0:1787119494.179878:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633418624:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13579us (13892us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119494.179886:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10015 00002000:00100000:3.0:1787119494.179895:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (25264128->25300991) req@ffff92a62041ca80 x1873929633418624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.179904:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ca80 with x1873929633418624 ext(25264128->25300991) 00002000:00010000:3.0:1787119494.179908:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ca80 00000100:00100000:2.0:1787119494.180024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.180382:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633419264 00000100:00100000:3.0:1787119494.180388:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633419264 00000100:00100000:3.0:1787119494.180480:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19618 00000100:00100000:3.0:1787119494.180500:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+101:32720:x1873929633419264:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119494.180538:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119494.180558:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e2fa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c73 expref: 101 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.180577:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119494.180581:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119494.181092:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.181105:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.181114:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119494.181163:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976432 00000004:00010000:3.0:1787119494.181189:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1bd6c40 reply state 00000000107ad199 transno 4294976433 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.181198:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119494.181305:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+103:32720:x1873929633419264:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 806us (1279us total) trans 4294976433 rc 0/0 00000100:00100000:3.0:1787119494.181312:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19618 00000020:00080000:3.0:1787119494.181316:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787119494.187229:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.187247:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.187255:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.187262:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119494.187267:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.187275:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.187292:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119494.187295:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119494.187300:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.187305:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3023 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.188107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.188185:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633419520 00000100:00100000:2.0:1787119494.188195:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633419520 00002000:00100000:2.0:1787119494.188244:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (7630848->7634943) req@ffff92a62041f480 x1873929633419520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.188255:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f480 with x1873929633419520 ext(7630848->7634943) 00002000:00010000:2.0:1787119494.188260:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041f480 00000100:00100000:2.0:1787119494.188293:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10018 00000100:00100000:2.0:1787119494.188302:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633419520:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.188647:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633419520:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 344us (547us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.188655:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10018 00002000:00100000:2.0:1787119494.188662:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (7630848->7634943) req@ffff92a62041f480 x1873929633419520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.188680:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f480 with x1873929633419520 ext(7630848->7634943) 00002000:00010000:2.0:1787119494.188685:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041f480 00000100:00100000:0.0:1787119494.191045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.191134:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633419392 00000100:00100000:1.0:1787119494.191143:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633419392 00002000:00010000:1.0:1787119494.191178:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (39439060->18446744073709551615) 00002000:00100000:1.0:1787119494.191182:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154a80 with x1873929633419392 ext(39439060->18446744073709551615) 00002000:00010000:1.0:1787119494.191193:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606154a80. 00000100:00100000:1.0:1787119494.191227:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10019 00000100:00100000:1.0:1787119494.191237:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633419392:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.191559:0:20838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 34212788 -> 39439060 00002000:00010000:1.0:1787119494.191563:0:20838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.191565:0:20838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119490 -> 1787119492 00002000:00010000:1.0:1787119494.191567:0:20838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.191569:0:20838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 909 -> 1293 00000100:00100000:1.0:1787119494.191631:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633419392:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 395us (595us total) trans 4294968882 rc 0/0 00000100:00100000:1.0:1787119494.191639:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10019 00002000:00010000:1.0:1787119494.191642:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (39439060->18446744073709551615) 00002000:00100000:1.0:1787119494.191645:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154a80 with x1873929633419392 ext(39439060->18446744073709551615) 00002000:00010000:1.0:1787119494.191650:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606154a80. 00000100:00100000:0.0:1787119494.196957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.197055:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633419648 00000100:00100000:2.0:1787119494.197067:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633419648 00002000:00100000:2.0:1787119494.197117:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (41299968->41316351) req@ffff92a606155880 x1873929633419648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.197128:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155880 with x1873929633419648 ext(41299968->41316351) 00002000:00010000:2.0:1787119494.197133:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606155880 00000100:00100000:2.0:1787119494.197165:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10020 00000100:00100000:2.0:1787119494.197174:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633419648:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.197492:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633419648:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 307us (533us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787119494.197500:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10020 00002000:00100000:2.0:1787119494.197507:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (41299968->41316351) req@ffff92a606155880 x1873929633419648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/16824 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.197514:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155880 with x1873929633419648 ext(41299968->41316351) 00002000:00010000:2.0:1787119494.197517:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606155880 00000100:00100000:0.0:1787119494.198607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.198777:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633419904 00000100:00100000:3.0:1787119494.198785:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633419904 00000100:00100000:3.0:1787119494.198832:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19619 00000100:00100000:3.0:1787119494.198841:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+102:32729:x1873929633419904:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119494.198861:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119494.198883:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e302a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ca4 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.198970:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.198984:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.198996:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119494.199023:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 48114906 00000004:00200000:3.0:1787119494.199028:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119494.199048:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.199076:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e302a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ca4 expref: 104 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.199093:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ca4 expref: 103 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.199101:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119494.199104:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119494.199108:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:3.0:1787119494.199162:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+103:32729:x1873929633419904:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 322us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119494.199168:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19619 00000100:00100000:3.0:1787119494.204120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.205361:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633419776 00000100:00100000:1.0:1787119494.205374:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633419776 00002000:00100000:1.0:1787119494.205425:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (25264128->25300991) req@ffff92a50986df80 x1873929633419776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.205490:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986df80 with x1873929633419776 ext(25264128->25300991) 00002000:00010000:1.0:1787119494.205497:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986df80 00000100:00100000:1.0:1787119494.205533:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10021 00000100:00100000:1.0:1787119494.205544:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633419776:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.207996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.208253:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633419776:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2709us (4143us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119494.208264:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10021 00002000:00100000:2.0:1787119494.208275:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (25264128->25300991) req@ffff92a50986df80 x1873929633419776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.208285:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986df80 with x1873929633419776 ext(25264128->25300991) 00002000:00010000:2.0:1787119494.208291:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986df80 00000100:00100000:2.0:1787119494.208316:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633420032 00000100:00100000:2.0:1787119494.208323:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633420032 00002000:00100000:2.0:1787119494.208359:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (25219072->25223167) req@ffff92a50986f100 x1873929633420032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.208367:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986f100 with x1873929633420032 ext(25219072->25223167) 00002000:00010000:2.0:1787119494.208371:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986f100 00000100:00100000:2.0:1787119494.208393:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10022 00000100:00100000:2.0:1787119494.208402:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633420032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.208640:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633420032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 239us (654us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.208647:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10022 00002000:00100000:2.0:1787119494.208653:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (25219072->25223167) req@ffff92a50986f100 x1873929633420032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.208660:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986f100 with x1873929633420032 ext(25219072->25223167) 00002000:00010000:2.0:1787119494.208663:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986f100 00000100:00100000:0.0:1787119494.216631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.216686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.216708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.216873:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633420416 00000100:00100000:3.0:1787119494.216885:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633420416 00002000:00100000:3.0:1787119494.216937:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (41299968->41316351) req@ffff92a606157100 x1873929633420416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.216949:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157100 with x1873929633420416 ext(41299968->41316351) 00002000:00010000:3.0:1787119494.216955:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157100 00000100:00100000:3.0:1787119494.216986:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633420544 00000100:00100000:3.0:1787119494.216990:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633420544 00002000:00100000:3.0:1787119494.217005:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (25223168->25227263) req@ffff92a606157b80 x1873929633420544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.217013:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157b80 with x1873929633420544 ext(25223168->25227263) 00002000:00010000:3.0:1787119494.217017:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157b80 00000100:00100000:3.0:1787119494.217039:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10023 00000100:00100000:3.0:1787119494.217049:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633420416:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.217324:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633420416:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 275us (636us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119494.217332:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10023 00002000:00100000:3.0:1787119494.217338:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (41299968->41316351) req@ffff92a606157100 x1873929633420416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/16824 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.217351:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157100 with x1873929633420416 ext(41299968->41316351) 00002000:00010000:3.0:1787119494.217355:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157100 00000100:00100000:3.0:1787119494.217372:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10024 00000100:00100000:3.0:1787119494.217379:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633420544:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.217507:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633420544:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 128us (797us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.217515:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10024 00002000:00100000:3.0:1787119494.217521:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (25223168->25227263) req@ffff92a606157b80 x1873929633420544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.217528:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157b80 with x1873929633420544 ext(25223168->25227263) 00002000:00010000:3.0:1787119494.217531:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157b80 00000100:00100000:2.0:1787119494.218240:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633420288 00000100:00100000:2.0:1787119494.218250:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633420288 00000100:00100000:2.0:1787119494.218298:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19620 00000100:00100000:2.0:1787119494.218307:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+103:32728:x1873929633420288:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119494.218360:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119494.218390:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e2fb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c7a expref: 103 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.218409:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119494.218414:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119494.218881:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.218897:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.218906:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119494.218959:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976434 00000004:00010000:2.0:1787119494.218987:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038130092 reply state 000000005a999b8c transno 4294976435 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119494.218994:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119494.219078:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+105:32728:x1873929633420288:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 771us (2458us total) trans 4294976435 rc 0/0 00000100:00100000:2.0:1787119494.219085:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19620 00000020:00080000:2.0:1787119494.219089:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119494.231753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.231796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.231859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.231948:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633420672 00000100:00100000:2.0:1787119494.231958:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633420672 00002000:00100000:2.0:1787119494.232023:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (39383040->39387135) req@ffff92a50986e300 x1873929633420672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.232035:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986e300 with x1873929633420672 ext(39383040->39387135) 00002000:00010000:2.0:1787119494.232041:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986e300 00000100:00100000:2.0:1787119494.232072:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633420800 00000100:00100000:2.0:1787119494.232075:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633420800 00002000:00100000:2.0:1787119494.232090:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (7634944->7639039) req@ffff92a50986ce00 x1873929633420800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.232097:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ce00 with x1873929633420800 ext(7634944->7639039) 00002000:00010000:2.0:1787119494.232101:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986ce00 00000100:00100000:2.0:1787119494.232116:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633420928 00000100:00100000:2.0:1787119494.232119:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633420928 00002000:00010000:2.0:1787119494.232134:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (53296850->18446744073709551615) 00002000:00100000:2.0:1787119494.232137:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ea00 with x1873929633420928 ext(53296850->18446744073709551615) 00002000:00010000:2.0:1787119494.232149:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ea00. 00000100:00100000:2.0:1787119494.232166:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10025 00000100:00100000:2.0:1787119494.232176:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633420672:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.232468:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633420672:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 265us (697us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.232477:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10025 00002000:00100000:2.0:1787119494.232493:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (39383040->39387135) req@ffff92a50986e300 x1873929633420672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.232500:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986e300 with x1873929633420672 ext(39383040->39387135) 00002000:00010000:2.0:1787119494.232504:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986e300 00000100:00100000:2.0:1787119494.232522:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10026 00000100:00100000:2.0:1787119494.232528:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633420800:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.232632:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633420800:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 103us (834us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.232639:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10026 00002000:00100000:2.0:1787119494.232645:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (7634944->7639039) req@ffff92a50986ce00 x1873929633420800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.232654:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ce00 with x1873929633420800 ext(7634944->7639039) 00002000:00010000:2.0:1787119494.232657:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986ce00 00000100:00100000:2.0:1787119494.232671:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10027 00000100:00100000:2.0:1787119494.232679:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633420928:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119494.232865:0:19245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 48114906 -> 53296850 00002000:00010000:2.0:1787119494.232869:0:19245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119494.232871:0:19245:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119494.232873:0:19245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119494.232875:0:19245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119494.232909:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633420928:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 230us (1049us total) trans 4294969129 rc 0/0 00000100:00100000:2.0:1787119494.232916:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10027 00002000:00010000:2.0:1787119494.232919:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (53296850->18446744073709551615) 00002000:00100000:2.0:1787119494.232922:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ea00 with x1873929633420928 ext(53296850->18446744073709551615) 00002000:00010000:2.0:1787119494.232927:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ea00. 00010000:00010000:1.0:1787119494.233309:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.233320:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.233328:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.233335:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119494.233340:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.233356:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.233371:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119494.233374:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119494.233378:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.233384:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3038 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.234913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.234953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.235086:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633421056 00000100:00100000:0.0:1787119494.235097:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633421056 00002000:00100000:0.0:1787119494.235141:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (25198592->25264127) req@ffff92a50986fb80 x1873929633421056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.235152:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986fb80 with x1873929633421056 ext(25198592->25264127) 00002000:00010000:0.0:1787119494.235158:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986fb80 00000100:00100000:0.0:1787119494.235198:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10028 00000100:00100000:0.0:1787119494.235207:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633421056:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.235674:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633421312 00000100:00100000:2.0:1787119494.235679:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633421312 00000100:00100000:2.0:1787119494.235730:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19621 00000100:00100000:2.0:1787119494.235739:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+104:32727:x1873929633421312:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119494.235787:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119494.235815:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e2ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c8f expref: 104 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.235832:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119494.235837:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119494.236046:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.236061:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.236071:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119494.236126:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976436 00000004:00010000:2.0:1787119494.236150:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fcddaf7 reply state 000000008d0b1ed9 transno 4294976437 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119494.236160:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119494.236231:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+106:32727:x1873929633421312:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 494us (1327us total) trans 4294976437 rc 0/0 00000100:00100000:2.0:1787119494.236238:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19621 00000020:00080000:2.0:1787119494.236242:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119494.240696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.240887:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633421440 00000100:00100000:0.0:1787119494.240897:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633421440 00000100:00100000:0.0:1787119494.240958:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19622 00000100:00100000:0.0:1787119494.240967:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+106:32728:x1873929633421440:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119494.240999:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119494.241021:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e3046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cab expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.241100:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e304d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.241114:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e304d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.241125:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e304d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119494.241150:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 53296850 00000004:00200000:0.0:1787119494.241155:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119494.241173:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e304d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.241199:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e3046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cab expref: 108 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.241216:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e304d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cab expref: 107 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.241225:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119494.241227:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119494.241230:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fae00, rc 0) 00000100:00100000:0.0:1787119494.241292:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+107:32728:x1873929633421440:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 326us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.241303:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19622 00000100:00100000:2.0:1787119494.245564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.245817:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633421568 00000100:00100000:1.0:1787119494.245828:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633421568 00002000:00100000:1.0:1787119494.245878:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (39387136->39391231) req@ffff92a62a998000 x1873929633421568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.245890:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a998000 with x1873929633421568 ext(39387136->39391231) 00002000:00010000:1.0:1787119494.245895:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a998000 00000100:00100000:1.0:1787119494.245928:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10029 00000100:00100000:1.0:1787119494.245938:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633421568:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.246199:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633421568:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 262us (645us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.246207:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10029 00002000:00100000:1.0:1787119494.246214:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (39387136->39391231) req@ffff92a62a998000 x1873929633421568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.246222:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a998000 with x1873929633421568 ext(39387136->39391231) 00002000:00010000:1.0:1787119494.246226:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a998000 00000100:00100000:2.0:1787119494.254366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.254535:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633421696 00000100:00100000:1.0:1787119494.254548:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633421696 00002000:00100000:1.0:1787119494.254614:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (7610368->7675903) req@ffff92a62a999500 x1873929633421696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.254624:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999500 with x1873929633421696 ext(7610368->7675903) 00002000:00010000:1.0:1787119494.254630:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a999500 00000100:00100000:1.0:1787119494.254653:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10030 00000100:00100000:1.0:1787119494.254662:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633421696:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119494.256014:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.256033:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.256041:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.256049:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119494.256053:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.256061:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.256076:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119494.256081:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119494.256085:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.256090:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e303f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119494.260962:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633421056:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 25741us (25994us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119494.260977:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10028 00002000:00100000:0.0:1787119494.260990:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (25198592->25264127) req@ffff92a50986fb80 x1873929633421056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.261001:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986fb80 with x1873929633421056 ext(25198592->25264127) 00002000:00010000:0.0:1787119494.261008:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986fb80 00000100:00100000:2.0:1787119494.269997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.270065:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.270095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.270176:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633421824 00000100:00100000:1.0:1787119494.270187:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633421824 00002000:00100000:1.0:1787119494.270234:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (39362560->39428095) req@ffff92a62a999f80 x1873929633421824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.270245:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999f80 with x1873929633421824 ext(39362560->39428095) 00002000:00010000:1.0:1787119494.270251:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a999f80 00000100:00100000:1.0:1787119494.270279:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633421952 00000100:00100000:1.0:1787119494.270283:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633421952 00002000:00010000:1.0:1787119494.270297:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (53296850->18446744073709551615) 00002000:00100000:1.0:1787119494.270300:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99b100 with x1873929633421952 ext(53296850->18446744073709551615) 00002000:00010000:1.0:1787119494.270311:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99b100. 00000100:00100000:1.0:1787119494.270326:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633422080 00000100:00100000:1.0:1787119494.270329:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633422080 00002000:00100000:1.0:1787119494.270343:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (25264128->25300991) req@ffff92a62a99a300 x1873929633422080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.270360:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99a300 with x1873929633422080 ext(25264128->25300991) 00002000:00010000:1.0:1787119494.270364:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99a300 00000100:00100000:1.0:1787119494.270382:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10031 00000100:00100000:1.0:1787119494.270391:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633421824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.270879:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10032 00000100:00100000:1.0:1787119494.270889:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2374:x1873929633421952:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.271084:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 48114906 -> 53296850 00002000:00010000:1.0:1787119494.271087:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.271090:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119494.271092:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.271095:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119494.271132:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2374:x1873929633421952:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 244us (1065us total) trans 4294969130 rc 0/0 00000100:00100000:1.0:1787119494.271139:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10032 00002000:00010000:1.0:1787119494.271143:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (53296850->18446744073709551615) 00002000:00100000:1.0:1787119494.271146:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99b100 with x1873929633421952 ext(53296850->18446744073709551615) 00002000:00010000:1.0:1787119494.271150:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99b100. 00000100:00100000:1.0:1787119494.271169:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10033 00000100:00100000:1.0:1787119494.271176:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2374:x1873929633422080:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.272330:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633421696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17662us (17977us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119494.272342:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10030 00002000:00100000:1.0:1787119494.272360:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (7610368->7675903) req@ffff92a62a999500 x1873929633421696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.272369:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999500 with x1873929633421696 ext(7610368->7675903) 00002000:00010000:1.0:1787119494.272375:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a999500 00000100:00100000:2.0:1787119494.277659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.277856:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633422336 00000100:00100000:3.0:1787119494.277866:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633422336 00000100:00100000:3.0:1787119494.277926:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19623 00000100:00100000:3.0:1787119494.277936:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+106:32728:x1873929633422336:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119494.278005:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119494.278037:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e304d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cab expref: 106 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.278058:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119494.278063:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119494.278272:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.278286:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.278295:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119494.278352:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976438 00000004:00010000:3.0:1787119494.278377:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1c5221c reply state 000000006b898e8a transno 4294976439 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.278387:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119494.278539:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+108:32728:x1873929633422336:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 603us (887us total) trans 4294976439 rc 0/0 00000100:00100000:3.0:1787119494.278546:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19623 00000020:00080000:3.0:1787119494.278551:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119494.285579:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2374:x1873929633422080:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14395us (15474us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119494.285604:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10033 00002000:00100000:3.0:1787119494.285618:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (25264128->25300991) req@ffff92a62a99a300 x1873929633422080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.285628:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99a300 with x1873929633422080 ext(25264128->25300991) 00002000:00010000:3.0:1787119494.285634:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99a300 00000100:00100000:1.0:1787119494.286163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.286232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.286259:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633422592 00000100:00100000:1.0:1787119494.286268:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633422592 00002000:00010000:1.0:1787119494.286306:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (25736352->18446744073709551615) 00002000:00100000:1.0:1787119494.286311:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633422592 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119494.286324:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d500. 00000100:00100000:3.0:1787119494.286426:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633422464 00000100:00100000:3.0:1787119494.286431:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633422464 00000100:00100000:3.0:1787119494.286495:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19624 00000100:00100000:3.0:1787119494.286504:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+108:32727:x1873929633422464:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119494.286523:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119494.286547:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e305b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cb2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.286640:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3062 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.286655:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.286665:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119494.286702:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 53296850 00000004:00200000:3.0:1787119494.286707:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119494.286724:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.286750:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e305b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cb2 expref: 110 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.286769:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cb2 expref: 109 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.286778:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119494.286780:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119494.286784:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119494.286823:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+109:32727:x1873929633422464:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 320us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119494.286829:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19624 00000100:00100000:1.0:1787119494.286987:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10034 00000100:00100000:1.0:1787119494.286995:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633422592:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.287241:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 53296850 -> 25736352 00002000:00010000:1.0:1787119494.287246:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.287248:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119494.287250:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.287252:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119494.287275:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633422592:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 281us (1041us total) trans 4294969131 rc 0/0 00000100:00100000:1.0:1787119494.287281:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10034 00002000:00010000:1.0:1787119494.287284:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (25736352->18446744073709551615) 00002000:00100000:1.0:1787119494.287287:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633422592 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119494.287292:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d500. 00010000:00010000:0.0:1787119494.287394:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.287403:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.287409:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.287415:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119494.287418:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.287425:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.287435:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119494.287469:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119494.287473:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.287492:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3054 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119494.287779:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633421824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17388us (17791us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119494.287787:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10031 00002000:00100000:2.0:1787119494.287795:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (39362560->39428095) req@ffff92a62a999f80 x1873929633421824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.287803:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999f80 with x1873929633421824 ext(39362560->39428095) 00002000:00010000:2.0:1787119494.287807:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a999f80 00000100:00100000:0.0:1787119494.295563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.296028:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633422720 00000100:00100000:3.0:1787119494.296039:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633422720 00002000:00100000:3.0:1787119494.296091:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (2277376->2281471) req@ffff92a606155c00 x1873929633422720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.296113:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155c00 with x1873929633422720 ext(2277376->2281471) 00002000:00010000:3.0:1787119494.296119:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155c00 00000100:00100000:3.0:1787119494.296143:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10035 00000100:00100000:3.0:1787119494.296152:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633422720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.296415:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633422720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 263us (864us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.296423:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10035 00002000:00100000:3.0:1787119494.296430:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (2277376->2281471) req@ffff92a606155c00 x1873929633422720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.296457:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155c00 with x1873929633422720 ext(2277376->2281471) 00002000:00010000:3.0:1787119494.296461:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155c00 00000100:00100000:2.0:1787119494.310662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.310701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.310710:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633422848 00000100:00100000:2.0:1787119494.310721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.310721:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633422848 00000100:00100000:2.0:1787119494.310738:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633422976 00000100:00100000:2.0:1787119494.310742:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633422976 00000100:00100000:0.0:1787119494.310775:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19625 00000100:00100000:0.0:1787119494.310784:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+108:32728:x1873929633422848:12345-192.168.201.59@tcp:101:fsx.0 00002000:00100000:2.0:1787119494.310790:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (39428096->39440383) req@ffff92a62a999880 x1873929633422976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.310800:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999880 with x1873929633422976 ext(39428096->39440383) 00010000:00010000:0.0:1787119494.310804:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1787119494.310814:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a999880 00010000:00010000:0.0:1787119494.310824:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e3069 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cb9 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119494.310829:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633423104 00000100:00100000:2.0:1787119494.310832:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633423104 00002000:00100000:2.0:1787119494.310847:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (41299968->41316351) req@ffff92a62a99bb80 x1873929633423104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.310854:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99bb80 with x1873929633423104 ext(41299968->41316351) 00002000:00010000:2.0:1787119494.310857:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99bb80 00000100:00100000:2.0:1787119494.310890:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10036 00000100:00100000:2.0:1787119494.310898:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633422976:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:0.0:1787119494.310906:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e3070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.310920:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e3070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.310930:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e3070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119494.310954:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 25736352 00000004:00200000:0.0:1787119494.310958:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119494.310991:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e3070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.311019:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e3069 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cb9 expref: 110 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.311043:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e3070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cb9 expref: 109 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.311051:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119494.311054:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119494.311058:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa200, rc 0) 00000100:00100000:0.0:1787119494.311113:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+109:32728:x1873929633422848:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 329us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119494.311117:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633422976:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 221us (416us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1787119494.311120:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19625 00000100:00100000:2.0:1787119494.311124:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10036 00002000:00100000:2.0:1787119494.311129:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (39428096->39440383) req@ffff92a62a999880 x1873929633422976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/12728 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.311137:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999880 with x1873929633422976 ext(39428096->39440383) 00002000:00010000:2.0:1787119494.311140:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a999880 00000100:00100000:2.0:1787119494.311152:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10037 00000100:00100000:2.0:1787119494.311158:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2376:x1873929633423104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.311161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.311282:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2376:x1873929633423104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 123us (558us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787119494.311289:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10037 00002000:00100000:2.0:1787119494.311294:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (41299968->41316351) req@ffff92a62a99bb80 x1873929633423104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/16824 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.311301:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99bb80 with x1873929633423104 ext(41299968->41316351) 00002000:00010000:2.0:1787119494.311304:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99bb80 00000100:00100000:2.0:1787119494.311314:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633423232 00000100:00100000:2.0:1787119494.311317:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633423232 00002000:00100000:2.0:1787119494.311330:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (2281472->2285567) req@ffff92a606157480 x1873929633423232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.311338:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157480 with x1873929633423232 ext(2281472->2285567) 00002000:00010000:2.0:1787119494.311341:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606157480 00000100:00100000:2.0:1787119494.311357:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10038 00000100:00100000:2.0:1787119494.311364:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633423232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.311494:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633423232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 129us (331us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.311500:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10038 00002000:00100000:2.0:1787119494.311507:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (2281472->2285567) req@ffff92a606157480 x1873929633423232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.311514:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157480 with x1873929633423232 ext(2281472->2285567) 00002000:00010000:2.0:1787119494.311518:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606157480 00000100:00100000:0.0:1787119494.316364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.316543:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633423488 00000100:00100000:3.0:1787119494.316554:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633423488 00000100:00100000:3.0:1787119494.316620:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19626 00000100:00100000:3.0:1787119494.316631:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+109:32727:x1873929633423488:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119494.316829:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119494.316859:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3062 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cb2 expref: 109 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.316878:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119494.316883:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119494.317101:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.317115:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.317124:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119494.317174:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976440 00000004:00010000:3.0:1787119494.317199:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f7d64b0 reply state 00000000e6debed3 transno 4294976441 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.317207:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119494.317337:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+111:32727:x1873929633423488:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 707us (990us total) trans 4294976441 rc 0/0 00000100:00100000:3.0:1787119494.317346:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19626 00000020:00080000:3.0:1787119494.317409:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119494.322121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.322204:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633423744 00000100:00100000:3.0:1787119494.322214:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633423744 00000100:00100000:3.0:1787119494.322284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19627 00000100:00100000:3.0:1787119494.322293:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+111:32728:x1873929633423744:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119494.322361:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119494.322387:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e3070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cb9 expref: 111 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.322406:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119494.322411:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119494.322650:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.322663:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.322684:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119494.322732:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976442 00000004:00010000:3.0:1787119494.322756:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096f83339 reply state 00000000d61d8a29 transno 4294976443 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.322765:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119494.322861:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+113:32728:x1873929633423744:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 568us (749us total) trans 4294976443 rc 0/0 00000100:00100000:3.0:1787119494.322869:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19627 00000020:00080000:3.0:1787119494.322874:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787119494.328218:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.328237:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.328245:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.328251:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119494.328258:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.328265:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.328283:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119494.328286:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119494.328291:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.328298:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e307e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.329648:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.329663:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.329670:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.329675:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119494.329679:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.329685:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.329700:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119494.329702:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119494.329707:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.329712:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3077 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119494.331360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.331399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.331428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.331542:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633423872 00000100:00100000:0.0:1787119494.331552:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633423872 00000100:00100000:1.0:1787119494.331557:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633424000 00000100:00100000:1.0:1787119494.331565:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633424000 00002000:00010000:0.0:1787119494.331593:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (25736352->18446744073709551615) 00002000:00100000:0.0:1787119494.331599:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99ad80 with x1873929633423872 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119494.331600:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (15491427->18446744073709551615) 00002000:00100000:1.0:1787119494.331607:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99b800 with x1873929633424000 ext(15491427->18446744073709551615) 00002000:00010000:0.0:1787119494.331614:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99ad80. 00002000:00010000:1.0:1787119494.331615:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99b800. 00000100:00100000:0.0:1787119494.331655:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633424128 00000100:00100000:0.0:1787119494.331659:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633424128 00002000:00100000:0.0:1787119494.331735:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (2256896->2322431) req@ffff92a62a99b480 x1873929633424128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.331745:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99b480 with x1873929633424128 ext(2256896->2322431) 00002000:00010000:0.0:1787119494.331750:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a99b480 00000100:00100000:1.0:1787119494.332970:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10039 00000100:00100000:1.0:1787119494.332991:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2376:x1873929633423872:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:2.0:1787119494.336349:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10040 00000100:00100000:2.0:1787119494.336370:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633424000:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119494.336654:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 25736352 -> 15491427 00002000:00010000:2.0:1787119494.336658:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119494.336660:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119494.336663:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119494.336665:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00002000:00010000:1.0:1787119494.336703:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 53296850 -> 25736352 00002000:00010000:1.0:1787119494.336709:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.336712:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119494.336714:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119494.336717:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119494.336756:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633424000:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 388us (5350us total) trans 4294969133 rc 0/0 00000100:00100000:1.0:1787119494.336756:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633423872:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 3769us (5411us total) trans 4294969132 rc 0/0 00000100:00100000:3.0:1787119494.337065:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10041 00000100:00100000:2.0:1787119494.337080:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10040 00000100:00100000:3.0:1787119494.337086:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633424128:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:2.0:1787119494.337089:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (15491427->18446744073709551615) 00002000:00100000:2.0:1787119494.337095:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99b800 with x1873929633424000 ext(15491427->18446744073709551615) 00002000:00010000:2.0:1787119494.337104:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99b800. 00000100:00100000:2.0:1787119494.337252:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.337280:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633424256 00000100:00100000:2.0:1787119494.337287:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633424256 00002000:00100000:2.0:1787119494.337322:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (39383040->39439059) req@ffff92a62a998a80 x1873929633424256/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.337331:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a998a80 with x1873929633424256 ext(39383040->39439059) 00002000:00010000:2.0:1787119494.337336:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a998a80 00000100:00100000:2.0:1787119494.337360:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10042 00000100:00100000:3.0:1787119494.337368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.337371:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633424256:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119494.342830:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633424128:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5738us (11388us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119494.342848:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10041 00002000:00100000:3.0:1787119494.342861:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (2256896->2322431) req@ffff92a62a99b480 x1873929633424128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.342873:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99b480 with x1873929633424128 ext(2256896->2322431) 00002000:00010000:3.0:1787119494.342880:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a99b480 00000100:00100000:2.0:1787119494.342889:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633424256:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 5519us (5635us total) trans 4294968883 rc 0/0 00000100:00100000:2.0:1787119494.342899:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10042 00002000:00100000:2.0:1787119494.342907:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (39383040->39439059) req@ffff92a62a998a80 x1873929633424256/t4294968883(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.342915:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a998a80 with x1873929633424256 ext(39383040->39439059) 00002000:00010000:2.0:1787119494.342919:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a998a80 00000100:00100000:2.0:1787119494.344114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.344114:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10039 00002000:00010000:1.0:1787119494.344125:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (25736352->18446744073709551615) 00002000:00100000:1.0:1787119494.344130:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99ad80 with x1873929633423872 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119494.344146:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99ad80. 00000100:00100000:2.0:1787119494.344149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.344211:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633424512 00000100:00100000:1.0:1787119494.344221:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633424512 00000100:00100000:1.0:1787119494.344270:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633424640 00000100:00100000:1.0:1787119494.344273:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633424640 00000100:00100000:1.0:1787119494.344293:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633424768 00000100:00100000:1.0:1787119494.344297:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633424768 00000100:00100000:2.0:1787119494.344315:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19628 00000100:00100000:1.0:1787119494.344324:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19629 00000100:00100000:2.0:1787119494.344330:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+113:32729:x1873929633424512:12345-192.168.201.59@tcp:36:fsx.0 00000100:00100000:1.0:1787119494.344337:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+113:32727:x1873929633424640:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119494.344401:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119494.344427:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ca4 expref: 113 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.344465:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119494.344471:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119494.344500:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19630 00000100:00100000:3.0:1787119494.344509:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+112:32728:x1873929633424768:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119494.344519:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119494.344535:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cc7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.344611:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e308c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.344624:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e308c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.344635:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e308c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119494.344661:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 15491427 00010000:00010000:2.0:1787119494.344664:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119494.344666:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119494.344684:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e308c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.344687:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.344699:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.344714:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cc7 expref: 115 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.344730:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e308c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cc7 expref: 114 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.344744:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119494.344748:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000001:00080000:2.0:1787119494.344750:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976444 00010000:00010000:3.0:1787119494.344751:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000004:00010000:2.0:1787119494.344779:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023d12c0b reply state 00000000303ac8c5 transno 4294976445 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119494.344789:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119494.344802:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+115:32728:x1873929633424768:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 294us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119494.344808:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19630 00000100:00100000:2.0:1787119494.344864:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+115:32729:x1873929633424512:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 539us (7498us total) trans 4294976445 rc 0/0 00000100:00100000:2.0:1787119494.344872:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19628 00000020:00080000:2.0:1787119494.344876:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787119494.345344:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119494.345359:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e309a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cc0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.345406:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.345416:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.345424:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119494.345461:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 25736352 00000004:00200000:1.0:1787119494.345464:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119494.345475:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.345505:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e309a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cc0 expref: 116 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.345518:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cc0 expref: 115 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.345525:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119494.345527:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119494.345531:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119494.345572:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+115:32727:x1873929633424640:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1240us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.345578:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19629 00000100:00100000:2.0:1787119494.356723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.356775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119494.356901:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.356916:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.356924:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.356931:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119494.356937:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.356946:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.356966:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119494.356969:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119494.356974:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.356979:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3093 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119494.357280:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633424896 00000100:00100000:0.0:1787119494.357290:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633424896 00000100:00100000:0.0:1787119494.357348:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5041 00000100:00100000:0.0:1787119494.357357:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633424896:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119494.357638:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633425024 00000100:00100000:1.0:1787119494.357643:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633425024 00002000:00100000:1.0:1787119494.357676:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (2277376->2318335) req@ffff92a50655e300 x1873929633425024/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.357687:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655e300 with x1873929633425024 ext(2277376->2318335) 00002000:00010000:1.0:1787119494.357693:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655e300 00000100:00100000:1.0:1787119494.357726:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10043 00000100:00100000:1.0:1787119494.357735:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633425024:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119494.361842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.361917:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633425152 00000100:00100000:1.0:1787119494.361927:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633425152 00002000:00010000:1.0:1787119494.361969:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (53296850->18446744073709551615) 00002000:00100000:1.0:1787119494.361975:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a939f80 with x1873929633425152 ext(53296850->18446744073709551615) 00002000:00010000:1.0:1787119494.361988:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a939f80. 00000100:00100000:3.0:1787119494.364896:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633425024:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 7149us (8107us total) trans 4294968884 rc 0/0 00000100:00100000:3.0:1787119494.364912:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10043 00002000:00100000:3.0:1787119494.364925:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (2277376->2318335) req@ffff92a50655e300 x1873929633425024/t4294968884(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.364935:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655e300 with x1873929633425024 ext(2277376->2318335) 00002000:00010000:3.0:1787119494.364942:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655e300 00000100:00100000:3.0:1787119494.364987:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10044 00000100:00100000:3.0:1787119494.365000:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633425152:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119494.365145:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 48114906 -> 53296850 00002000:00010000:3.0:1787119494.365150:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119494.365152:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:3.0:1787119494.365154:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119494.365156:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:3.0:1787119494.365180:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633425152:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 184us (3350us total) trans 4294969134 rc 0/0 00000100:00100000:3.0:1787119494.365187:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10044 00002000:00010000:3.0:1787119494.365191:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (53296850->18446744073709551615) 00002000:00100000:3.0:1787119494.365194:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a939f80 with x1873929633425152 ext(53296850->18446744073709551615) 00002000:00010000:3.0:1787119494.365202:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a939f80. 00000100:00100000:3.0:1787119494.378938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.378971:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633425408 00000100:00100000:3.0:1787119494.378982:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633425408 00000100:00100000:3.0:1787119494.379034:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19631 00000100:00100000:3.0:1787119494.379044:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+114:32727:x1873929633425408:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119494.379102:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119494.379132:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cc0 expref: 114 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.379154:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119494.379160:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119494.379702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.379731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119494.380650:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119494.382104:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633425536 00000100:00100000:0.0:1787119494.382120:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633425536 00000100:00100000:0.0:1787119494.382166:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633425792 00000100:00100000:0.0:1787119494.382169:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633425792 00000100:00100000:0.0:1787119494.382191:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19632 00000100:00100000:0.0:1787119494.382198:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+116:32729:x1873929633425536:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119494.382216:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119494.382233:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fbe00/0xcaba3de8463e30af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cce expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.382303:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e30b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.382316:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e30b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.382326:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e30b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.383071:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.383081:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119494.383183:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976446 00000004:00010000:3.0:1787119494.383230:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000812d4ffd reply state 00000000397decbc transno 4294976447 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.383241:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787119494.383458:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 53296850 00000004:00200000:0.0:1787119494.383464:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119494.383490:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e30b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.383519:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fbe00/0xcaba3de8463e30af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cce expref: 120 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.383538:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e30b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cce expref: 119 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.383546:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119494.383549:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119494.383553:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb800, rc 0) 00000100:00100000:3.0:1787119494.383950:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+119:32727:x1873929633425408:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 4906us (5022us total) trans 4294976447 rc 0/0 00000100:00100000:3.0:1787119494.383958:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19631 00000020:00080000:3.0:1787119494.383964:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119494.383990:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19633 00000100:00100000:3.0:1787119494.384000:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+118:32728:x1873929633425792:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119494.384045:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119494.384063:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e308c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cc7 expref: 118 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.384076:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119494.384080:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119494.384217:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.384227:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.384235:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119494.384274:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976448 00000004:00010000:3.0:1787119494.384296:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014bd56d7 reply state 000000002f15d841 transno 4294976449 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.384303:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119494.386068:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+120:32729:x1873929633425536:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 3858us (6357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.386081:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19632 00000100:00100000:3.0:1787119494.386878:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+119:32728:x1873929633425792:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2872us (7137us total) trans 4294976449 rc 0/0 00000100:00100000:3.0:1787119494.386890:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19633 00000020:00080000:3.0:1787119494.386895:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119494.386983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.393392:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633425920 00000100:00100000:0.0:1787119494.393409:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633425920 00000100:00100000:0.0:1787119494.393503:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5042 00000100:00100000:0.0:1787119494.393514:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633425920:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119494.393629:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633425920:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 117us (6646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.393637:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5042 00000100:00100000:0.0:1787119494.393835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.393859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119494.393881:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.393892:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.393899:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.393906:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6069f4a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119494.393910:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.393918:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.393934:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119494.393937:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119494.393941:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.393947:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e30a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.394362:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.394372:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.394383:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.394388:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6069f5a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119494.394391:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.394398:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.394408:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119494.394411:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119494.394414:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.394420:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119494.394809:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633426048 00000100:00100000:2.0:1787119494.394816:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633426048 00002000:00010000:2.0:1787119494.394844:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (34212788->18446744073709551615) 00002000:00100000:2.0:1787119494.394849:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2300 with x1873929633426048 ext(34212788->18446744073709551615) 00002000:00010000:2.0:1787119494.394858:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a2300. 00000100:00100000:2.0:1787119494.394886:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633426176 00000100:00100000:2.0:1787119494.394889:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633426176 00002000:00010000:2.0:1787119494.394900:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (15491427->18446744073709551615) 00002000:00100000:2.0:1787119494.394902:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0380 with x1873929633426176 ext(15491427->18446744073709551615) 00002000:00010000:2.0:1787119494.394908:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0380. 00000100:00100000:2.0:1787119494.394964:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10045 00000100:00100000:2.0:1787119494.394973:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2374:x1873929633426048:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119494.395209:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 15491427 -> 34212788 00002000:00010000:2.0:1787119494.395213:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119492 -> 1787119493 00002000:00010000:2.0:1787119494.395216:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119494.395218:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119492 -> 1787119493 00002000:00010000:2.0:1787119494.395221:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119494.395275:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2374:x1873929633426048:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 302us (1440us total) trans 4294969135 rc 0/0 00000100:00100000:2.0:1787119494.395284:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10045 00002000:00010000:2.0:1787119494.395287:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (34212788->18446744073709551615) 00002000:00100000:2.0:1787119494.395290:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2300 with x1873929633426048 ext(34212788->18446744073709551615) 00002000:00010000:2.0:1787119494.395295:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a2300. 00000100:00100000:2.0:1787119494.395312:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10046 00000100:00100000:2.0:1787119494.395319:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2376:x1873929633426176:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119494.395598:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 25736352 -> 15491427 00002000:00010000:2.0:1787119494.395602:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119492 -> 1787119493 00002000:00010000:2.0:1787119494.395605:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119494.395607:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119492 -> 1787119493 00002000:00010000:2.0:1787119494.395609:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:2.0:1787119494.395632:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633426176:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 313us (1772us total) trans 4294969136 rc 0/0 00000100:00100000:2.0:1787119494.395640:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10046 00002000:00010000:2.0:1787119494.395643:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (15491427->18446744073709551615) 00002000:00100000:2.0:1787119494.395646:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0380 with x1873929633426176 ext(15491427->18446744073709551615) 00002000:00010000:2.0:1787119494.395650:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0380. 00000100:00100000:2.0:1787119494.401814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.402612:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633426304 00000100:00100000:0.0:1787119494.402623:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633426304 00002000:00100000:0.0:1787119494.402791:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (29941760->29945855) req@ffff92a50655ce00 x1873929633426304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.402804:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ce00 with x1873929633426304 ext(29941760->29945855) 00002000:00010000:0.0:1787119494.402809:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ce00 00000100:00100000:0.0:1787119494.402837:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10047 00000100:00100000:0.0:1787119494.402846:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633426304:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.403074:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633426304:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 227us (1270us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119494.403081:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10047 00002000:00100000:0.0:1787119494.403088:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (29941760->29945855) req@ffff92a50655ce00 x1873929633426304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.403096:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ce00 with x1873929633426304 ext(29941760->29945855) 00002000:00010000:0.0:1787119494.403100:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ce00 00000100:00100000:3.0:1787119494.409028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.409514:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633426560 00000100:00100000:0.0:1787119494.409528:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633426560 00000100:00100000:0.0:1787119494.409585:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19634 00000100:00100000:0.0:1787119494.409595:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+117:32729:x1873929633426560:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119494.409663:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119494.409693:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e30b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cce expref: 117 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.409713:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119494.409717:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119494.409932:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.409945:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.409953:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119494.410002:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976450 00000004:00010000:0.0:1787119494.410025:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c00887d5 reply state 00000000febc596c transno 4294976451 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119494.410033:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119494.410115:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+119:32729:x1873929633426560:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 521us (1096us total) trans 4294976451 rc 0/0 00000100:00100000:0.0:1787119494.410122:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19634 00000020:00080000:0.0:1787119494.410127:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119494.414297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.414362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119494.414424:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.414435:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.414485:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.414493:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119494.414500:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.414506:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633426816 00010000:00010000:3.0:1787119494.414509:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.414517:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633426816 00010000:00010000:3.0:1787119494.414527:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119494.414532:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119494.414536:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.414542:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e30c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.414575:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19635 00000100:00100000:1.0:1787119494.414586:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+118:32727:x1873929633426816:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119494.414606:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119494.414635:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e30cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cd5 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.414723:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.414741:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.414752:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119494.414779:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 15491427 00000004:00200000:1.0:1787119494.414783:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119494.414805:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.414846:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e30cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cd5 expref: 120 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.414860:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cd5 expref: 119 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.414868:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119494.414871:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119494.414873:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119494.414932:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+119:32727:x1873929633426816:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 349us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.414941:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19635 00000100:00100000:0.0:1787119494.415174:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633426688 00000100:00100000:0.0:1787119494.415180:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633426688 00002000:00100000:0.0:1787119494.415210:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (34181120->34185215) req@ffff92a62a93aa00 x1873929633426688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.415221:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93aa00 with x1873929633426688 ext(34181120->34185215) 00002000:00010000:0.0:1787119494.415225:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a93aa00 00000100:00100000:0.0:1787119494.415252:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10048 00000100:00100000:0.0:1787119494.415260:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633426688:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.415542:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633426688:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 282us (1254us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119494.415550:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10048 00002000:00100000:0.0:1787119494.415556:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (34181120->34185215) req@ffff92a62a93aa00 x1873929633426688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.415564:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93aa00 with x1873929633426688 ext(34181120->34185215) 00002000:00010000:0.0:1787119494.415568:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a93aa00 00000100:00100000:1.0:1787119494.418776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.419013:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633426944 00000100:00100000:0.0:1787119494.419023:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633426944 00002000:00100000:0.0:1787119494.419070:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (29945856->29949951) req@ffff92a51282d880 x1873929633426944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.419082:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d880 with x1873929633426944 ext(29945856->29949951) 00002000:00010000:0.0:1787119494.419089:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282d880 00000100:00100000:0.0:1787119494.419120:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10049 00000100:00100000:0.0:1787119494.419130:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633426944:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.419376:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633426944:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 246us (764us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119494.419383:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10049 00002000:00100000:0.0:1787119494.419391:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (29945856->29949951) req@ffff92a51282d880 x1873929633426944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.419399:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d880 with x1873929633426944 ext(29945856->29949951) 00002000:00010000:0.0:1787119494.419402:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282d880 00000100:00100000:1.0:1787119494.423809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.423866:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633427072 00000100:00100000:1.0:1787119494.423875:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633427072 00002000:00010000:1.0:1787119494.423918:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (25736352->18446744073709551615) 00002000:00100000:1.0:1787119494.423923:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282fb80 with x1873929633427072 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119494.423936:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282fb80. 00000100:00100000:1.0:1787119494.423967:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10050 00000100:00100000:1.0:1787119494.423978:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633427072:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.424296:0:19245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 53296850 -> 25736352 00002000:00010000:1.0:1787119494.424300:0:19245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119493 00002000:00010000:1.0:1787119494.424303:0:19245:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119494.424305:0:19245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119493 00002000:00010000:1.0:1787119494.424307:0:19245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119494.424371:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2375:x1873929633427072:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 394us (571us total) trans 4294969137 rc 0/0 00000100:00100000:1.0:1787119494.424381:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10050 00002000:00010000:1.0:1787119494.424385:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (25736352->18446744073709551615) 00002000:00100000:1.0:1787119494.424388:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282fb80 with x1873929633427072 ext(25736352->18446744073709551615) 00002000:00010000:1.0:1787119494.424394:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282fb80. 00000100:00100000:1.0:1787119494.433495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.433761:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633427200 00000100:00100000:3.0:1787119494.433773:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633427200 00002000:00100000:3.0:1787119494.433832:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (29921280->29986815) req@ffff92a51282c380 x1873929633427200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.433843:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c380 with x1873929633427200 ext(29921280->29986815) 00002000:00010000:3.0:1787119494.433849:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282c380 00000100:00100000:3.0:1787119494.433876:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10051 00000100:00100000:3.0:1787119494.433886:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633427200:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.436186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.436227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.436334:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633427328 00000100:00100000:3.0:1787119494.436343:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633427328 00000100:00100000:2.0:1787119494.436365:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633427584 00000100:00100000:2.0:1787119494.436372:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633427584 00000100:00100000:3.0:1787119494.436398:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19636 00000100:00100000:3.0:1787119494.436408:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+120:32729:x1873929633427328:12345-192.168.201.59@tcp:101:fsx.0 00000100:00100000:2.0:1787119494.436416:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19637 00000100:00100000:2.0:1787119494.436426:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+120:32727:x1873929633427584:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119494.436428:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119494.436487:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4400/0xcaba3de8463e30d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cdc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.436507:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119494.436531:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e30d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cd5 expref: 121 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.436548:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119494.436553:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119494.436563:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.436576:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.436586:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119494.436671:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 25736352 00000004:00200000:3.0:1787119494.436676:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119494.436701:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.436729:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4400/0xcaba3de8463e30d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cdc expref: 122 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.436746:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cdc expref: 121 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.436746:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.436768:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119494.436769:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.436773:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119494.436778:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6069f5a00, rc 0) 00010000:00010000:2.0:1787119494.436783:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119494.436839:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976452 00000004:00010000:2.0:1787119494.436864:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1a11951 reply state 000000005511d4e6 transno 4294976453 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119494.436873:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119494.437017:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+123:32729:x1873929633427328:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 610us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119494.437025:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19636 00000100:00100000:2.0:1787119494.437037:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+123:32727:x1873929633427584:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 611us (807us total) trans 4294976453 rc 0/0 00000100:00100000:2.0:1787119494.437045:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19637 00000020:00080000:2.0:1787119494.437050:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1787119494.450896:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968882 is committed 00000001:00080000:1.0:1787119494.450913:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968883 is committed 00000001:00080000:1.0:1787119494.450921:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968884 is committed 00000100:00100000:0.0:1787119494.456751:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633424896:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 99382us (100024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.456767:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5041 00000100:00100000:1.0:1787119494.467951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.468025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.468045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.468089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.468129:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633427968 00000100:00100000:1.0:1787119494.468139:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633427968 00000100:00100000:1.0:1787119494.468187:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633428224 00000100:00100000:1.0:1787119494.468190:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633428224 00000100:00100000:1.0:1787119494.468215:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19638 00000100:00100000:1.0:1787119494.468225:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+123:32720:x1873929633427968:12345-192.168.201.59@tcp:101:fsx.0 00000100:00100000:3.0:1787119494.468247:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633427712 00010000:00010000:1.0:1787119494.468247:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787119494.468253:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633427712 00010000:00010000:1.0:1787119494.468271:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e30ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ce3 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1787119494.468288:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (34185216->34189311) req@ffff92a51282f480 x1873929633427712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.468299:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f480 with x1873929633427712 ext(34185216->34189311) 00002000:00010000:3.0:1787119494.468305:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282f480 00010000:00010000:0.0:1787119494.468370:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.468379:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.468387:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.468394:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119494.468398:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.468405:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.468420:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119494.468423:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119494.468427:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.468434:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e30e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.468614:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e30f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.468627:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e30f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.468637:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e30f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119494.468664:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 39439060 00000004:00200000:1.0:1787119494.468668:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119494.468687:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e30f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.468714:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e30ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ce3 expref: 124 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.468728:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e30f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ce3 expref: 123 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.468736:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119494.468739:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119494.468741:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119494.468804:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+123:32720:x1873929633427968:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 579us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.468812:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19638 00000100:00100000:1.0:1787119494.468842:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19639 00000100:00100000:1.0:1787119494.468851:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+122:32729:x1873929633428224:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119494.468881:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119494.468894:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e30e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cdc expref: 122 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.468904:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119494.468907:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119494.469082:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.469092:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.469099:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119494.469150:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976454 00000004:00010000:1.0:1787119494.469262:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001620f1eb reply state 00000000b83685d6 transno 4294976455 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.469272:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119494.469372:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+124:32729:x1873929633428224:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 522us (1282us total) trans 4294976455 rc 0/0 00000100:00100000:1.0:1787119494.469381:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19639 00000020:00080000:1.0:1787119494.469385:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119494.469938:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633427200:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 36049us (36462us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119494.469947:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10051 00002000:00100000:2.0:1787119494.469957:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (29921280->29986815) req@ffff92a51282c380 x1873929633427200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.469967:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c380 with x1873929633427200 ext(29921280->29986815) 00002000:00010000:2.0:1787119494.469973:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282c380 00000100:00100000:2.0:1787119494.469994:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633427840 00000100:00100000:2.0:1787119494.470000:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633427840 00002000:00010000:2.0:1787119494.470024:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (34212788->18446744073709551615) 00002000:00100000:2.0:1787119494.470028:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ca80 with x1873929633427840 ext(34212788->18446744073709551615) 00002000:00010000:2.0:1787119494.470037:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ca80. 00000100:00100000:1.0:1787119494.470068:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10052 00000100:00100000:1.0:1787119494.470076:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2376:x1873929633427712:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.470161:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10053 00000100:00100000:3.0:1787119494.470172:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2374:x1873929633427840:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:1.0:1787119494.470290:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2376:x1873929633427712:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 214us (2348us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.470297:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10052 00002000:00100000:1.0:1787119494.470304:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (34185216->34189311) req@ffff92a51282f480 x1873929633427712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.470313:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f480 with x1873929633427712 ext(34185216->34189311) 00002000:00010000:1.0:1787119494.470316:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282f480 00002000:00010000:3.0:1787119494.470473:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 15491427 -> 34212788 00002000:00010000:3.0:1787119494.470486:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119493 -> 1787119493 00002000:00010000:3.0:1787119494.470488:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:3.0:1787119494.470490:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119493 -> 1787119493 00002000:00010000:3.0:1787119494.470493:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:3.0:1787119494.470518:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2374:x1873929633427840:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 349us (2493us total) trans 4294969138 rc 0/0 00000100:00100000:3.0:1787119494.470526:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10053 00002000:00010000:3.0:1787119494.470529:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (34212788->18446744073709551615) 00002000:00100000:3.0:1787119494.470532:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ca80 with x1873929633427840 ext(34212788->18446744073709551615) 00002000:00010000:3.0:1787119494.470536:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ca80. 00010000:00010000:3.0:1787119494.478715:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.478734:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.478741:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.478747:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119494.478753:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.478761:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.478780:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119494.478783:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119494.478788:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.478794:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e30fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119494.481708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.481800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.489530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.489741:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633428352 00000100:00100000:3.0:1787119494.489742:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633428480 00000100:00100000:3.0:1787119494.489752:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633428480 00000100:00100000:1.0:1787119494.489752:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633428352 00002000:00100000:3.0:1787119494.489809:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (7630848->7634943) req@ffff92a5098a1880 x1873929633428480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.489823:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1880 with x1873929633428480 ext(7630848->7634943) 00000100:00100000:0.0:1787119494.489823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00010000:3.0:1787119494.489831:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a1880 00000100:00100000:0.0:1787119494.493850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.496242:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633428608 00000100:00100000:3.0:1787119494.496253:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633428864 00000100:00100000:2.0:1787119494.496258:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633428608 00000100:00100000:3.0:1787119494.496260:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633428864 00000100:00100000:0.0:1787119494.496516:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633428736 00000100:00100000:0.0:1787119494.496521:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633428736 00002000:00010000:1.0:1787119494.500110:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (15491427->18446744073709551615) 00002000:00100000:3.0:1787119494.500122:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (34181120->34185215) req@ffff92a5098a2a00 x1873929633428864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.500122:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0e00 with x1873929633428352 ext(15491427->18446744073709551615) 00002000:00100000:0.0:1787119494.500126:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (29986816->30023679) req@ffff92a5098a1500 x1873929633428736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00010000:1.0:1787119494.500136:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0e00. 00002000:00100000:3.0:1787119494.500153:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2a00 with x1873929633428864 ext(34181120->34185215) 00002000:00100000:0.0:1787119494.500153:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1500 with x1873929633428736 ext(29986816->30023679) 00002000:00010000:0.0:1787119494.500163:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a1500 00002000:00010000:3.0:1787119494.500164:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a2a00 00000100:00100000:1.0:1787119494.500178:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10054 00000100:00100000:0.0:1787119494.500185:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10055 00000100:00100000:1.0:1787119494.500199:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633428480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.500199:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2375:x1873929633428352:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:3.0:1787119494.500212:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10056 00000100:00100000:3.0:1787119494.500224:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633428736:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.500515:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10057 00000100:00100000:3.0:1787119494.500525:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633428864:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:0.0:1787119494.500533:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 25736352 -> 15491427 00002000:00010000:0.0:1787119494.500538:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119493 -> 1787119493 00002000:00010000:0.0:1787119494.500541:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:0.0:1787119494.500543:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119493 -> 1787119493 00002000:00010000:0.0:1787119494.500545:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:0.0:1787119494.500589:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633428352:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 395us (18890us total) trans 4294969139 rc 0/0 00000100:00100000:0.0:1787119494.500598:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10055 00002000:00010000:0.0:1787119494.500601:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (15491427->18446744073709551615) 00002000:00100000:0.0:1787119494.500614:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0e00 with x1873929633428352 ext(15491427->18446744073709551615) 00002000:00010000:0.0:1787119494.500620:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0e00. 00000100:00100000:3.0:1787119494.500659:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2375:x1873929633428864:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 135us (10837us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.500666:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10057 00002000:00100000:3.0:1787119494.500672:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (34181120->34185215) req@ffff92a5098a2a00 x1873929633428864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.500680:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2a00 with x1873929633428864 ext(34181120->34185215) 00002000:00010000:3.0:1787119494.500684:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a2a00 00002000:00100000:2.0:1787119494.500966:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (34160640->34213887) req@ffff92a5098a0000 x1873929633428608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.500976:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0000 with x1873929633428608 ext(34160640->34213887) 00002000:00010000:2.0:1787119494.500980:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0000 00000100:00100000:2.0:1787119494.501004:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10058 00000100:00100000:2.0:1787119494.501013:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2374:x1873929633428608:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.502292:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633428480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2097us (20483us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.502304:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10054 00002000:00100000:1.0:1787119494.502315:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (7630848->7634943) req@ffff92a5098a1880 x1873929633428480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.502332:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1880 with x1873929633428480 ext(7630848->7634943) 00002000:00010000:1.0:1787119494.502337:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a1880 00000100:00100000:3.0:1787119494.503949:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633428736:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3719us (10114us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119494.503960:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10056 00002000:00100000:3.0:1787119494.503970:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (29986816->30023679) req@ffff92a5098a1500 x1873929633428736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.503979:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1500 with x1873929633428736 ext(29986816->30023679) 00002000:00010000:3.0:1787119494.503985:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a1500 00000100:00100000:0.0:1787119494.505544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.505800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.505895:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633428992 00000100:00100000:1.0:1787119494.505904:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633428992 00002000:00100000:1.0:1787119494.505947:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (7634944->7639039) req@ffff92a5098a3800 x1873929633428992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.505959:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3800 with x1873929633428992 ext(7634944->7639039) 00002000:00010000:1.0:1787119494.505964:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a3800 00000100:00100000:1.0:1787119494.505991:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633429120 00000100:00100000:1.0:1787119494.505995:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633429120 00002000:00100000:1.0:1787119494.506010:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (34185216->34189311) req@ffff92a62a93bb80 x1873929633429120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.506019:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93bb80 with x1873929633429120 ext(34185216->34189311) 00000100:00100000:3.0:1787119494.506024:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10059 00002000:00010000:1.0:1787119494.506025:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a93bb80 00000100:00100000:1.0:1787119494.506046:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10060 00000100:00100000:1.0:1787119494.506053:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2373:x1873929633429120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.506105:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633428992:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.506287:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633428992:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 253us (748us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.506295:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10059 00002000:00100000:3.0:1787119494.506301:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (7634944->7639039) req@ffff92a5098a3800 x1873929633428992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.506309:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3800 with x1873929633428992 ext(7634944->7639039) 00002000:00010000:3.0:1787119494.506313:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a3800 00000100:00100000:1.0:1787119494.507884:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2373:x1873929633429120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1823us (2076us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.507898:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10060 00002000:00100000:1.0:1787119494.507909:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (34185216->34189311) req@ffff92a62a93bb80 x1873929633429120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.507920:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93bb80 with x1873929633429120 ext(34185216->34189311) 00002000:00010000:1.0:1787119494.507925:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a93bb80 00000100:00100000:2.0:1787119494.508794:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2374:x1873929633428608:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7776us (19268us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1787119494.508806:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10058 00002000:00100000:2.0:1787119494.508815:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (34160640->34213887) req@ffff92a5098a0000 x1873929633428608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.508836:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0000 with x1873929633428608 ext(34160640->34213887) 00002000:00010000:2.0:1787119494.508842:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0000 00000100:00100000:0.0:1787119494.527277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.527327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.527355:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633429376 00000100:00100000:0.0:1787119494.527365:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633429376 00002000:00100000:0.0:1787119494.527412:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (29941760->30011391) req@ffff92a5098a1f80 x1873929633429376/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.527423:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1f80 with x1873929633429376 ext(29941760->30011391) 00002000:00010000:0.0:1787119494.527429:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a1f80 00000100:00100000:0.0:1787119494.527470:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10061 00000100:00100000:0.0:1787119494.527491:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633429376:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119494.527778:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633429248 00000100:00100000:2.0:1787119494.527783:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633429248 00000100:00100000:2.0:1787119494.527840:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19640 00000100:00100000:2.0:1787119494.527849:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+123:32729:x1873929633429248:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119494.527863:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119494.527884:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3103 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cea expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.527962:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e310a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.527976:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.527988:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119494.528014:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 15491427 00000004:00200000:2.0:1787119494.528019:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119494.528036:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.528222:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3103 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cea expref: 125 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.528241:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e310a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cea expref: 124 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.528249:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119494.528252:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119494.528255:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92000, rc 0) 00000100:00100000:2.0:1787119494.528291:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+124:32729:x1873929633429248:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 443us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119494.528298:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19640 00000100:00100000:2.0:1787119494.528747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.528937:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633429504 00000100:00100000:0.0:1787119494.528943:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633429504 00002000:00100000:0.0:1787119494.528973:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (7610368->7675903) req@ffff92a50655ea00 x1873929633429504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.528983:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ea00 with x1873929633429504 ext(7610368->7675903) 00002000:00010000:0.0:1787119494.528987:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ea00 00000100:00100000:0.0:1787119494.529010:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10062 00000100:00100000:0.0:1787119494.529018:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633429504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.536960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.537056:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633429632 00000100:00100000:0.0:1787119494.537066:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633429632 00002000:00100000:0.0:1787119494.537108:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (34160640->34213887) req@ffff92a51282d180 x1873929633429632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.537119:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d180 with x1873929633429632 ext(34160640->34213887) 00002000:00010000:0.0:1787119494.537123:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282d180 00000100:00100000:0.0:1787119494.537150:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10063 00000100:00100000:0.0:1787119494.537158:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2374:x1873929633429632:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.543284:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633429504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14257us (14529us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119494.543297:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10062 00002000:00100000:3.0:1787119494.543308:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (7610368->7675903) req@ffff92a50655ea00 x1873929633429504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.543317:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ea00 with x1873929633429504 ext(7610368->7675903) 00002000:00010000:3.0:1787119494.543322:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ea00 00000100:00100000:2.0:1787119494.544880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.544921:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633429760 00000100:00100000:1.0:1787119494.544931:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633429760 00002000:00100000:1.0:1787119494.544976:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (34181120->34212787) req@ffff92a50655d880 x1873929633429760/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.544988:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d880 with x1873929633429760 ext(34181120->34212787) 00002000:00010000:1.0:1787119494.544993:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d880 00000100:00100000:1.0:1787119494.545030:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10064 00000100:00100000:1.0:1787119494.545040:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633429760:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119494.545668:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633429376:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 18187us (18337us total) trans 4294968885 rc 0/0 00000100:00100000:1.0:1787119494.545677:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10061 00002000:00100000:1.0:1787119494.545686:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (29941760->30011391) req@ffff92a5098a1f80 x1873929633429376/t4294968885(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.545695:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1f80 with x1873929633429376 ext(29941760->30011391) 00002000:00010000:1.0:1787119494.545699:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a1f80 00000100:00100000:2.0:1787119494.554066:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2374:x1873929633429632:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16892us (17097us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1787119494.554084:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10063 00002000:00100000:2.0:1787119494.554102:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (34160640->34213887) req@ffff92a51282d180 x1873929633429632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.554114:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d180 with x1873929633429632 ext(34160640->34213887) 00002000:00010000:2.0:1787119494.554122:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282d180 00000100:00100000:0.0:1787119494.556801:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.556848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.557196:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633429888 00000100:00100000:2.0:1787119494.557206:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633429888 00002000:00100000:2.0:1787119494.557250:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (2277376->2281471) req@ffff92a5098a3b80 x1873929633429888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.557262:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3b80 with x1873929633429888 ext(2277376->2281471) 00002000:00010000:2.0:1787119494.557267:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a3b80 00000100:00100000:2.0:1787119494.557294:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10065 00000100:00100000:2.0:1787119494.557304:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633429888:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.557581:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633429888:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 279us (732us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.557590:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10065 00002000:00100000:2.0:1787119494.557596:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (2277376->2281471) req@ffff92a5098a3b80 x1873929633429888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.557605:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3b80 with x1873929633429888 ext(2277376->2281471) 00002000:00010000:2.0:1787119494.557608:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a3b80 00000100:00100000:1.0:1787119494.558507:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633430144 00000100:00100000:1.0:1787119494.558515:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633430144 00000100:00100000:1.0:1787119494.558566:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19641 00000100:00100000:1.0:1787119494.558576:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+124:32729:x1873929633430144:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119494.558630:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119494.558661:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e310a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cea expref: 124 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.558682:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119494.558688:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119494.558896:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.558910:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.558921:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119494.558971:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976456 00000004:00010000:1.0:1787119494.558996:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000913f7e93 reply state 000000002269ad0d transno 4294976457 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.559006:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119494.559094:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+126:32729:x1873929633430144:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 518us (2304us total) trans 4294976457 rc 0/0 00000100:00100000:1.0:1787119494.559101:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19641 00000020:00080000:1.0:1787119494.559106:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119494.569983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.570070:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633430272 00000100:00100000:0.0:1787119494.570082:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633430272 00002000:00100000:0.0:1787119494.570139:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (34181120->34212787) req@ffff92a51282e680 x1873929633430272/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.570150:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e680 with x1873929633430272 ext(34181120->34212787) 00002000:00010000:0.0:1787119494.570156:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282e680 00000100:00100000:0.0:1787119494.570187:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10066 00000100:00100000:0.0:1787119494.570198:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2376:x1873929633430272:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119494.570640:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633429760:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 25599us (25769us total) trans 4294969140 rc 0/0 00000100:00100000:1.0:1787119494.570649:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10064 00002000:00100000:1.0:1787119494.570656:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (34181120->34212787) req@ffff92a50655d880 x1873929633429760/t4294969140(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.570666:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d880 with x1873929633429760 ext(34181120->34212787) 00002000:00010000:1.0:1787119494.570670:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d880 00000100:00100000:1.0:1787119494.570773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119494.570865:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.570876:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.570883:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.570890:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119494.570895:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.570902:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.570918:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119494.570920:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119494.570925:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.570930:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3111 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.570965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.571005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.571025:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633430528 00000100:00100000:1.0:1787119494.571029:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633430528 00002000:00010000:1.0:1787119494.571048:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (34212788->18446744073709551615) 00002000:00100000:1.0:1787119494.571052:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d500 with x1873929633430528 ext(34212788->18446744073709551615) 00002000:00010000:1.0:1787119494.571064:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282d500. 00000100:00100000:1.0:1787119494.571081:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633430656 00000100:00100000:1.0:1787119494.571084:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633430656 00002000:00100000:1.0:1787119494.571102:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (2281472->2285567) req@ffff92a51282df80 x1873929633430656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.571111:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282df80 with x1873929633430656 ext(2281472->2285567) 00002000:00010000:1.0:1787119494.571115:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282df80 00000100:00100000:1.0:1787119494.571129:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10067 00000100:00100000:1.0:1787119494.571136:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633430528:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.571266:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 15491427 -> 34212788 00002000:00010000:1.0:1787119494.571271:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119493 -> 1787119493 00002000:00010000:1.0:1787119494.571273:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119494.571276:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119493 -> 1787119493 00002000:00010000:1.0:1787119494.571278:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1933 00000100:00100000:1.0:1787119494.571304:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633430528:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 168us (338us total) trans 4294969141 rc 0/0 00000100:00100000:1.0:1787119494.571311:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10067 00002000:00010000:1.0:1787119494.571315:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (34212788->18446744073709551615) 00002000:00100000:1.0:1787119494.571318:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d500 with x1873929633430528 ext(34212788->18446744073709551615) 00002000:00010000:1.0:1787119494.571322:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282d500. 00000100:00100000:1.0:1787119494.571335:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10068 00000100:00100000:1.0:1787119494.571342:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633430656:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.571523:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633430656:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 181us (516us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.571530:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10068 00002000:00100000:1.0:1787119494.571536:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (2281472->2285567) req@ffff92a51282df80 x1873929633430656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.571550:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282df80 with x1873929633430656 ext(2281472->2285567) 00002000:00010000:1.0:1787119494.571553:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282df80 00000100:00100000:0.0:1787119494.575790:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633430400 00000100:00100000:0.0:1787119494.575805:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633430400 00000100:00100000:0.0:1787119494.575886:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5043 00000100:00100000:0.0:1787119494.575897:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633430400:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119494.577121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.577151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.577173:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633430912 00000100:00100000:1.0:1787119494.577180:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633430912 00000100:00100000:1.0:1787119494.577221:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5044 00000100:00100000:1.0:1787119494.577230:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2374:x1873929633430912:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119494.577511:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633430784 00000100:00100000:3.0:1787119494.577516:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633430784 00002000:00100000:3.0:1787119494.577542:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (34181120->34185215) req@ffff92a51282f100 x1873929633430784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.577553:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f100 with x1873929633430784 ext(34181120->34185215) 00002000:00010000:3.0:1787119494.577559:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282f100 00000100:00100000:3.0:1787119494.577586:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10069 00000100:00100000:3.0:1787119494.577594:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633430784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.577770:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633430784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 175us (655us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.577778:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10069 00002000:00100000:3.0:1787119494.577786:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (34181120->34185215) req@ffff92a51282f100 x1873929633430784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.577801:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f100 with x1873929633430784 ext(34181120->34185215) 00002000:00010000:3.0:1787119494.577804:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282f100 00000100:00100000:1.0:1787119494.577836:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633430272:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 7628us (7851us total) trans 4294969142 rc 0/0 00000100:00100000:1.0:1787119494.577846:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10066 00002000:00100000:1.0:1787119494.577853:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (34181120->34212787) req@ffff92a51282e680 x1873929633430272/t4294969142(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.577862:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e680 with x1873929633430272 ext(34181120->34212787) 00002000:00010000:1.0:1787119494.577867:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282e680 00000100:00100000:0.0:1787119494.581707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.581780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.581808:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633431168 00000100:00100000:0.0:1787119494.581815:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633431168 00000100:00100000:0.0:1787119494.581864:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5045 00000100:00100000:0.0:1787119494.581873:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2374:x1873929633431168:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119494.582418:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633431040 00000100:00100000:3.0:1787119494.582424:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633431040 00002000:00100000:3.0:1787119494.582471:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (2256896->2322431) req@ffff92a5098a0a80 x1873929633431040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.582491:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0a80 with x1873929633431040 ext(2256896->2322431) 00002000:00010000:3.0:1787119494.582498:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a0a80 00000100:00100000:3.0:1787119494.582519:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10070 00000100:00100000:3.0:1787119494.582527:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633431040:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.589257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.589567:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633431296 00000100:00100000:2.0:1787119494.589581:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633431296 00002000:00100000:2.0:1787119494.589624:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (34185216->34189311) req@ffff92a5098a1c00 x1873929633431296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.589635:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1c00 with x1873929633431296 ext(34185216->34189311) 00002000:00010000:2.0:1787119494.589641:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a1c00 00000100:00100000:2.0:1787119494.589672:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10071 00000100:00100000:2.0:1787119494.589681:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633431296:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.589889:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633431296:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 208us (642us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.589897:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10071 00002000:00100000:2.0:1787119494.589904:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (34185216->34189311) req@ffff92a5098a1c00 x1873929633431296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.589912:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1c00 with x1873929633431296 ext(34185216->34189311) 00002000:00010000:2.0:1787119494.589915:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a1c00 00000100:00100000:0.0:1787119494.590404:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633431040:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7876us (8704us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119494.590415:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10070 00002000:00100000:0.0:1787119494.590422:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (2256896->2322431) req@ffff92a5098a0a80 x1873929633431040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.590430:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0a80 with x1873929633431040 ext(2256896->2322431) 00002000:00010000:0.0:1787119494.590433:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a0a80 00000100:00100000:0.0:1787119494.595622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.597099:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633431424 00000100:00100000:3.0:1787119494.597113:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633431424 00002000:00100000:3.0:1787119494.597165:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (2277376->2318335) req@ffff92a5098a2680 x1873929633431424/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.597176:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2680 with x1873929633431424 ext(2277376->2318335) 00002000:00010000:3.0:1787119494.597182:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a2680 00000100:00100000:3.0:1787119494.597208:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10072 00000100:00100000:3.0:1787119494.597218:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633431424:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119494.600559:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633431424:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 3332us (4936us total) trans 4294968886 rc 0/0 00000100:00100000:0.0:1787119494.600574:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10072 00002000:00100000:0.0:1787119494.600587:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (2277376->2318335) req@ffff92a5098a2680 x1873929633431424/t4294968886(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.600596:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2680 with x1873929633431424 ext(2277376->2318335) 00002000:00010000:0.0:1787119494.600602:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a2680 00000100:00100000:3.0:1787119494.605423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.605553:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633431552 00000100:00100000:0.0:1787119494.605563:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633431552 00002000:00100000:0.0:1787119494.605625:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (34160640->34213887) req@ffff92a62a938380 x1873929633431552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.605638:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a938380 with x1873929633431552 ext(34160640->34213887) 00002000:00010000:0.0:1787119494.605643:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a938380 00000100:00100000:0.0:1787119494.605686:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10073 00000100:00100000:0.0:1787119494.605698:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633431552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.614651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.614973:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633431552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9275us (9556us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1787119494.614985:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10073 00002000:00100000:2.0:1787119494.614998:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (34160640->34213887) req@ffff92a62a938380 x1873929633431552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.615008:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a938380 with x1873929633431552 ext(34160640->34213887) 00002000:00010000:2.0:1787119494.615014:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a938380 00000100:00100000:0.0:1787119494.615095:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633431680 00000100:00100000:0.0:1787119494.615103:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633431680 00000100:00100000:0.0:1787119494.615152:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5046 00000100:00100000:0.0:1787119494.615161:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633431680:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119494.623027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.623401:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633431808 00000100:00100000:0.0:1787119494.623411:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633431808 00002000:00100000:0.0:1787119494.623497:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (34181120->34212787) req@ffff92a51282ce00 x1873929633431808/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.623507:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ce00 with x1873929633431808 ext(34181120->34212787) 00002000:00010000:0.0:1787119494.623514:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ce00 00000100:00100000:0.0:1787119494.623543:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10074 00000100:00100000:0.0:1787119494.623639:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633431808:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119494.638432:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633431808:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 14868us (15403us total) trans 4294969143 rc 0/0 00000100:00100000:0.0:1787119494.638481:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10074 00002000:00100000:0.0:1787119494.638496:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (34181120->34212787) req@ffff92a51282ce00 x1873929633431808/t4294969143(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.638506:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ce00 with x1873929633431808 ext(34181120->34212787) 00002000:00010000:0.0:1787119494.638513:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ce00 00000100:00100000:2.0:1787119494.656265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.656347:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633431936 00000100:00100000:3.0:1787119494.656357:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633431936 00000100:00100000:3.0:1787119494.656413:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5047 00000100:00100000:3.0:1787119494.656423:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633431936:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119494.672786:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633431168:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 90901us (90992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.672800:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5045 00000001:00080000:3.0:1787119494.675914:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969142 is committed 00000100:00100000:1.0:1787119494.676229:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633430912:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 98994us (99070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.676241:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5044 00000100:00100000:1.0:1787119494.690456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.690520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.690687:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633432064 00000100:00100000:0.0:1787119494.690697:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633432064 00000100:00100000:0.0:1787119494.690895:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633432192 00000100:00100000:0.0:1787119494.690899:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633432192 00000100:00100000:1.0:1787119494.692142:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19642 00000001:00080000:1.0:1787119494.692532:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968885 is committed 00000100:00100000:1.0:1787119494.692560:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+126:32728:x1873929633432064:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119494.692607:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119494.692705:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3118 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cf1 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.692973:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e311f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.692988:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e311f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693000:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e311f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119494.693025:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 34212788 00000004:00200000:1.0:1787119494.693029:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119494.693047:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e311f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693074:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e3118 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cf1 expref: 128 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693091:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e311f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cf1 expref: 127 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693100:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119494.693103:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119494.693106:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430400, rc 0) 00000100:00100000:1.0:1787119494.693246:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+127:32728:x1873929633432064:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1092us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.693259:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19642 00000100:00100000:1.0:1787119494.693285:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19643 00000100:00100000:1.0:1787119494.693293:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+126:32727:x1873929633432192:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119494.693302:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119494.693310:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cf8 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693359:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e312d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693368:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693376:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119494.693400:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 34212788 00000004:00200000:1.0:1787119494.693403:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119494.693413:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693429:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cf8 expref: 128 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693509:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e312d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cf8 expref: 127 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.693517:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119494.693521:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119494.693524:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119494.693546:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+127:32727:x1873929633432192:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 254us (3026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.693552:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19643 00000100:00100000:0.0:1787119494.694193:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633430400:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 118295us (123417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.694204:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5043 00000100:00100000:3.0:1787119494.708775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.708855:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.708918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.708943:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633432320 00000100:00100000:3.0:1787119494.708953:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633432320 00002000:00100000:3.0:1787119494.708995:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (34930688->34934783) req@ffff92a62a93b800 x1873929633432320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.709007:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93b800 with x1873929633432320 ext(34930688->34934783) 00002000:00010000:3.0:1787119494.709012:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a93b800 00000100:00100000:3.0:1787119494.709037:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633432448 00000100:00100000:3.0:1787119494.709040:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633432448 00002000:00100000:3.0:1787119494.709059:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (9064448->9068543) req@ffff92a62a93b480 x1873929633432448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.709067:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93b480 with x1873929633432448 ext(9064448->9068543) 00000100:00100000:1.0:1787119494.709088:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633432576 00000100:00100000:1.0:1787119494.709092:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633432576 00002000:00010000:3.0:1787119494.709400:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a93b480 00000100:00100000:3.0:1787119494.709434:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10075 00000100:00100000:3.0:1787119494.709470:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633432320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.711556:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633432320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2083us (2784us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.711569:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10075 00002000:00100000:3.0:1787119494.711581:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (34930688->34934783) req@ffff92a62a93b800 x1873929633432320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.711592:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93b800 with x1873929633432320 ext(34930688->34934783) 00002000:00010000:3.0:1787119494.711598:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a93b800 00000100:00100000:3.0:1787119494.711630:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10076 00000100:00100000:3.0:1787119494.711643:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633432448:12345-192.168.201.59@tcp:3:fsx.0 00002000:00100000:1.0:1787119494.714202:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (9064448->9068543) req@ffff92a62a938a80 x1873929633432576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.714216:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a938a80 with x1873929633432576 ext(9064448->9068543) 00002000:00010000:1.0:1787119494.714223:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a938a80 00000100:00100000:1.0:1787119494.714264:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10077 00000100:00100000:1.0:1787119494.714275:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633432576:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.714545:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633432576:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 272us (5626us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.714553:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10077 00002000:00100000:1.0:1787119494.714560:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (9064448->9068543) req@ffff92a62a938a80 x1873929633432576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.714567:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a938a80 with x1873929633432576 ext(9064448->9068543) 00002000:00010000:1.0:1787119494.714571:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a938a80 00000100:00100000:3.0:1787119494.717845:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633432448:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6193us (8977us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.717860:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10076 00002000:00100000:3.0:1787119494.717871:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (9064448->9068543) req@ffff92a62a93b480 x1873929633432448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.717881:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93b480 with x1873929633432448 ext(9064448->9068543) 00002000:00010000:3.0:1787119494.717888:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a93b480 00000100:00100000:3.0:1787119494.718052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.718107:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633432704 00000100:00100000:3.0:1787119494.718115:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633432704 00002000:00100000:3.0:1787119494.718152:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (34979840->34983935) req@ffff92a62a938700 x1873929633432704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.718161:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a938700 with x1873929633432704 ext(34979840->34983935) 00002000:00010000:3.0:1787119494.718165:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a938700 00000100:00100000:3.0:1787119494.718195:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10078 00000100:00100000:3.0:1787119494.718205:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633432704:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.718342:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633432704:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 138us (290us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.718350:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10078 00002000:00100000:3.0:1787119494.718356:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (34979840->34983935) req@ffff92a62a938700 x1873929633432704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.718371:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a938700 with x1873929633432704 ext(34979840->34983935) 00002000:00010000:3.0:1787119494.718374:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a938700 00000100:00100000:1.0:1787119494.732011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.732911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.733579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.734110:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633432832 00000100:00100000:0.0:1787119494.734121:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633432832 00002000:00100000:0.0:1787119494.734169:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (9068544->9072639) req@ffff92a509eef800 x1873929633432832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.734180:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eef800 with x1873929633432832 ext(9068544->9072639) 00002000:00010000:0.0:1787119494.734186:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eef800 00000100:00100000:0.0:1787119494.734215:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633432960 00000100:00100000:0.0:1787119494.734219:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633432960 00002000:00100000:0.0:1787119494.734237:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (20422656->20426751) req@ffff92a509eef480 x1873929633432960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.734246:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eef480 with x1873929633432960 ext(20422656->20426751) 00000100:00100000:2.0:1787119494.734248:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10079 00002000:00010000:0.0:1787119494.734251:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509eef480 00000100:00100000:2.0:1787119494.734263:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633432832:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.734274:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10080 00000100:00100000:0.0:1787119494.734284:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633432960:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.734537:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633432960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 253us (1628us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119494.734548:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10080 00002000:00100000:0.0:1787119494.734554:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (20422656->20426751) req@ffff92a509eef480 x1873929633432960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.734562:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eef480 with x1873929633432960 ext(20422656->20426751) 00002000:00010000:0.0:1787119494.734565:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509eef480 00000100:00100000:2.0:1787119494.734614:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633432832:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 288us (2547us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.734623:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10079 00002000:00100000:2.0:1787119494.734629:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (9068544->9072639) req@ffff92a509eef800 x1873929633432832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.734637:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eef800 with x1873929633432832 ext(9068544->9072639) 00002000:00010000:2.0:1787119494.734640:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eef800 00000100:00100000:2.0:1787119494.741490:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633433088 00000100:00100000:2.0:1787119494.741505:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633433088 00002000:00100000:2.0:1787119494.741571:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (9068544->9072639) req@ffff92a509eeca80 x1873929633433088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.741583:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eeca80 with x1873929633433088 ext(9068544->9072639) 00002000:00010000:2.0:1787119494.741590:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eeca80 00000100:00100000:2.0:1787119494.741617:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10081 00000100:00100000:2.0:1787119494.741627:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633433088:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.741884:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633433088:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 258us (8305us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.741891:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10081 00002000:00100000:2.0:1787119494.741898:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (9068544->9072639) req@ffff92a509eeca80 x1873929633433088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.741907:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eeca80 with x1873929633433088 ext(9068544->9072639) 00002000:00010000:2.0:1787119494.741910:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eeca80 00000100:00100000:1.0:1787119494.747620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.747654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.748136:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633433216 00000100:00100000:0.0:1787119494.748146:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633433216 00002000:00100000:0.0:1787119494.748195:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (9043968->9109503) req@ffff92a509eec700 x1873929633433216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.748205:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eec700 with x1873929633433216 ext(9043968->9109503) 00002000:00010000:0.0:1787119494.748211:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eec700 00000100:00100000:0.0:1787119494.748237:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633433344 00000100:00100000:0.0:1787119494.748240:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633433344 00002000:00100000:0.0:1787119494.748256:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (5865472->5869567) req@ffff92a509eedc00 x1873929633433344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.748265:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eedc00 with x1873929633433344 ext(5865472->5869567) 00002000:00010000:0.0:1787119494.748268:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509eedc00 00000100:00100000:0.0:1787119494.748291:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10082 00000100:00100000:0.0:1787119494.748300:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633433216:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.748559:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10083 00000100:00100000:0.0:1787119494.748567:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633433344:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.748717:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633433344:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 149us (1061us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119494.748724:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10083 00002000:00100000:0.0:1787119494.748730:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (5865472->5869567) req@ffff92a509eedc00 x1873929633433344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.748737:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eedc00 with x1873929633433344 ext(5865472->5869567) 00002000:00010000:0.0:1787119494.748740:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509eedc00 00000100:00100000:1.0:1787119494.750120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.751348:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633433472 00000100:00100000:2.0:1787119494.751363:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633433472 00002000:00100000:2.0:1787119494.751411:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (9043968->9109503) req@ffff92a509eed180 x1873929633433472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.751423:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eed180 with x1873929633433472 ext(9043968->9109503) 00002000:00010000:2.0:1787119494.751428:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eed180 00000100:00100000:2.0:1787119494.751496:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10084 00000100:00100000:2.0:1787119494.751505:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633433472:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.757662:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633433216:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9352us (10043us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119494.757678:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10082 00002000:00100000:0.0:1787119494.757692:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (9043968->9109503) req@ffff92a509eec700 x1873929633433216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.757703:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eec700 with x1873929633433216 ext(9043968->9109503) 00002000:00010000:0.0:1787119494.757709:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eec700 00000100:00100000:3.0:1787119494.761249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.761308:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633433600 00000100:00100000:3.0:1787119494.761317:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633433600 00002000:00100000:3.0:1787119494.761366:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (5869568->5873663) req@ffff92a62a939c00 x1873929633433600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.761377:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a939c00 with x1873929633433600 ext(5869568->5873663) 00002000:00010000:3.0:1787119494.761383:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a939c00 00000100:00100000:3.0:1787119494.761409:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10085 00000100:00100000:3.0:1787119494.761419:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633433600:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.761736:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633433600:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 319us (495us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.761745:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10085 00002000:00100000:3.0:1787119494.761751:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (5869568->5873663) req@ffff92a62a939c00 x1873929633433600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.761760:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a939c00 with x1873929633433600 ext(5869568->5873663) 00002000:00010000:3.0:1787119494.761764:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a939c00 00000001:00080000:1.0:1787119494.765795:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969143 is committed 00000100:00100000:3.0:1787119494.767190:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633431936:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 110759us (110926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119494.767204:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5047 00000100:00100000:1.0:1787119494.769152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.769652:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633433728 00000100:00100000:3.0:1787119494.769673:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633433728 00002000:00100000:3.0:1787119494.769727:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (9064448->9097215) req@ffff92a509eee680 x1873929633433728/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.769739:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eee680 with x1873929633433728 ext(9064448->9097215) 00002000:00010000:3.0:1787119494.769747:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eee680 00000100:00100000:3.0:1787119494.769784:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10086 00000100:00100000:3.0:1787119494.769793:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633433728:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119494.771608:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633433472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20095us (21486us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119494.771620:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10084 00002000:00100000:2.0:1787119494.771630:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (9043968->9109503) req@ffff92a509eed180 x1873929633433472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.771640:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eed180 with x1873929633433472 ext(9043968->9109503) 00002000:00010000:2.0:1787119494.771645:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eed180 00000100:00100000:1.0:1787119494.772357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.772428:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633433856 00000100:00100000:3.0:1787119494.772465:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633433856 00002000:00100000:3.0:1787119494.772511:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (5844992->5910527) req@ffff92a509eec000 x1873929633433856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.772520:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eec000 with x1873929633433856 ext(5844992->5910527) 00002000:00010000:3.0:1787119494.772523:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509eec000 00000100:00100000:3.0:1787119494.772550:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10087 00000100:00100000:3.0:1787119494.772559:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633433856:12345-192.168.201.59@tcp:3:fsx.0 00000001:00080000:1.0:1787119494.776344:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968886 is committed 00000100:00100000:1.0:1787119494.777083:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633431680:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 161493us (162010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.777099:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5046 00000100:00100000:1.0:1787119494.781798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.781941:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633433984 00000100:00100000:2.0:1787119494.781951:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633433984 00000100:00100000:2.0:1787119494.782010:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19644 00000100:00100000:2.0:1787119494.782020:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+127:32729:x1873929633433984:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119494.782041:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119494.782064:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3134 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715cff expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.782155:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e313b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.782169:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e313b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.782182:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e313b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119494.782210:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 34212788 00000004:00200000:2.0:1787119494.782214:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119494.782233:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e313b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.782258:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3134 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cff expref: 129 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.782278:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e313b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cff expref: 128 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119494.782286:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119494.782289:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119494.782293:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119494.782799:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+128:32729:x1873929633433984:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 778us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119494.782807:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19644 00000100:00100000:2.0:1787119494.786533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.786637:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633434112 00000100:00100000:0.0:1787119494.786646:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633434112 00002000:00100000:0.0:1787119494.786704:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (9064448->9097215) req@ffff92a50655c380 x1873929633434112/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.786716:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c380 with x1873929633434112 ext(9064448->9097215) 00002000:00010000:0.0:1787119494.786723:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655c380 00000100:00100000:0.0:1787119494.786757:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10088 00000100:00100000:0.0:1787119494.786767:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633434112:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119494.791483:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633433856:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18874us (19079us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119494.791497:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10087 00002000:00100000:3.0:1787119494.791509:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (5844992->5910527) req@ffff92a509eec000 x1873929633433856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.791519:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eec000 with x1873929633433856 ext(5844992->5910527) 00002000:00010000:3.0:1787119494.791525:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509eec000 00000100:00100000:2.0:1787119494.793639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.793752:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633434240 00000100:00100000:3.0:1787119494.793762:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633434240 00002000:00100000:3.0:1787119494.793847:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (29941760->29945855) req@ffff92a50655ed80 x1873929633434240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.793859:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ed80 with x1873929633434240 ext(29941760->29945855) 00002000:00010000:3.0:1787119494.793864:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ed80 00000100:00100000:3.0:1787119494.793893:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10089 00000100:00100000:3.0:1787119494.793902:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633434240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.797602:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.797654:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633434368 00000100:00100000:2.0:1787119494.797671:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633434368 00002000:00100000:2.0:1787119494.797716:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (9064448->9068543) req@ffff92a50655f800 x1873929633434368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.797734:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f800 with x1873929633434368 ext(9064448->9068543) 00002000:00010000:2.0:1787119494.797739:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655f800 00000100:00100000:2.0:1787119494.797772:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10090 00000100:00100000:2.0:1787119494.797780:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633434368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119494.798004:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633434368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 223us (412us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.798013:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10090 00002000:00100000:2.0:1787119494.798019:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (9064448->9068543) req@ffff92a50655f800 x1873929633434368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.798027:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f800 with x1873929633434368 ext(9064448->9068543) 00002000:00010000:2.0:1787119494.798031:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655f800 00000100:00100000:2.0:1787119494.799745:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633433728:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 29942us (30593us total) trans 4294969144 rc 0/0 00000100:00100000:2.0:1787119494.799757:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10086 00002000:00100000:2.0:1787119494.799768:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (9064448->9097215) req@ffff92a509eee680 x1873929633433728/t4294969144(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.799777:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eee680 with x1873929633433728 ext(9064448->9097215) 00002000:00010000:2.0:1787119494.799782:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eee680 00000100:00100000:3.0:1787119494.800197:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633434240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6293us (6565us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.800206:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10089 00002000:00100000:3.0:1787119494.800213:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (29941760->29945855) req@ffff92a50655ed80 x1873929633434240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.800222:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ed80 with x1873929633434240 ext(29941760->29945855) 00002000:00010000:3.0:1787119494.800226:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ed80 00000100:00100000:0.0:1787119494.800563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.800747:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633434496 00000100:00100000:1.0:1787119494.800755:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633434496 00002000:00100000:1.0:1787119494.800790:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (5910528->5947391) req@ffff92a50512c700 x1873929633434496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.800800:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c700 with x1873929633434496 ext(5910528->5947391) 00002000:00010000:1.0:1787119494.800804:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512c700 00000100:00100000:1.0:1787119494.800831:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10091 00000100:00100000:1.0:1787119494.800840:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633434496:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.801771:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633434112:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 14999us (15243us total) trans 4294969145 rc 0/0 00000100:00100000:3.0:1787119494.801781:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10088 00002000:00100000:3.0:1787119494.801788:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (9064448->9097215) req@ffff92a50655c380 x1873929633434112/t4294969145(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.801797:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c380 with x1873929633434112 ext(9064448->9097215) 00002000:00010000:3.0:1787119494.801802:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655c380 00000100:00100000:2.0:1787119494.807246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.807285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.807370:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633434752 00000100:00100000:1.0:1787119494.807381:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633434752 00000100:00100000:1.0:1787119494.807461:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5048 00000100:00100000:1.0:1787119494.807483:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633434752:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119494.810509:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633434624 00000100:00100000:3.0:1787119494.810524:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633434624 00002000:00100000:3.0:1787119494.810572:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (29945856->29949951) req@ffff92a50655f480 x1873929633434624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.810592:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f480 with x1873929633434624 ext(29945856->29949951) 00002000:00010000:3.0:1787119494.810597:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655f480 00000100:00100000:3.0:1787119494.810627:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10092 00000100:00100000:3.0:1787119494.810637:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633434624:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.810873:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633434624:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 236us (3634us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.810881:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10092 00002000:00100000:3.0:1787119494.810888:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (29945856->29949951) req@ffff92a50655f480 x1873929633434624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.810896:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f480 with x1873929633434624 ext(29945856->29949951) 00002000:00010000:3.0:1787119494.810899:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655f480 00000100:00100000:2.0:1787119494.813325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.813480:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633435008 00000100:00100000:0.0:1787119494.813489:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633435008 00000100:00100000:0.0:1787119494.813536:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5049 00000100:00100000:0.0:1787119494.813544:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633435008:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119494.813638:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633435008:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 94us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.813645:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5049 00000100:00100000:3.0:1787119494.813900:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633434496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13059us (13336us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119494.813909:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10091 00002000:00100000:3.0:1787119494.813918:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (5910528->5947391) req@ffff92a50512c700 x1873929633434496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.813928:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c700 with x1873929633434496 ext(5910528->5947391) 00002000:00010000:3.0:1787119494.813933:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512c700 00000100:00100000:2.0:1787119494.818736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.818779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.818854:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633435136 00000100:00100000:3.0:1787119494.818866:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633435136 00002000:00100000:3.0:1787119494.818918:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (29921280->29986815) req@ffff92a50655dc00 x1873929633435136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.818936:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655dc00 with x1873929633435136 ext(29921280->29986815) 00002000:00010000:3.0:1787119494.818942:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655dc00 00000100:00100000:3.0:1787119494.818984:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633434880 00000100:00100000:3.0:1787119494.818987:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633434880 00002000:00100000:3.0:1787119494.819004:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (9068544->9072639) req@ffff92a50655d180 x1873929633434880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.819012:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d180 with x1873929633434880 ext(9068544->9072639) 00002000:00010000:3.0:1787119494.819016:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d180 00000100:00100000:3.0:1787119494.819034:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10093 00000100:00100000:3.0:1787119494.819043:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633435136:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.819352:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10094 00000100:00100000:1.0:1787119494.819362:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633434880:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.819559:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633434880:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 198us (779us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.819570:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10094 00002000:00100000:1.0:1787119494.819577:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (9068544->9072639) req@ffff92a50655d180 x1873929633434880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.819585:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d180 with x1873929633434880 ext(9068544->9072639) 00002000:00010000:1.0:1787119494.819588:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d180 00000100:00100000:0.0:1787119494.825218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.825826:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633435264 00000100:00100000:3.0:1787119494.825838:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633435264 00002000:00100000:3.0:1787119494.825888:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (5865472->34983935) req@ffff92a50512dc00 x1873929633435264/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.825898:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512dc00 with x1873929633435264 ext(5865472->34983935) 00002000:00010000:3.0:1787119494.825904:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512dc00 00000100:00100000:3.0:1787119494.825938:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10095 00000100:00100000:3.0:1787119494.825954:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633435264:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119494.835309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.836959:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633435520 00000100:00100000:1.0:1787119494.836973:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633435520 00000100:00100000:1.0:1787119494.837029:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19645 00000100:00100000:1.0:1787119494.837040:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+128:32728:x1873929633435520:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119494.837090:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119494.837119:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e311f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cf1 expref: 128 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.837139:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119494.837146:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119494.837277:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.837290:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.837299:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119494.837346:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976458 00000004:00010000:1.0:1787119494.837372:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e34d938 reply state 00000000ecb012c8 transno 4294976459 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.837386:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119494.837495:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+130:32728:x1873929633435520:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 455us (2194us total) trans 4294976459 rc 0/0 00000100:00100000:1.0:1787119494.837502:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19645 00000020:00080000:1.0:1787119494.837508:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119494.837511:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633435264:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 11565us (12303us total) trans 4294968887 rc 0/0 00000100:00100000:3.0:1787119494.837520:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10095 00002000:00100000:3.0:1787119494.837530:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (5865472->34983935) req@ffff92a50512dc00 x1873929633435264/t4294968887(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.837546:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512dc00 with x1873929633435264 ext(5865472->34983935) 00002000:00010000:3.0:1787119494.837551:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512dc00 00000100:00100000:2.0:1787119494.839498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.839530:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633435648 00000100:00100000:2.0:1787119494.839540:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633435648 00002000:00100000:2.0:1787119494.839579:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (9043968->9109503) req@ffff92a50655c000 x1873929633435648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.839589:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c000 with x1873929633435648 ext(9043968->9109503) 00002000:00010000:2.0:1787119494.839594:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655c000 00000100:00100000:2.0:1787119494.839617:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10096 00000100:00100000:2.0:1787119494.839627:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633435648:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.841315:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633435136:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 22263us (22580us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119494.841327:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10093 00002000:00100000:1.0:1787119494.841343:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (29921280->29986815) req@ffff92a50655dc00 x1873929633435136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.841353:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655dc00 with x1873929633435136 ext(29921280->29986815) 00002000:00010000:1.0:1787119494.841358:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655dc00 00010000:00010000:1.0:1787119494.841863:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.841873:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.841881:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.841888:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119494.841893:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.841900:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.841919:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119494.841923:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119494.841928:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.841935:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3142 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119494.849727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.849757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.849782:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633435776 00000100:00100000:0.0:1787119494.849792:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633435776 00000100:00100000:0.0:1787119494.849840:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5050 00000100:00100000:0.0:1787119494.849849:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633435776:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119494.850097:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633435904 00000100:00100000:3.0:1787119494.850101:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633435904 00002000:00010000:3.0:1787119494.850120:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (39439060->18446744073709551615) 00002000:00100000:3.0:1787119494.850124:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512df80 with x1873929633435904 ext(39439060->18446744073709551615) 00002000:00010000:3.0:1787119494.850135:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512df80. 00000100:00100000:3.0:1787119494.850159:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10097 00000100:00100000:3.0:1787119494.850166:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633435904:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119494.850679:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 34212788 -> 39439060 00002000:00010000:3.0:1787119494.850684:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119493 -> 1787119493 00002000:00010000:3.0:1787119494.850686:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119492 00002000:00010000:3.0:1787119494.850688:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119493 -> 1787119493 00002000:00010000:3.0:1787119494.850690:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1933 -> 1293 00000100:00100000:3.0:1787119494.850747:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633435904:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 580us (988us total) trans 4294969146 rc 0/0 00000100:00100000:3.0:1787119494.850754:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10097 00002000:00010000:3.0:1787119494.850758:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (39439060->18446744073709551615) 00002000:00100000:3.0:1787119494.850761:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512df80 with x1873929633435904 ext(39439060->18446744073709551615) 00002000:00010000:3.0:1787119494.850765:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512df80. 00000100:00100000:1.0:1787119494.852361:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633435648:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12725us (12863us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119494.852374:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10096 00002000:00100000:1.0:1787119494.852387:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (9043968->9109503) req@ffff92a50655c000 x1873929633435648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.852398:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c000 with x1873929633435648 ext(9043968->9109503) 00002000:00010000:1.0:1787119494.852405:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655c000 00000100:00100000:0.0:1787119494.860032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.860081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.860117:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633436032 00000100:00100000:0.0:1787119494.860127:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633436032 00002000:00100000:0.0:1787119494.860204:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (29986816->30023679) req@ffff92a50512e680 x1873929633436032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.860215:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512e680 with x1873929633436032 ext(29986816->30023679) 00002000:00010000:0.0:1787119494.860221:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512e680 00000100:00100000:0.0:1787119494.860243:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633436160 00000100:00100000:0.0:1787119494.860246:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633436160 00002000:00100000:0.0:1787119494.860262:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (9064448->9097215) req@ffff92a50512d180 x1873929633436160/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.860271:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d180 with x1873929633436160 ext(9064448->9097215) 00002000:00010000:0.0:1787119494.860274:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d180 00000100:00100000:0.0:1787119494.860294:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10098 00000100:00100000:0.0:1787119494.860304:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633436032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.862033:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10099 00000100:00100000:1.0:1787119494.862052:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633436160:12345-192.168.201.59@tcp:4:fsx.0 00000001:00080000:0.0:1787119494.864947:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969144 is committed 00000001:00080000:0.0:1787119494.864968:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969145 is committed 00000100:00100000:1.0:1787119494.865133:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633434752:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 57656us (57840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.865144:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5048 00000100:00100000:2.0:1787119494.867320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.867694:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633436288 00000100:00100000:3.0:1787119494.867706:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633436288 00002000:00100000:3.0:1787119494.867751:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (39383040->39387135) req@ffff92a50655d500 x1873929633436288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.867769:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d500 with x1873929633436288 ext(39383040->39387135) 00002000:00010000:3.0:1787119494.867775:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d500 00000100:00100000:3.0:1787119494.867803:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10100 00000100:00100000:3.0:1787119494.867813:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633436288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.868102:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633436288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 289us (791us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.868110:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10100 00002000:00100000:3.0:1787119494.868117:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (39383040->39387135) req@ffff92a50655d500 x1873929633436288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.868125:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d500 with x1873929633436288 ext(39383040->39387135) 00002000:00010000:3.0:1787119494.868128:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d500 00000100:00100000:1.0:1787119494.879628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.879669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.879698:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633436416 00000100:00100000:1.0:1787119494.879708:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633436416 00002000:00100000:1.0:1787119494.879750:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (39387136->39391231) req@ffff92a509eedf80 x1873929633436416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.879770:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eedf80 with x1873929633436416 ext(39387136->39391231) 00002000:00010000:1.0:1787119494.879775:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eedf80 00000100:00100000:1.0:1787119494.879800:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10101 00000100:00100000:1.0:1787119494.879808:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633436416:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.880012:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633436416:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 203us (389us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.880019:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10101 00002000:00100000:1.0:1787119494.880026:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (39387136->39391231) req@ffff92a509eedf80 x1873929633436416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.880035:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eedf80 with x1873929633436416 ext(39387136->39391231) 00002000:00010000:1.0:1787119494.880039:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eedf80 00000100:00100000:1.0:1787119494.880060:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633436672 00000100:00100000:1.0:1787119494.880064:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633436672 00000100:00100000:1.0:1787119494.880092:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19646 00000100:00100000:1.0:1787119494.880098:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+129:32727:x1873929633436672:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119494.880137:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119494.880164:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e312d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cf8 expref: 129 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.880180:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119494.880185:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119494.880344:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.880362:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.880371:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119494.880428:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976460 00000004:00010000:1.0:1787119494.880495:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cba7ca18 reply state 0000000018855366 transno 4294976461 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.880504:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119494.880553:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+131:32727:x1873929633436672:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 454us (895us total) trans 4294976461 rc 0/0 00000100:00100000:1.0:1787119494.880560:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19646 00000020:00080000:1.0:1787119494.880564:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119494.880708:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633436032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20405us (20688us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119494.880716:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10098 00002000:00100000:1.0:1787119494.880722:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (29986816->30023679) req@ffff92a50512e680 x1873929633436032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.880730:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512e680 with x1873929633436032 ext(29986816->30023679) 00002000:00010000:1.0:1787119494.880734:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512e680 00000100:00100000:2.0:1787119494.883507:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633436160:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 21448us (23412us total) trans 4294969147 rc 0/0 00000100:00100000:2.0:1787119494.883522:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10099 00002000:00100000:2.0:1787119494.883534:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (9064448->9097215) req@ffff92a50512d180 x1873929633436160/t4294969147(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.883545:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d180 with x1873929633436160 ext(9064448->9097215) 00002000:00010000:2.0:1787119494.883551:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d180 00000100:00100000:0.0:1787119494.889093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119494.889107:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119494.889117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119494.889121:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.889128:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.889135:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119494.889140:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.889148:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.889171:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119494.889175:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119494.889179:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119494.889185:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3149 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119494.889216:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633436800 00000100:00100000:3.0:1787119494.889225:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633436800 00000100:00100000:2.0:1787119494.889234:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633436928 00000100:00100000:2.0:1787119494.889237:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633436928 00002000:00010000:2.0:1787119494.889260:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (39439060->18446744073709551615) 00002000:00100000:2.0:1787119494.889264:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ed80 with x1873929633436928 ext(39439060->18446744073709551615) 00002000:00100000:3.0:1787119494.889266:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (39362560->39428095) req@ffff92a50512fb80 x1873929633436800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.889273:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512fb80 with x1873929633436800 ext(39362560->39428095) 00002000:00010000:2.0:1787119494.889275:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ed80. 00002000:00010000:3.0:1787119494.889277:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512fb80 00000100:00100000:3.0:1787119494.889300:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10102 00000100:00100000:3.0:1787119494.889310:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633436800:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.895677:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10103 00000100:00100000:1.0:1787119494.895703:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633436928:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.895975:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 34212788 -> 39439060 00002000:00010000:1.0:1787119494.895980:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119493 -> 1787119493 00002000:00010000:1.0:1787119494.895984:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119491 -> 1787119492 00002000:00010000:1.0:1787119494.895987:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119493 -> 1787119493 00002000:00010000:1.0:1787119494.895989:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1933 -> 1293 00000100:00100000:1.0:1787119494.896078:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633436928:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 385us (6957us total) trans 4294969148 rc 0/0 00000100:00100000:1.0:1787119494.896086:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10103 00002000:00010000:1.0:1787119494.896091:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (39439060->18446744073709551615) 00002000:00100000:1.0:1787119494.896095:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ed80 with x1873929633436928 ext(39439060->18446744073709551615) 00002000:00010000:1.0:1787119494.896103:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ed80. 00000100:00100000:2.0:1787119494.897992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.898029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.898058:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633437184 00000100:00100000:2.0:1787119494.898068:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633437184 00002000:00100000:2.0:1787119494.898112:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (29941760->30011391) req@ffff92a50655df80 x1873929633437184/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.898123:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655df80 with x1873929633437184 ext(29941760->30011391) 00002000:00010000:2.0:1787119494.898128:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655df80 00000100:00100000:2.0:1787119494.898152:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10104 00000100:00100000:2.0:1787119494.898162:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633437184:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119494.898877:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633437056 00000100:00100000:1.0:1787119494.898885:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633437056 00000100:00100000:1.0:1787119494.898917:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5051 00000100:00100000:1.0:1787119494.898925:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633437056:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119494.900286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.900718:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633437312 00000100:00100000:0.0:1787119494.900727:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633437312 00002000:00100000:0.0:1787119494.900763:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (39383040->39387135) req@ffff92a50655f100 x1873929633437312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.900781:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f100 with x1873929633437312 ext(39383040->39387135) 00002000:00010000:0.0:1787119494.900787:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655f100 00000100:00100000:0.0:1787119494.900813:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10105 00000100:00100000:0.0:1787119494.900823:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633437312:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.904901:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633437184:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 6729us (6860us total) trans 4294968888 rc 0/0 00000100:00100000:3.0:1787119494.904916:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10104 00002000:00100000:3.0:1787119494.904930:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (29941760->30011391) req@ffff92a50655df80 x1873929633437184/t4294968888(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.904942:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655df80 with x1873929633437184 ext(29941760->30011391) 00002000:00010000:3.0:1787119494.904949:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655df80 00000100:00100000:3.0:1787119494.905034:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633436800:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15724us (15950us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119494.905044:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10102 00002000:00100000:3.0:1787119494.905051:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (39362560->39428095) req@ffff92a50512fb80 x1873929633436800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.905061:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512fb80 with x1873929633436800 ext(39362560->39428095) 00002000:00010000:3.0:1787119494.905065:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512fb80 00000100:00100000:2.0:1787119494.906597:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633437312:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5768us (6309us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119494.906609:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10105 00002000:00100000:2.0:1787119494.906618:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (39383040->39387135) req@ffff92a50655f100 x1873929633437312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.906628:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f100 with x1873929633437312 ext(39383040->39387135) 00002000:00010000:2.0:1787119494.906633:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655f100 00000001:00080000:1.0:1787119494.909267:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968887 is committed 00000100:00100000:0.0:1787119494.909696:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633435776:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 59842us (59973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119494.909707:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5050 00000100:00100000:1.0:1787119494.922822:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.922865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.922880:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633437440 00000100:00100000:2.0:1787119494.922890:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633437440 00000100:00100000:2.0:1787119494.922940:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5052 00000100:00100000:2.0:1787119494.922950:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633437440:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119494.922967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.922986:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633437568 00000100:00100000:1.0:1787119494.922990:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633437568 00002000:00100000:1.0:1787119494.923018:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (39387136->39391231) req@ffff92a509eece00 x1873929633437568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.923030:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eece00 with x1873929633437568 ext(39387136->39391231) 00002000:00010000:1.0:1787119494.923036:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eece00 00000100:00100000:1.0:1787119494.923061:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633437696 00000100:00100000:1.0:1787119494.923065:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633437696 00002000:00100000:1.0:1787119494.923079:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (39428096->39440383) req@ffff92a509eeea00 x1873929633437696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.923087:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eeea00 with x1873929633437696 ext(39428096->39440383) 00002000:00010000:1.0:1787119494.923090:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eeea00 00000100:00100000:3.0:1787119494.923337:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10106 00000100:00100000:3.0:1787119494.923347:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633437568:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.923581:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633437568:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 235us (714us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119494.923588:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10106 00002000:00100000:3.0:1787119494.923594:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (39387136->39391231) req@ffff92a509eece00 x1873929633437568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.923602:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eece00 with x1873929633437568 ext(39387136->39391231) 00002000:00010000:3.0:1787119494.923605:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eece00 00000100:00100000:3.0:1787119494.923623:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10107 00000100:00100000:3.0:1787119494.923629:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633437696:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.923727:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633437696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 97us (758us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1787119494.923733:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10107 00002000:00100000:3.0:1787119494.923739:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (39428096->39440383) req@ffff92a509eeea00 x1873929633437696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/12728 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.923747:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eeea00 with x1873929633437696 ext(39428096->39440383) 00002000:00010000:3.0:1787119494.923751:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eeea00 00000100:00100000:2.0:1787119494.930121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.930215:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633437824 00000100:00100000:3.0:1787119494.930225:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633437824 00002000:00100000:3.0:1787119494.930270:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (39362560->39428095) req@ffff92a63eabc700 x1873929633437824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.930280:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633437824 ext(39362560->39428095) 00002000:00010000:3.0:1787119494.930286:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc700 00000100:00100000:3.0:1787119494.930309:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10108 00000100:00100000:3.0:1787119494.930318:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633437824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.934282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.934424:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633437952 00000100:00100000:1.0:1787119494.934435:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633437952 00002000:00100000:0.0:1787119494.935092:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (671744->675839) req@ffff92a62a939180 x1873929633437952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.935106:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a939180 with x1873929633437952 ext(671744->675839) 00002000:00010000:0.0:1787119494.935112:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a939180 00000100:00100000:0.0:1787119494.935148:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10109 00000100:00100000:0.0:1787119494.935157:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633437952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.935604:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633437952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 447us (1331us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119494.935612:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10109 00002000:00100000:0.0:1787119494.935619:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (671744->675839) req@ffff92a62a939180 x1873929633437952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.935627:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a939180 with x1873929633437952 ext(671744->675839) 00002000:00010000:0.0:1787119494.935630:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a939180 00000100:00100000:3.0:1787119494.936245:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633437824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5926us (6133us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119494.936254:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10108 00002000:00100000:3.0:1787119494.936261:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (39362560->39428095) req@ffff92a63eabc700 x1873929633437824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.936269:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633437824 ext(39362560->39428095) 00002000:00010000:3.0:1787119494.936273:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc700 00000001:00080000:0.0:1787119494.941467:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969148 is committed 00000100:00100000:1.0:1787119494.942304:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633437056:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 43372us (44314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119494.942317:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5051 00000100:00100000:0.0:1787119494.949915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.949950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.949980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.949990:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633438080 00000100:00100000:0.0:1787119494.949998:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633438208 00000100:00100000:1.0:1787119494.950000:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633438080 00000100:00100000:0.0:1787119494.950001:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633438208 00002000:00100000:1.0:1787119494.950048:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (39383040->39439059) req@ffff92a50512d500 x1873929633438080/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.950048:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (675840->679935) req@ffff92a50512c380 x1873929633438208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.950061:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633438080 ext(39383040->39439059) 00002000:00100000:0.0:1787119494.950061:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c380 with x1873929633438208 ext(675840->679935) 00002000:00010000:1.0:1787119494.950067:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d500 00002000:00010000:0.0:1787119494.950067:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512c380 00000100:00100000:0.0:1787119494.950790:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633438336 00000100:00100000:0.0:1787119494.950798:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633438336 00002000:00100000:0.0:1787119494.950821:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (39428096->39440383) req@ffff92a50512ea00 x1873929633438336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119494.950831:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ea00 with x1873929633438336 ext(39428096->39440383) 00002000:00010000:0.0:1787119494.950835:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ea00 00000100:00100000:1.0:1787119494.950916:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10110 00000100:00100000:1.0:1787119494.950927:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633438208:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.950963:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10111 00000100:00100000:3.0:1787119494.950974:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633438080:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119494.951159:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633438208:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 234us (1208us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.951167:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10110 00002000:00100000:1.0:1787119494.951175:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (675840->679935) req@ffff92a50512c380 x1873929633438208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.951183:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c380 with x1873929633438208 ext(675840->679935) 00002000:00010000:1.0:1787119494.951187:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512c380 00000100:00100000:1.0:1787119494.951209:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10112 00000100:00100000:1.0:1787119494.951215:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633438336:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119494.951348:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633438336:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 132us (1365us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119494.951355:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10112 00002000:00100000:1.0:1787119494.951361:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (39428096->39440383) req@ffff92a50512ea00 x1873929633438336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/12728 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.951370:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ea00 with x1873929633438336 ext(39428096->39440383) 00002000:00010000:1.0:1787119494.951374:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ea00 00000100:00100000:3.0:1787119494.956000:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633438080:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 5017us (6085us total) trans 4294969149 rc 0/0 00000100:00100000:3.0:1787119494.956014:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10111 00002000:00100000:3.0:1787119494.956027:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (39383040->39439059) req@ffff92a50512d500 x1873929633438080/t4294969149(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.956045:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633438080 ext(39383040->39439059) 00002000:00010000:3.0:1787119494.956053:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d500 00000100:00100000:1.0:1787119494.960032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119494.960959:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633438464 00000100:00100000:2.0:1787119494.960971:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633438464 00002000:00100000:2.0:1787119494.961032:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (651264->716799) req@ffff92a509eed880 x1873929633438464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.961050:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eed880 with x1873929633438464 ext(651264->716799) 00002000:00010000:2.0:1787119494.961055:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509eed880 00000100:00100000:2.0:1787119494.961089:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10113 00000100:00100000:2.0:1787119494.961100:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633438464:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119494.965578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.965710:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119494.966991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119494.967987:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633438976 00000100:00100000:0.0:1787119494.968000:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633438976 00000100:00100000:0.0:1787119494.968063:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5053 00000100:00100000:0.0:1787119494.968074:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633438976:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119494.969133:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633438464:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8029us (9105us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119494.969145:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10113 00002000:00100000:3.0:1787119494.969156:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (651264->716799) req@ffff92a509eed880 x1873929633438464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 504/440 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.969167:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eed880 with x1873929633438464 ext(651264->716799) 00002000:00010000:3.0:1787119494.969172:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509eed880 00000100:00100000:3.0:1787119494.969195:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633438848 00000100:00100000:3.0:1787119494.969200:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633438848 00002000:00100000:3.0:1787119494.969224:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (39383040->39439059) req@ffff92a62a93a300 x1873929633438848/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119494.969233:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93a300 with x1873929633438848 ext(39383040->39439059) 00002000:00010000:3.0:1787119494.969237:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a93a300 00000100:00100000:3.0:1787119494.969255:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10114 00000100:00100000:3.0:1787119494.969263:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633438848:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119494.972171:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633438720 00000100:00100000:1.0:1787119494.972187:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633438720 00000100:00100000:1.0:1787119494.972251:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19647 00000100:00100000:1.0:1787119494.972260:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+130:32729:x1873929633438720:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119494.973798:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119494.973840:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e313b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715cff expref: 130 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.973858:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119494.973864:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119494.974283:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.974297:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119494.974304:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119494.974997:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976462 00000004:00010000:1.0:1787119494.975036:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a691b2e reply state 00000000272b2b0d transno 4294976463 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.975048:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119494.975146:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+132:32729:x1873929633438720:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2882us (9574us total) trans 4294976463 rc 0/0 00000100:00100000:1.0:1787119494.975155:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19647 00000020:00080000:1.0:1787119494.975161:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119494.975678:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633438848:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 6413us (9965us total) trans 4294969150 rc 0/0 00000100:00100000:2.0:1787119494.975689:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10114 00002000:00100000:2.0:1787119494.975700:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (39383040->39439059) req@ffff92a62a93a300 x1873929633438848/t4294969150(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/448 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119494.975711:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a93a300 with x1873929633438848 ext(39383040->39439059) 00002000:00010000:2.0:1787119494.975715:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a93a300 00000100:00100000:0.0:1787119494.993615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119494.993684:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633439104 00000100:00100000:1.0:1787119494.993695:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633439104 00002000:00100000:1.0:1787119494.993764:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (6119424->6123519) req@ffff92a506157800 x1873929633439104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/0 e 0 to 0 dl 1787119505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.993777:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157800 with x1873929633439104 ext(6119424->6123519) 00002000:00010000:1.0:1787119494.993784:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506157800 00000100:00100000:1.0:1787119494.993811:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10115 00000100:00100000:1.0:1787119494.993822:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633439104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119494.993953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119494.994006:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.994016:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.994023:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.994033:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119494.994038:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.994045:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.994063:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119494.994066:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119494.994072:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119494.994077:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3150 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119494.994135:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633439104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 315us (531us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119494.994144:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10115 00002000:00100000:1.0:1787119494.994151:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (6119424->6123519) req@ffff92a506157800 x1873929633439104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787119505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119494.994159:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157800 with x1873929633439104 ext(6119424->6123519) 00002000:00010000:1.0:1787119494.994163:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506157800 00000100:00100000:1.0:1787119494.994179:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633439232 00000100:00100000:1.0:1787119494.994183:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633439232 00002000:00010000:1.0:1787119494.994197:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (39439060->18446744073709551615) 00002000:00100000:1.0:1787119494.994200:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154380 with x1873929633439232 ext(39439060->18446744073709551615) 00002000:00010000:1.0:1787119494.994208:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154380. 00000100:00100000:1.0:1787119494.994225:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10116 00000100:00100000:1.0:1787119494.994232:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633439232:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119494.994547:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 34212788 -> 39439060 00002000:00010000:1.0:1787119494.994551:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119493 -> 1787119493 00002000:00010000:1.0:1787119494.994554:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119491 -> 1787119492 00002000:00010000:1.0:1787119494.994556:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119493 -> 1787119493 00002000:00010000:1.0:1787119494.994559:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1933 -> 1293 00000100:00100000:1.0:1787119494.994589:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633439232:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 357us (635us total) trans 4294969151 rc 0/0 00000100:00100000:1.0:1787119494.994596:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10116 00002000:00010000:1.0:1787119494.994600:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (39439060->18446744073709551615) 00002000:00100000:1.0:1787119494.994603:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154380 with x1873929633439232 ext(39439060->18446744073709551615) 00002000:00010000:1.0:1787119494.994607:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154380. 00000001:00080000:3.0:1787119495.003421:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968888 is committed 00000100:00100000:3.0:1787119495.004003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.004069:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633439360 00000100:00100000:1.0:1787119495.004079:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633439360 00000100:00080000:3.0:1787119495.004139:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:1.0:1787119495.004147:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (39383040->39387135) req@ffff92a6072f8e00 x1873929633439360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.004159:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8e00 with x1873929633439360 ext(39383040->39387135) 00002000:00010000:1.0:1787119495.004165:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8e00 00000100:00100000:1.0:1787119495.004196:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10117 00000100:00100000:1.0:1787119495.004206:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633439360:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.004458:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633439360:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 252us (459us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.004466:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10117 00002000:00100000:1.0:1787119495.004483:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (39383040->39387135) req@ffff92a6072f8e00 x1873929633439360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.004491:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8e00 with x1873929633439360 ext(39383040->39387135) 00002000:00010000:1.0:1787119495.004495:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8e00 00000100:00100000:3.0:1787119495.004504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.004512:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633439488 00000100:00100000:1.0:1787119495.004515:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633439488 00002000:00100000:1.0:1787119495.004535:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (6172672->6176767) req@ffff92a63eb2df80 x1873929633439488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.004544:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2df80 with x1873929633439488 ext(6172672->6176767) 00002000:00010000:1.0:1787119495.004548:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2df80 00000100:00100000:1.0:1787119495.004562:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10118 00000100:00100000:1.0:1787119495.004568:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633439488:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.004577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00080000:3.0:1787119495.004596:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119495.004700:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633439488:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 130us (194us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.004707:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10118 00002000:00100000:1.0:1787119495.004714:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (6172672->6176767) req@ffff92a63eb2df80 x1873929633439488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.004721:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2df80 with x1873929633439488 ext(6172672->6176767) 00002000:00010000:1.0:1787119495.004724:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2df80 00000100:00100000:2.0:1787119495.005635:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633437440:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 82682us (82819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119495.005647:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5052 00000100:00100000:2.0:1787119495.005677:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633439616 00000100:00100000:2.0:1787119495.005682:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633439616 00000100:00100000:2.0:1787119495.005712:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5054 00000100:00100000:2.0:1787119495.005719:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633439616:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119495.010837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.011204:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633439744 00000100:00100000:3.0:1787119495.011216:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633439744 00002000:00100000:3.0:1787119495.011265:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (39387136->39391231) req@ffff92a509eefb80 x1873929633439744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.011276:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eefb80 with x1873929633439744 ext(39387136->39391231) 00002000:00010000:3.0:1787119495.011282:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eefb80 00000100:00100000:3.0:1787119495.011306:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10119 00000100:00100000:3.0:1787119495.011315:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633439744:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.011684:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633439744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 369us (857us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.011692:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10119 00002000:00100000:3.0:1787119495.011699:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (39387136->39391231) req@ffff92a509eefb80 x1873929633439744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.011708:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509eefb80 with x1873929633439744 ext(39387136->39391231) 00002000:00010000:3.0:1787119495.011712:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509eefb80 00000100:00100000:1.0:1787119495.015541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.016124:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633440000 00000100:00100000:2.0:1787119495.016135:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633440000 00000100:00100000:2.0:1787119495.016211:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19648 00000100:00100000:2.0:1787119495.016221:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+131:32724:x1873929633440000:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119495.016273:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119495.016300:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e301c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715c9d expref: 131 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.016319:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119495.016324:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1787119495.016513:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787119495.016580:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.016594:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.016605:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119495.016654:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976464 00000004:00010000:2.0:1787119495.016796:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007dbce19 reply state 00000000cbeda929 transno 4294976465 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.016805:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119495.016894:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+133:32724:x1873929633440000:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 674us (1364us total) trans 4294976465 rc 0/0 00000100:00100000:2.0:1787119495.016902:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19648 00000020:00080000:2.0:1787119495.016906:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787119495.018843:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.018859:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.018866:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.018883:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119495.018888:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.018896:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.018912:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119495.018915:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119495.018920:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.018927:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3157 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119495.019195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.019652:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633440128 00000100:00100000:2.0:1787119495.019671:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633440128 00002000:00010000:2.0:1787119495.019712:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (47090098->18446744073709551615) 00002000:00100000:2.0:1787119495.019717:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6a680 with x1873929633440128 ext(47090098->18446744073709551615) 00002000:00010000:2.0:1787119495.019728:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6a680. 00000100:00100000:2.0:1787119495.019757:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10120 00000100:00100000:2.0:1787119495.019766:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633440128:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119495.020051:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 39439060 -> 47090098 00002000:00010000:2.0:1787119495.020056:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119492 -> 1787119493 00002000:00010000:2.0:1787119495.020058:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119495.020061:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119492 -> 1787119493 00002000:00010000:2.0:1787119495.020063:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1293 -> 2447 00000100:00100000:2.0:1787119495.020129:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633440128:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 364us (938us total) trans 4294968889 rc 0/0 00000100:00100000:2.0:1787119495.020137:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10120 00002000:00010000:2.0:1787119495.020141:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (47090098->18446744073709551615) 00002000:00100000:2.0:1787119495.020144:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508f6a680 with x1873929633440128 ext(47090098->18446744073709551615) 00002000:00010000:2.0:1787119495.020149:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508f6a680. 00000100:00100000:3.0:1787119495.021621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.021848:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633440256 00000100:00100000:2.0:1787119495.021857:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633440256 00002000:00100000:2.0:1787119495.021903:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (39362560->39428095) req@ffff92a5066ddc00 x1873929633440256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.021915:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddc00 with x1873929633440256 ext(39362560->39428095) 00002000:00010000:2.0:1787119495.021920:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ddc00 00000100:00100000:2.0:1787119495.021939:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10121 00000100:00100000:2.0:1787119495.021949:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633440256:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.025496:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.025770:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633440384 00000100:00100000:2.0:1787119495.025779:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633440384 00002000:00100000:2.0:1787119495.025827:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (34930688->34934783) req@ffff92a506edd180 x1873929633440384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.025839:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd180 with x1873929633440384 ext(34930688->34934783) 00002000:00010000:2.0:1787119495.025846:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edd180 00000100:00100000:2.0:1787119495.025880:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10122 00000100:00100000:2.0:1787119495.025890:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633440384:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.026174:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633440384:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 284us (687us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.026182:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10122 00002000:00100000:2.0:1787119495.026190:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (34930688->34934783) req@ffff92a506edd180 x1873929633440384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.026198:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506edd180 with x1873929633440384 ext(34930688->34934783) 00002000:00010000:2.0:1787119495.026203:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506edd180 00000001:00080000:3.0:1787119495.026532:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969149 is committed 00000100:00100000:0.0:1787119495.027265:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633438976:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 59189us (60276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119495.027274:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5053 00000100:00100000:1.0:1787119495.032540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.032568:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633440512 00000100:00100000:1.0:1787119495.032577:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633440512 00002000:00100000:1.0:1787119495.032621:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (34979840->34983935) req@ffff92a5098a7b80 x1873929633440512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.032640:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7b80 with x1873929633440512 ext(34979840->34983935) 00002000:00010000:1.0:1787119495.032645:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a7b80 00000100:00100000:1.0:1787119495.032669:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10123 00000100:00100000:1.0:1787119495.032678:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633440512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.032956:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633440512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 277us (424us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.032963:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10123 00002000:00100000:1.0:1787119495.032969:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (34979840->34983935) req@ffff92a5098a7b80 x1873929633440512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.032978:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7b80 with x1873929633440512 ext(34979840->34983935) 00002000:00010000:1.0:1787119495.032981:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a7b80 00000100:00100000:2.0:1787119495.033526:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633440256:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11577us (11909us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119495.033535:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10121 00002000:00100000:2.0:1787119495.033542:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (39362560->39428095) req@ffff92a5066ddc00 x1873929633440256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.033551:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddc00 with x1873929633440256 ext(39362560->39428095) 00002000:00010000:2.0:1787119495.033555:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ddc00 00000100:00100000:3.0:1787119495.044396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.044464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.044523:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633440768 00000100:00100000:1.0:1787119495.044533:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633440768 00000100:00100000:1.0:1787119495.044590:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19649 00000100:00100000:1.0:1787119495.044601:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+132:32728:x1873929633440768:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119495.044625:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787119495.044639:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633440640 00000100:00100000:2.0:1787119495.044644:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633440640 00010000:00010000:1.0:1787119495.044647:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e315e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d06 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787119495.044684:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (47054848->47058943) req@ffff92a511632a00 x1873929633440640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.044695:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633440640 ext(47054848->47058943) 00002000:00010000:2.0:1787119495.044700:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511632a00 00000100:00100000:2.0:1787119495.044718:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10124 00000100:00100000:2.0:1787119495.044725:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633440640:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:1.0:1787119495.044742:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e3165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.044755:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e3165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.044770:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e3165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119495.044796:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 39439060 00000004:00200000:1.0:1787119495.044802:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119495.044821:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e3165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.044845:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431600/0xcaba3de8463e315e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d06 expref: 134 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.044861:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e3165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d06 expref: 133 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.044882:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119495.044885:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119495.044889:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431000, rc 0) 00000100:00100000:2.0:1787119495.044935:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633440640:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 210us (548us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.044943:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10124 00002000:00100000:2.0:1787119495.044950:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (47054848->47058943) req@ffff92a511632a00 x1873929633440640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.044959:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633440640 ext(47054848->47058943) 00002000:00010000:2.0:1787119495.044962:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511632a00 00000100:00100000:1.0:1787119495.045355:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+133:32728:x1873929633440768:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 754us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119495.045363:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19649 00000100:00100000:3.0:1787119495.056215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.056431:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633440896 00000100:00100000:1.0:1787119495.056474:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633440896 00002000:00100000:1.0:1787119495.056527:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (20422656->20426751) req@ffff92a63dc05500 x1873929633440896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.056539:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05500 with x1873929633440896 ext(20422656->20426751) 00002000:00010000:1.0:1787119495.056544:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05500 00000100:00100000:1.0:1787119495.056578:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10125 00000100:00100000:1.0:1787119495.056588:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633440896:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.056834:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633440896:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 247us (4181us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.056842:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10125 00002000:00100000:1.0:1787119495.056849:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (20422656->20426751) req@ffff92a63dc05500 x1873929633440896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.056857:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05500 with x1873929633440896 ext(20422656->20426751) 00002000:00010000:1.0:1787119495.056861:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05500 00000100:00100000:1.0:1787119495.058219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.061100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.062501:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633441024 00000100:00100000:3.0:1787119495.062513:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633441024 00002000:00100000:2.0:1787119495.062620:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (47058944->47063039) req@ffff92a5098a5c00 x1873929633441024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.062632:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5c00 with x1873929633441024 ext(47058944->47063039) 00002000:00010000:2.0:1787119495.062638:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a5c00 00000100:00100000:2.0:1787119495.062673:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633441152 00000100:00100000:2.0:1787119495.062677:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633441152 00002000:00100000:2.0:1787119495.062694:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (7630848->7634943) req@ffff92a508da5180 x1873929633441152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.062702:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5180 with x1873929633441152 ext(7630848->7634943) 00002000:00010000:2.0:1787119495.062706:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5180 00000100:00100000:2.0:1787119495.062721:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10126 00000100:00100000:2.0:1787119495.062729:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633441024:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.062963:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633441024:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 234us (4751us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.062971:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10126 00002000:00100000:2.0:1787119495.062978:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (47058944->47063039) req@ffff92a5098a5c00 x1873929633441024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.062985:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5c00 with x1873929633441024 ext(47058944->47063039) 00002000:00010000:2.0:1787119495.062989:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a5c00 00000100:00100000:2.0:1787119495.063006:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10127 00000100:00100000:2.0:1787119495.063013:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633441152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.063105:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633441152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 92us (2013us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.063111:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10127 00002000:00100000:2.0:1787119495.063117:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (7630848->7634943) req@ffff92a508da5180 x1873929633441152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.063124:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5180 with x1873929633441152 ext(7630848->7634943) 00002000:00010000:2.0:1787119495.063127:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5180 00000100:00100000:2.0:1787119495.063193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.063308:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633441280 00000100:00100000:2.0:1787119495.063313:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633441280 00002000:00100000:2.0:1787119495.063329:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (39428096->39440383) req@ffff92a63eabdc00 x1873929633441280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.063338:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdc00 with x1873929633441280 ext(39428096->39440383) 00002000:00010000:2.0:1787119495.063342:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabdc00 00000100:00100000:2.0:1787119495.063359:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10128 00000100:00100000:2.0:1787119495.063366:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633441280:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.063519:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633441280:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 153us (326us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119495.063526:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10128 00002000:00100000:2.0:1787119495.063532:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (39428096->39440383) req@ffff92a63eabdc00 x1873929633441280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/12728 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.063539:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdc00 with x1873929633441280 ext(39428096->39440383) 00002000:00010000:2.0:1787119495.063542:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabdc00 00000001:00080000:3.0:1787119495.065956:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969151 is committed 00000100:00100000:2.0:1787119495.066183:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633439616:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 60458us (61598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119495.066193:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5054 00000100:00100000:1.0:1787119495.067546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.067807:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633441408 00000100:00100000:2.0:1787119495.067816:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633441408 00002000:00100000:2.0:1787119495.067859:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (47034368->47091711) req@ffff92a519cdce00 x1873929633441408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.067871:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdce00 with x1873929633441408 ext(47034368->47091711) 00002000:00010000:2.0:1787119495.067876:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdce00 00000100:00100000:2.0:1787119495.067906:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10129 00000100:00100000:2.0:1787119495.067916:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633441408:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.070644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.070746:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633441536 00000100:00100000:3.0:1787119495.070804:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633441536 00000100:00100000:3.0:1787119495.070865:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19650 00000100:00100000:3.0:1787119495.070875:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+133:32727:x1873929633441536:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119495.070894:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119495.070916:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e316c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d0d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.070995:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.071009:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.071020:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119495.071044:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 39439060 00000004:00200000:3.0:1787119495.071049:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119495.071068:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.071092:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e316c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d0d expref: 135 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.071108:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d0d expref: 134 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.071116:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119495.071119:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119495.071123:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1600, rc 0) 00000100:00100000:3.0:1787119495.071189:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+134:32727:x1873929633441536:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 316us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119495.071196:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19650 00000100:00100000:3.0:1787119495.078544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.078573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.078679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.085242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.085296:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633441664 00000100:00100000:2.0:1787119495.085309:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633441664 00002000:00100000:2.0:1787119495.085358:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (7634944->7639039) req@ffff92a508cfc700 x1873929633441664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.085370:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc700 with x1873929633441664 ext(7634944->7639039) 00002000:00010000:2.0:1787119495.085376:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc700 00000100:00100000:2.0:1787119495.085405:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633441792 00000100:00100000:2.0:1787119495.085409:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633441792 00002000:00100000:2.0:1787119495.085424:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (39383040->39439059) req@ffff92a509136a00 x1873929633441792/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.085433:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136a00 with x1873929633441792 ext(39383040->39439059) 00002000:00010000:2.0:1787119495.085450:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136a00 00000100:00100000:2.0:1787119495.085464:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633441920 00000100:00100000:2.0:1787119495.085477:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633441920 00002000:00100000:2.0:1787119495.085494:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (5865472->5869567) req@ffff92a509136300 x1873929633441920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.085501:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136300 with x1873929633441920 ext(5865472->5869567) 00002000:00010000:2.0:1787119495.085504:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509136300 00000100:00100000:2.0:1787119495.085529:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10130 00000100:00100000:2.0:1787119495.085539:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633441664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.085802:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633441664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 265us (7268us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.085807:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10130 00002000:00100000:2.0:1787119495.085812:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (7634944->7639039) req@ffff92a508cfc700 x1873929633441664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.085817:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc700 with x1873929633441664 ext(7634944->7639039) 00002000:00010000:2.0:1787119495.085819:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc700 00000100:00100000:2.0:1787119495.085832:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10131 00000100:00100000:2.0:1787119495.085836:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633441792:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119495.085936:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10132 00000100:00100000:2.0:1787119495.085943:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633441920:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.086014:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633441920:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 71us (7336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.086018:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10132 00002000:00100000:2.0:1787119495.086022:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (5865472->5869567) req@ffff92a509136300 x1873929633441920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.086027:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136300 with x1873929633441920 ext(5865472->5869567) 00002000:00010000:2.0:1787119495.086030:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509136300 00000100:00100000:2.0:1787119495.087960:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633441408:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20037us (20411us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1787119495.087971:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10129 00002000:00100000:2.0:1787119495.087982:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (47034368->47091711) req@ffff92a519cdce00 x1873929633441408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.087993:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdce00 with x1873929633441408 ext(47034368->47091711) 00002000:00010000:2.0:1787119495.087998:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cdce00 00000100:00100000:2.0:1787119495.090043:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633441792:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 4199us (11463us total) trans 4294969152 rc 0/0 00000100:00100000:2.0:1787119495.090054:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10131 00002000:00100000:2.0:1787119495.090063:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (39383040->39439059) req@ffff92a509136a00 x1873929633441792/t4294969152(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.090071:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136a00 with x1873929633441792 ext(39383040->39439059) 00002000:00010000:2.0:1787119495.090075:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136a00 00000100:00100000:3.0:1787119495.095731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.095925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.095981:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633442048 00000100:00100000:0.0:1787119495.095992:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633442048 00002000:00100000:0.0:1787119495.096039:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (7630848->7634943) req@ffff92a62a999180 x1873929633442048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.096050:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999180 with x1873929633442048 ext(7630848->7634943) 00002000:00010000:0.0:1787119495.096056:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a999180 00000100:00100000:0.0:1787119495.096087:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633442304 00000100:00100000:0.0:1787119495.096090:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633442304 00002000:00100000:0.0:1787119495.096104:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (7610368->7675903) req@ffff92a50986c000 x1873929633442304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.096113:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c000 with x1873929633442304 ext(7610368->7675903) 00002000:00010000:0.0:1787119495.096116:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c000 00000100:00100000:0.0:1787119495.096135:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10133 00000100:00100000:0.0:1787119495.096143:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633442048:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.096374:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633442048:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 230us (11142us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.096382:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10133 00002000:00100000:0.0:1787119495.096388:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (7630848->7634943) req@ffff92a62a999180 x1873929633442048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.096395:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999180 with x1873929633442048 ext(7630848->7634943) 00002000:00010000:0.0:1787119495.096398:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a999180 00000100:00100000:0.0:1787119495.096418:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10134 00000100:00100000:0.0:1787119495.096424:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633442304:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.096972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.097062:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633442176 00000100:00100000:2.0:1787119495.097067:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633442176 00002000:00100000:2.0:1787119495.097094:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (5869568->5873663) req@ffff92a50986dc00 x1873929633442176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.097103:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986dc00 with x1873929633442176 ext(5869568->5873663) 00002000:00010000:2.0:1787119495.097108:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986dc00 00000100:00100000:2.0:1787119495.097129:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10135 00000100:00100000:2.0:1787119495.097135:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633442176:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.097272:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633442176:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 137us (1347us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.097279:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10135 00002000:00100000:2.0:1787119495.097285:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (5869568->5873663) req@ffff92a50986dc00 x1873929633442176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.097292:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986dc00 with x1873929633442176 ext(5869568->5873663) 00002000:00010000:2.0:1787119495.097295:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986dc00 00000100:00100000:3.0:1787119495.097516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.097636:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633442560 00000100:00100000:2.0:1787119495.097641:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633442560 00002000:00100000:2.0:1787119495.097659:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (6119424->47090097) req@ffff92a62041df80 x1873929633442560/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.097668:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041df80 with x1873929633442560 ext(6119424->47090097) 00002000:00010000:2.0:1787119495.097671:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041df80 00000100:00100000:2.0:1787119495.097695:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10136 00000100:00100000:2.0:1787119495.097704:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633442560:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119495.098097:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633442432 00000100:00100000:1.0:1787119495.098102:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633442432 00000100:00100000:1.0:1787119495.098171:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5055 00000100:00100000:1.0:1787119495.098179:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633442432:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119495.103725:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633442304:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7289us (7993us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119495.103740:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10134 00002000:00100000:1.0:1787119495.103752:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (7610368->7675903) req@ffff92a50986c000 x1873929633442304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.103762:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c000 with x1873929633442304 ext(7610368->7675903) 00002000:00010000:1.0:1787119495.103768:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c000 00000100:00100000:3.0:1787119495.105317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.105427:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633442688 00000100:00100000:2.0:1787119495.105459:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633442688 00002000:00100000:2.0:1787119495.105516:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (7634944->7639039) req@ffff92a5098a0700 x1873929633442688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.105527:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0700 with x1873929633442688 ext(7634944->7639039) 00002000:00010000:2.0:1787119495.105532:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0700 00000100:00100000:3.0:1787119495.109841:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10137 00000100:00100000:3.0:1787119495.109864:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633442688:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.109985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.110033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.110158:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633442688:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 301us (4849us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.110167:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10137 00002000:00100000:3.0:1787119495.110177:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (7634944->7639039) req@ffff92a5098a0700 x1873929633442688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.110188:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0700 with x1873929633442688 ext(7634944->7639039) 00002000:00010000:3.0:1787119495.110194:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0700 00000100:00100000:3.0:1787119495.110215:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633442816 00000100:00100000:3.0:1787119495.110222:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633442816 00002000:00100000:3.0:1787119495.110251:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (5844992->5910527) req@ffff92a519cded80 x1873929633442816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.110259:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cded80 with x1873929633442816 ext(5844992->5910527) 00002000:00010000:3.0:1787119495.110263:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cded80 00000100:00100000:3.0:1787119495.110286:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633442944 00000100:00100000:3.0:1787119495.110290:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633442944 00002000:00100000:3.0:1787119495.110304:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (2277376->2281471) req@ffff92a519cdf800 x1873929633442944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.110312:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf800 with x1873929633442944 ext(2277376->2281471) 00002000:00010000:3.0:1787119495.110315:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf800 00000100:00100000:1.0:1787119495.110315:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10138 00000100:00100000:1.0:1787119495.110323:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633442816:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.110338:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10139 00000100:00100000:3.0:1787119495.110345:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633442944:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.111571:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633442560:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 13861us (14047us total) trans 4294968890 rc 0/0 00000100:00100000:2.0:1787119495.111583:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10136 00002000:00100000:2.0:1787119495.111594:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (6119424->47090097) req@ffff92a62041df80 x1873929633442560/t4294968890(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.111603:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041df80 with x1873929633442560 ext(6119424->47090097) 00002000:00010000:2.0:1787119495.111608:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041df80 00000100:00100000:3.0:1787119495.113732:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633442944:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3376us (3688us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.113745:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10139 00002000:00100000:3.0:1787119495.113755:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (2277376->2281471) req@ffff92a519cdf800 x1873929633442944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.113765:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf800 with x1873929633442944 ext(2277376->2281471) 00002000:00010000:3.0:1787119495.113771:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf800 00000100:00100000:2.0:1787119495.118592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.118683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.118722:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633443072 00000100:00100000:3.0:1787119495.118729:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633443200 00000100:00100000:3.0:1787119495.118733:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633443200 00000100:00100000:2.0:1787119495.118733:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633443072 00002000:00100000:2.0:1787119495.118780:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (7610368->7675903) req@ffff92a63eabd180 x1873929633443072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.118792:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd180 with x1873929633443072 ext(7610368->7675903) 00002000:00010000:2.0:1787119495.118797:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd180 00000100:00100000:3.0:1787119495.118822:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5056 00000100:00100000:3.0:1787119495.118832:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633443200:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119495.119098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.119221:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633442816:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8898us (9235us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119495.119225:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633443328 00000100:00100000:3.0:1787119495.119229:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633443328 00000100:00100000:1.0:1787119495.119229:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10138 00002000:00100000:1.0:1787119495.119236:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (5844992->5910527) req@ffff92a519cded80 x1873929633442816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.119244:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cded80 with x1873929633442816 ext(5844992->5910527) 00002000:00100000:3.0:1787119495.119246:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (2281472->2285567) req@ffff92a63dfbb100 x1873929633443328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00010000:1.0:1787119495.119248:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519cded80 00002000:00100000:3.0:1787119495.119254:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb100 with x1873929633443328 ext(2281472->2285567) 00002000:00010000:3.0:1787119495.119257:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb100 00000100:00100000:1.0:1787119495.119264:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10140 00000100:00100000:3.0:1787119495.119271:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10141 00000100:00100000:1.0:1787119495.119271:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633443072:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.119276:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633443328:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.119996:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633443328:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 714us (893us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.120005:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10141 00002000:00100000:3.0:1787119495.120012:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (2281472->2285567) req@ffff92a63dfbb100 x1873929633443328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.120020:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb100 with x1873929633443328 ext(2281472->2285567) 00002000:00010000:3.0:1787119495.120024:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb100 00000100:00100000:3.0:1787119495.131708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.131762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.131789:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633443456 00000100:00100000:3.0:1787119495.131798:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633443456 00002000:00100000:3.0:1787119495.131845:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (5910528->5947391) req@ffff92a50655fb80 x1873929633443456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.131855:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655fb80 with x1873929633443456 ext(5910528->5947391) 00002000:00010000:3.0:1787119495.131861:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655fb80 00000100:00100000:3.0:1787119495.131895:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633443584 00000100:00100000:3.0:1787119495.131898:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633443584 00002000:00100000:3.0:1787119495.131914:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (2256896->2322431) req@ffff92a50655c700 x1873929633443584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.131929:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c700 with x1873929633443584 ext(2256896->2322431) 00002000:00010000:3.0:1787119495.131933:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655c700 00000100:00100000:3.0:1787119495.131950:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10142 00000100:00100000:3.0:1787119495.131959:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633443456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.132036:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10143 00000100:00100000:0.0:1787119495.132045:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633443584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.137555:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633443072:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18269us (18959us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119495.137569:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10140 00002000:00100000:1.0:1787119495.137584:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (7610368->7675903) req@ffff92a63eabd180 x1873929633443072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.137595:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd180 with x1873929633443072 ext(7610368->7675903) 00002000:00010000:1.0:1787119495.137601:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd180 00010000:00010000:0.0:1787119495.139293:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119495.146240:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633443456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14268us (14527us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119495.146255:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10142 00002000:00100000:2.0:1787119495.146271:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (5910528->5947391) req@ffff92a50655fb80 x1873929633443456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.146282:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655fb80 with x1873929633443456 ext(5910528->5947391) 00002000:00010000:2.0:1787119495.146290:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655fb80 00000100:00100000:0.0:1787119495.153796:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633443584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 21741us (22022us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119495.153811:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10143 00002000:00100000:0.0:1787119495.153825:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (2256896->2322431) req@ffff92a50655c700 x1873929633443584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.153842:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c700 with x1873929633443584 ext(2256896->2322431) 00002000:00010000:0.0:1787119495.153848:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655c700 00000100:00100000:3.0:1787119495.155662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.155694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.156202:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633443712 00000100:00100000:2.0:1787119495.156211:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633443712 00002000:00100000:2.0:1787119495.156255:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (2277376->2281471) req@ffff92a50655ca80 x1873929633443712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.156267:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ca80 with x1873929633443712 ext(2277376->2281471) 00002000:00010000:2.0:1787119495.156272:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655ca80 00000100:00100000:2.0:1787119495.156299:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633443840 00000100:00100000:2.0:1787119495.156303:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633443840 00002000:00100000:2.0:1787119495.156320:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (5865472->34983935) req@ffff92a51282e300 x1873929633443840/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.156339:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e300 with x1873929633443840 ext(5865472->34983935) 00002000:00010000:2.0:1787119495.156342:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282e300 00000100:00100000:2.0:1787119495.156367:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10144 00000100:00100000:2.0:1787119495.156377:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633443712:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.156634:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633443712:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 257us (979us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.156642:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10144 00002000:00100000:2.0:1787119495.156649:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (2277376->2281471) req@ffff92a50655ca80 x1873929633443712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.156657:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ca80 with x1873929633443712 ext(2277376->2281471) 00002000:00010000:2.0:1787119495.156660:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655ca80 00000100:00100000:2.0:1787119495.156678:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10145 00000100:00100000:2.0:1787119495.156686:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633443840:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119495.159215:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633442432:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 61023us (62232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119495.159229:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5055 00000001:00080000:3.0:1787119495.159484:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969152 is committed 00000100:00100000:0.0:1787119495.164411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.164522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.164793:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633443968 00000100:00100000:3.0:1787119495.164804:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633443968 00002000:00100000:2.0:1787119495.164912:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (2277376->2318335) req@ffff92a506154700 x1873929633443968/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.164925:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154700 with x1873929633443968 ext(2277376->2318335) 00002000:00010000:2.0:1787119495.164931:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154700 00000100:00100000:2.0:1787119495.164958:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633444096 00000100:00100000:2.0:1787119495.164961:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633444096 00002000:00100000:2.0:1787119495.164976:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (2281472->2285567) req@ffff92a506155500 x1873929633444096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.164985:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155500 with x1873929633444096 ext(2281472->2285567) 00002000:00010000:2.0:1787119495.164988:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155500 00000100:00100000:2.0:1787119495.165013:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10146 00000100:00100000:2.0:1787119495.165022:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633443968:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119495.165276:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10147 00000100:00100000:3.0:1787119495.165285:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633444096:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.165580:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633444096:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 295us (1057us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.165589:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10147 00002000:00100000:3.0:1787119495.165596:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (2281472->2285567) req@ffff92a506155500 x1873929633444096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.165605:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155500 with x1873929633444096 ext(2281472->2285567) 00002000:00010000:3.0:1787119495.165609:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155500 00000100:00100000:0.0:1787119495.169717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.169801:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633444224 00000100:00100000:3.0:1787119495.169811:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633444224 00000100:00100000:3.0:1787119495.169872:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19651 00000100:00100000:3.0:1787119495.169881:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+134:32729:x1873929633444224:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119495.169901:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119495.169921:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e317a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d14 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.170000:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3181 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.170014:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.170025:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119495.170053:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 39439060 00000004:00200000:3.0:1787119495.170058:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119495.170077:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.170102:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e317a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d14 expref: 136 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.170120:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d14 expref: 135 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.170130:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119495.170133:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119495.170137:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00000100:00100000:3.0:1787119495.170190:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+135:32729:x1873929633444224:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 309us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119495.170198:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19651 00000100:00100000:0.0:1787119495.175293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.175376:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633444352 00000100:00100000:2.0:1787119495.175394:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633444352 00002000:00100000:2.0:1787119495.175460:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (7630848->7634943) req@ffff92a506155880 x1873929633444352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.175481:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155880 with x1873929633444352 ext(7630848->7634943) 00002000:00010000:2.0:1787119495.175486:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155880 00000100:00100000:2.0:1787119495.175518:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10148 00000100:00100000:2.0:1787119495.175527:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633444352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.175749:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633444352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 223us (466us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.175757:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10148 00002000:00100000:2.0:1787119495.175764:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (7630848->7634943) req@ffff92a506155880 x1873929633444352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.175773:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155880 with x1873929633444352 ext(7630848->7634943) 00002000:00010000:2.0:1787119495.175776:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155880 00000100:00100000:2.0:1787119495.177578:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633443840:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 20885us (21876us total) trans 4294968891 rc 0/0 00000100:00100000:2.0:1787119495.177590:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10145 00002000:00100000:2.0:1787119495.177599:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (5865472->34983935) req@ffff92a51282e300 x1873929633443840/t4294968891(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.177609:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e300 with x1873929633443840 ext(5865472->34983935) 00002000:00010000:2.0:1787119495.177615:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282e300 00000100:00100000:2.0:1787119495.179059:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633443968:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 14029us (14719us total) trans 4294969153 rc 0/0 00000100:00100000:2.0:1787119495.179070:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10146 00002000:00100000:2.0:1787119495.179079:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (2277376->2318335) req@ffff92a506154700 x1873929633443968/t4294969153(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.179088:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154700 with x1873929633443968 ext(2277376->2318335) 00002000:00010000:2.0:1787119495.179092:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154700 00000001:00080000:3.0:1787119495.180279:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968890 is committed 00000100:00100000:0.0:1787119495.180541:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633443200:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 61706us (61854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119495.180556:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5056 00000100:00100000:3.0:1787119495.182624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.182767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.182871:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633444480 00000100:00100000:1.0:1787119495.182881:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633444480 00002000:00100000:1.0:1787119495.182929:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (2256896->2322431) req@ffff92a51282c000 x1873929633444480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.182940:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c000 with x1873929633444480 ext(2256896->2322431) 00002000:00010000:1.0:1787119495.182946:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c000 00000100:00100000:1.0:1787119495.182976:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633444608 00000100:00100000:1.0:1787119495.182980:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633444608 00002000:00100000:1.0:1787119495.182996:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (7634944->7639039) req@ffff92a63414ad80 x1873929633444608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.183005:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ad80 with x1873929633444608 ext(7634944->7639039) 00002000:00010000:1.0:1787119495.183009:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414ad80 00000100:00100000:1.0:1787119495.183035:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10149 00000100:00100000:1.0:1787119495.183044:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633444480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.183557:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10150 00000100:00100000:3.0:1787119495.183568:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633444608:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.183868:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633444608:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 301us (1100us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.183877:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10150 00002000:00100000:3.0:1787119495.183884:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (7634944->7639039) req@ffff92a63414ad80 x1873929633444608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.183892:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ad80 with x1873929633444608 ext(7634944->7639039) 00002000:00010000:3.0:1787119495.183896:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414ad80 00000100:00100000:3.0:1787119495.187741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.187826:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633444864 00000100:00100000:1.0:1787119495.187835:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633444864 00000100:00100000:1.0:1787119495.187888:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19652 00000100:00100000:1.0:1787119495.187898:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+135:32724:x1873929633444864:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119495.187919:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119495.187939:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d1b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.188017:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e318f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.188028:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.188039:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119495.188058:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 47090098 00000004:00200000:1.0:1787119495.188062:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119495.188078:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.188103:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d1b expref: 137 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.188121:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e318f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d1b expref: 136 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.188128:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119495.188129:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119495.188132:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:1.0:1787119495.190586:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+136:32724:x1873929633444864:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 2678us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119495.190599:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19652 00000100:00100000:3.0:1787119495.194775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.194853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.194959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.195164:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633444480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12118us (12547us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119495.195175:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10149 00002000:00100000:2.0:1787119495.195187:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (2256896->2322431) req@ffff92a51282c000 x1873929633444480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.195207:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c000 with x1873929633444480 ext(2256896->2322431) 00002000:00010000:2.0:1787119495.195213:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c000 00000100:00100000:2.0:1787119495.195252:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633445120 00000100:00100000:2.0:1787119495.195259:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633445120 00002000:00100000:2.0:1787119495.195290:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (7610368->7675903) req@ffff92a634148700 x1873929633445120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.195299:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148700 with x1873929633445120 ext(7610368->7675903) 00002000:00010000:2.0:1787119495.195302:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148700 00000100:00100000:2.0:1787119495.195323:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10151 00000100:00100000:2.0:1787119495.195332:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633445120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.195989:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633444736 00000100:00100000:0.0:1787119495.195996:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633444736 00000100:00100000:0.0:1787119495.196069:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633444992 00000100:00100000:0.0:1787119495.196073:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633444992 00000100:00100000:2.0:1787119495.196114:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5057 00000100:00100000:2.0:1787119495.196122:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633444736:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119495.196255:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5058 00000100:00100000:2.0:1787119495.196263:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633444992:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119495.209538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.210380:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633445376 00000100:00100000:0.0:1787119495.210390:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633445376 00000100:00100000:0.0:1787119495.210459:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19653 00000100:00100000:0.0:1787119495.210478:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+136:32724:x1873929633445376:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119495.210537:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119495.210565:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e318f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d1b expref: 136 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.210584:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119495.210589:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119495.210778:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.210793:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.210805:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119495.210852:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976466 00000004:00010000:0.0:1787119495.210879:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfbe5f97 reply state 000000008e1cf861 transno 4294976467 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119495.210888:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119495.210985:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+138:32724:x1873929633445376:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 508us (1455us total) trans 4294976467 rc 0/0 00000100:00100000:0.0:1787119495.210993:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19653 00000020:00080000:0.0:1787119495.210998:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119495.211579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.211621:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633445504 00000100:00100000:2.0:1787119495.211626:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633445504 00002000:00100000:2.0:1787119495.211655:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (2277376->2318335) req@ffff92a63eabc000 x1873929633445504/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.211666:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633445504 ext(2277376->2318335) 00002000:00010000:2.0:1787119495.211672:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc000 00000100:00100000:2.0:1787119495.211691:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10152 00000100:00100000:2.0:1787119495.211698:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633445504:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119495.211859:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633445120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16528us (16898us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119495.211866:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10151 00002000:00100000:2.0:1787119495.211873:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (7610368->7675903) req@ffff92a634148700 x1873929633445120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.211881:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148700 with x1873929633445120 ext(7610368->7675903) 00002000:00010000:2.0:1787119495.211885:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148700 00000100:00100000:3.0:1787119495.217613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119495.217645:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.217658:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.217667:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.217674:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119495.217679:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.217686:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.217702:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119495.217704:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119495.217708:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.217714:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3196 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119495.217743:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633445632 00000100:00100000:3.0:1787119495.217752:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633445632 00002000:00010000:3.0:1787119495.217781:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (60381765->18446744073709551615) 00002000:00100000:3.0:1787119495.217785:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149180 with x1873929633445632 ext(60381765->18446744073709551615) 00002000:00010000:3.0:1787119495.217794:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634149180. 00000100:00100000:3.0:1787119495.217819:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10153 00000100:00100000:3.0:1787119495.217827:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633445632:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119495.218058:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 47090098 -> 60381765 00002000:00010000:3.0:1787119495.218062:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119493 -> 1787119493 00002000:00010000:3.0:1787119495.218064:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:3.0:1787119495.218067:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119493 -> 1787119493 00002000:00010000:3.0:1787119495.218069:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2447 -> 2831 00000100:00100000:3.0:1787119495.218111:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633445632:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 284us (507us total) trans 4294968892 rc 0/0 00000100:00100000:3.0:1787119495.218118:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10153 00002000:00010000:3.0:1787119495.218122:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (60381765->18446744073709551615) 00002000:00100000:3.0:1787119495.218125:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149180 with x1873929633445632 ext(60381765->18446744073709551615) 00002000:00010000:3.0:1787119495.218129:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634149180. 00000100:00100000:3.0:1787119495.218500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.218571:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633445760 00000100:00100000:1.0:1787119495.218576:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633445760 00002000:00100000:1.0:1787119495.218601:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (2277376->2281471) req@ffff92a63414a680 x1873929633445760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.218610:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414a680 with x1873929633445760 ext(2277376->2281471) 00002000:00010000:1.0:1787119495.218615:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414a680 00000100:00100000:1.0:1787119495.218638:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10154 00000100:00100000:1.0:1787119495.218645:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633445760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.218797:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633445760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 152us (297us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.218804:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10154 00002000:00100000:1.0:1787119495.218810:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (2277376->2281471) req@ffff92a63414a680 x1873929633445760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.218818:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414a680 with x1873929633445760 ext(2277376->2281471) 00002000:00010000:1.0:1787119495.218821:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414a680 00000100:00100000:2.0:1787119495.219673:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633445504:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 7971us (8091us total) trans 4294969154 rc 0/0 00000100:00100000:2.0:1787119495.219681:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10152 00002000:00100000:2.0:1787119495.219689:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (2277376->2318335) req@ffff92a63eabc000 x1873929633445504/t4294969154(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.219698:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633445504 ext(2277376->2318335) 00002000:00010000:2.0:1787119495.219701:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc000 00000100:00100000:1.0:1787119495.222812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.223852:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633445888 00000100:00100000:0.0:1787119495.223865:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633445888 00000100:00100000:0.0:1787119495.223923:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19654 00000100:00100000:0.0:1787119495.223933:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50600b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+137:32724:x1873929633445888:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119495.223955:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119495.223974:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e319d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d22 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.224059:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.224074:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.224084:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119495.224116:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 60381765 00000004:00200000:0.0:1787119495.224121:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119495.224142:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.224170:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e319d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d22 expref: 139 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.224188:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d22 expref: 138 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.224198:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119495.224202:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119495.224205:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fae00, rc 0) 00000100:00100000:0.0:1787119495.224268:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50600b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+138:32724:x1873929633445888:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 336us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119495.224276:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19654 00000100:00100000:2.0:1787119495.229202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.230599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.231252:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633446016 00000100:00100000:2.0:1787119495.231263:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633446016 00000100:00100000:2.0:1787119495.231314:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5059 00000100:00100000:2.0:1787119495.231326:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633446016:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119495.232703:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633446144 00000100:00100000:1.0:1787119495.232713:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633446144 00002000:00100000:1.0:1787119495.232750:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (2281472->2285567) req@ffff92a63eabdf80 x1873929633446144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.232762:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdf80 with x1873929633446144 ext(2281472->2285567) 00002000:00010000:1.0:1787119495.232769:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabdf80 00000100:00100000:1.0:1787119495.232789:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10155 00000100:00100000:1.0:1787119495.232797:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633446144:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.233022:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633446144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 224us (2428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.233030:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10155 00002000:00100000:1.0:1787119495.233036:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (2281472->2285567) req@ffff92a63eabdf80 x1873929633446144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.233045:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdf80 with x1873929633446144 ext(2281472->2285567) 00002000:00010000:1.0:1787119495.233049:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabdf80 00000100:00100000:1.0:1787119495.233118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.233297:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633446272 00000100:00100000:2.0:1787119495.233301:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633446272 00002000:00100000:2.0:1787119495.233325:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (49610752->49614847) req@ffff92a63414d500 x1873929633446272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.233347:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d500 with x1873929633446272 ext(49610752->49614847) 00002000:00010000:2.0:1787119495.233351:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414d500 00000100:00100000:2.0:1787119495.233376:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10156 00000100:00100000:2.0:1787119495.233384:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633446272:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.233565:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633446272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 181us (446us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.233572:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10156 00002000:00100000:2.0:1787119495.233578:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (49610752->49614847) req@ffff92a63414d500 x1873929633446272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.233586:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d500 with x1873929633446272 ext(49610752->49614847) 00002000:00010000:2.0:1787119495.233589:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414d500 00000001:00080000:3.0:1787119495.237598:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969153 is committed 00000100:00100000:2.0:1787119495.239544:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633444736:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 43413us (44770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119495.239557:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5057 00000001:00080000:1.0:1787119495.242298:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968891 is committed 00000100:00100000:2.0:1787119495.242544:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633444992:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 46276us (47684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119495.242556:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5058 00000100:00100000:1.0:1787119495.243141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.243176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.243201:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633446400 00000100:00100000:1.0:1787119495.243210:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633446400 00002000:00100000:1.0:1787119495.243252:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (2256896->2322431) req@ffff92a63414df80 x1873929633446400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.243263:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414df80 with x1873929633446400 ext(2256896->2322431) 00002000:00010000:1.0:1787119495.243268:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414df80 00000100:00100000:1.0:1787119495.243286:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633446528 00000100:00100000:1.0:1787119495.243289:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633446528 00002000:00100000:1.0:1787119495.243304:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (49614848->49618943) req@ffff92a6358ed050 x1873929633446528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.243313:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358ed050 with x1873929633446528 ext(49614848->49618943) 00002000:00010000:1.0:1787119495.243317:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6358ed050 00000100:00100000:1.0:1787119495.244321:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10157 00000100:00100000:1.0:1787119495.244380:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633446400:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.244941:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10158 00000100:00100000:1.0:1787119495.244952:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6358ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633446528:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.245087:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6358ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633446528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 136us (1910us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.245094:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10158 00002000:00100000:1.0:1787119495.245103:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (49614848->49618943) req@ffff92a6358ed050 x1873929633446528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.245114:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358ed050 with x1873929633446528 ext(49614848->49618943) 00002000:00010000:1.0:1787119495.245120:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6358ed050 00000100:00100000:1.0:1787119495.250614:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.250761:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633446656 00000100:00100000:3.0:1787119495.250773:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633446656 00002000:00100000:3.0:1787119495.250819:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (29941760->29945855) req@ffff92a63414f100 x1873929633446656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.250831:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f100 with x1873929633446656 ext(29941760->29945855) 00002000:00010000:3.0:1787119495.250837:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414f100 00000100:00100000:3.0:1787119495.250870:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10159 00000100:00100000:3.0:1787119495.250880:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633446656:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.251096:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633446656:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 216us (490us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.251104:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10159 00002000:00100000:3.0:1787119495.251111:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (29941760->29945855) req@ffff92a63414f100 x1873929633446656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.251120:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f100 with x1873929633446656 ext(29941760->29945855) 00002000:00010000:3.0:1787119495.251123:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414f100 00000100:00100000:2.0:1787119495.251667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.251903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.252191:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633446400:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7859us (9052us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119495.252202:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10157 00002000:00100000:0.0:1787119495.252210:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (2256896->2322431) req@ffff92a63414df80 x1873929633446400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.252220:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414df80 with x1873929633446400 ext(2256896->2322431) 00002000:00010000:0.0:1787119495.252226:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414df80 00000100:00100000:0.0:1787119495.257619:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633446912 00000100:00100000:0.0:1787119495.257633:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633446912 00002000:00100000:0.0:1787119495.257688:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (671744->675839) req@ffff92a63eabf100 x1873929633446912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.257701:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf100 with x1873929633446912 ext(671744->675839) 00002000:00010000:0.0:1787119495.257707:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabf100 00000100:00100000:0.0:1787119495.257735:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633446784 00000100:00100000:0.0:1787119495.257738:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633446784 00002000:00100000:0.0:1787119495.257753:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (49590272->49655807) req@ffff92a63eabe300 x1873929633446784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.257762:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe300 with x1873929633446784 ext(49590272->49655807) 00002000:00010000:0.0:1787119495.257766:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabe300 00000100:00100000:0.0:1787119495.257787:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10160 00000100:00100000:0.0:1787119495.257797:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633446912:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.258040:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633446912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 243us (6375us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.258049:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10160 00002000:00100000:0.0:1787119495.258056:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (671744->675839) req@ffff92a63eabf100 x1873929633446912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.258065:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf100 with x1873929633446912 ext(671744->675839) 00002000:00010000:0.0:1787119495.258068:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabf100 00000100:00100000:0.0:1787119495.258089:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10161 00000100:00100000:0.0:1787119495.258096:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633446784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.258975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.260657:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633447040 00000100:00100000:1.0:1787119495.260672:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633447040 00002000:00100000:1.0:1787119495.260720:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (2277376->2318335) req@ffff92a634148000 x1873929633447040/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.260733:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148000 with x1873929633447040 ext(2277376->2318335) 00002000:00010000:1.0:1787119495.260739:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148000 00000100:00100000:1.0:1787119495.260763:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10162 00000100:00100000:1.0:1787119495.260773:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633447040:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119495.260957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.261363:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633447168 00000100:00100000:3.0:1787119495.261369:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633447168 00002000:00100000:3.0:1787119495.261392:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (29945856->29949951) req@ffff92a63414e300 x1873929633447168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.261407:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414e300 with x1873929633447168 ext(29945856->29949951) 00002000:00010000:3.0:1787119495.261410:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414e300 00000100:00100000:3.0:1787119495.261454:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10163 00000100:00100000:3.0:1787119495.261470:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633447168:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.261652:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633447168:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 189us (695us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.263589:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10163 00002000:00100000:3.0:1787119495.263603:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (29945856->29949951) req@ffff92a63414e300 x1873929633447168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.263614:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414e300 with x1873929633447168 ext(29945856->29949951) 00002000:00010000:3.0:1787119495.263621:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414e300 00000001:00080000:3.0:1787119495.271326:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969154 is committed 00000100:00100000:2.0:1787119495.271565:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633446016:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 40235us (42368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119495.271576:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5059 00000100:00100000:3.0:1787119495.273218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.273794:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633447296 00000100:00100000:1.0:1787119495.273804:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633447296 00002000:00100000:1.0:1787119495.273844:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (675840->679935) req@ffff92a634149500 x1873929633447296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.273855:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149500 with x1873929633447296 ext(675840->679935) 00002000:00010000:1.0:1787119495.273861:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634149500 00000100:00100000:0.0:1787119495.274177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.274343:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633447424 00000100:00100000:3.0:1787119495.274347:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633447424 00002000:00100000:3.0:1787119495.274367:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (29921280->29986815) req@ffff92a506157800 x1873929633447424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.274384:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157800 with x1873929633447424 ext(29921280->29986815) 00002000:00010000:3.0:1787119495.274388:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506157800 00000100:00100000:3.0:1787119495.274414:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10164 00000100:00100000:3.0:1787119495.274422:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633447424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.275593:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633446784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17489us (23682us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119495.275604:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10161 00002000:00100000:2.0:1787119495.275613:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (49590272->49655807) req@ffff92a63eabe300 x1873929633446784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.275624:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe300 with x1873929633446784 ext(49590272->49655807) 00002000:00010000:2.0:1787119495.275628:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabe300 00000100:00100000:2.0:1787119495.281123:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10165 00000100:00100000:2.0:1787119495.281149:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633447296:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.281428:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633447296:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 291us (8216us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.281436:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10165 00002000:00100000:2.0:1787119495.281473:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (675840->679935) req@ffff92a634149500 x1873929633447296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.281483:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149500 with x1873929633447296 ext(675840->679935) 00002000:00010000:2.0:1787119495.281489:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634149500 00000100:00100000:2.0:1787119495.289548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.289636:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633447552 00000100:00100000:1.0:1787119495.289645:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633447552 00002000:00100000:1.0:1787119495.289688:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (29941760->29945855) req@ffff92a63eabce00 x1873929633447552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.289700:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabce00 with x1873929633447552 ext(29941760->29945855) 00002000:00010000:1.0:1787119495.289705:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabce00 00000100:00100000:1.0:1787119495.289738:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10166 00000100:00100000:1.0:1787119495.289748:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633447552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.289941:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633447552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 194us (402us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.289949:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10166 00002000:00100000:1.0:1787119495.289956:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (29941760->29945855) req@ffff92a63eabce00 x1873929633447552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.289964:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabce00 with x1873929633447552 ext(29941760->29945855) 00002000:00010000:1.0:1787119495.289967:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabce00 00000100:00100000:0.0:1787119495.290575:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633447040:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 29802us (31602us total) trans 4294969155 rc 0/0 00000100:00100000:0.0:1787119495.290588:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10162 00002000:00100000:0.0:1787119495.290596:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (2277376->2318335) req@ffff92a634148000 x1873929633447040/t4294969155(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.290604:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148000 with x1873929633447040 ext(2277376->2318335) 00002000:00010000:0.0:1787119495.290608:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148000 00000100:00100000:3.0:1787119495.291252:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633447424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16827us (17072us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119495.291264:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10164 00002000:00100000:3.0:1787119495.291272:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (29921280->29986815) req@ffff92a506157800 x1873929633447424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.291280:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157800 with x1873929633447424 ext(29921280->29986815) 00002000:00010000:3.0:1787119495.291284:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506157800 00000100:00100000:2.0:1787119495.301794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.301959:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633447680 00000100:00100000:3.0:1787119495.301970:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633447680 00002000:00100000:3.0:1787119495.302019:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (651264->716799) req@ffff92a63eabea00 x1873929633447680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.302031:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabea00 with x1873929633447680 ext(651264->716799) 00002000:00010000:3.0:1787119495.302037:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabea00 00000100:00100000:3.0:1787119495.302158:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10167 00000100:00100000:3.0:1787119495.302170:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633447680:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.306635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.306954:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633447808 00000100:00100000:1.0:1787119495.306964:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633447808 00002000:00100000:1.0:1787119495.307013:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (49610752->49647615) req@ffff92a634149f80 x1873929633447808/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.307025:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149f80 with x1873929633447808 ext(49610752->49647615) 00002000:00010000:1.0:1787119495.307031:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634149f80 00000100:00100000:1.0:1787119495.307116:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10168 00000100:00100000:1.0:1787119495.307125:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633447808:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119495.313991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.315614:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633448064 00000100:00100000:0.0:1787119495.315628:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633448064 00000100:00100000:0.0:1787119495.315702:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5060 00000100:00100000:0.0:1787119495.315712:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633448064:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119495.325215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.325397:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633447936 00000100:00100000:3.0:1787119495.325410:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633447936 00002000:00100000:3.0:1787119495.325495:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (29945856->29949951) req@ffff92a506154380 x1873929633447936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.325508:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154380 with x1873929633447936 ext(29945856->29949951) 00002000:00010000:3.0:1787119495.325515:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154380 00000100:00100000:3.0:1787119495.325546:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10169 00000100:00100000:3.0:1787119495.325557:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633447936:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.325802:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633447936:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 246us (596us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.325811:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10169 00002000:00100000:3.0:1787119495.325818:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (29945856->29949951) req@ffff92a506154380 x1873929633447936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.325827:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154380 with x1873929633447936 ext(29945856->29949951) 00002000:00010000:3.0:1787119495.325831:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154380 00000100:00100000:3.0:1787119495.325915:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633447680:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 23747us (24133us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119495.325923:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10167 00002000:00100000:3.0:1787119495.325928:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (651264->716799) req@ffff92a63eabea00 x1873929633447680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.325937:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabea00 with x1873929633447680 ext(651264->716799) 00002000:00010000:3.0:1787119495.325941:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabea00 00000100:00100000:3.0:1787119495.327509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.327840:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633448192 00000100:00100000:2.0:1787119495.327849:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633448192 00000100:00100000:1.0:1787119495.327913:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633447808:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 20787us (21287us total) trans 4294968893 rc 0/0 00000100:00100000:1.0:1787119495.327923:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10168 00002000:00100000:1.0:1787119495.327933:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (49610752->49647615) req@ffff92a634149f80 x1873929633447808/t4294968893(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.327943:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149f80 with x1873929633447808 ext(49610752->49647615) 00002000:00010000:1.0:1787119495.327948:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634149f80 00002000:00100000:2.0:1787119495.328262:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (29986816->30023679) req@ffff92a63414b100 x1873929633448192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.328271:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414b100 with x1873929633448192 ext(29986816->30023679) 00002000:00010000:2.0:1787119495.328274:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414b100 00000100:00100000:2.0:1787119495.328301:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10170 00000100:00100000:2.0:1787119495.328309:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633448192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.333363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.333479:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633448320 00000100:00100000:2.0:1787119495.333489:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633448320 00002000:00100000:2.0:1787119495.333537:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (29921280->29986815) req@ffff92a63414a300 x1873929633448320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.333549:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414a300 with x1873929633448320 ext(29921280->29986815) 00002000:00010000:2.0:1787119495.333554:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414a300 00000100:00100000:2.0:1787119495.333591:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10171 00000100:00100000:2.0:1787119495.333600:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633448320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.334116:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633448192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5805us (6612us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119495.334124:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10170 00002000:00100000:3.0:1787119495.334132:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (29986816->30023679) req@ffff92a63414b100 x1873929633448192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.334141:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414b100 with x1873929633448192 ext(29986816->30023679) 00002000:00010000:3.0:1787119495.334144:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414b100 00000100:00100000:3.0:1787119495.338258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.338291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.338338:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633448576 00000100:00100000:3.0:1787119495.338347:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633448576 00002000:00100000:3.0:1787119495.338401:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (6119424->6123519) req@ffff92a63414aa00 x1873929633448576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.338412:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414aa00 with x1873929633448576 ext(6119424->6123519) 00002000:00010000:3.0:1787119495.338418:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414aa00 00000100:00100000:3.0:1787119495.338483:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10172 00000100:00100000:3.0:1787119495.338492:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633448576:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.338741:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633448576:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 250us (447us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.338749:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10172 00002000:00100000:3.0:1787119495.338755:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (6119424->6123519) req@ffff92a63414aa00 x1873929633448576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.338762:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414aa00 with x1873929633448576 ext(6119424->6123519) 00002000:00010000:3.0:1787119495.338766:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414aa00 00000100:00100000:3.0:1787119495.339328:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633448320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5727us (5973us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119495.339336:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10171 00002000:00100000:3.0:1787119495.339343:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (29921280->29986815) req@ffff92a63414a300 x1873929633448320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.339351:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414a300 with x1873929633448320 ext(29921280->29986815) 00002000:00010000:3.0:1787119495.339355:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414a300 00000100:00100000:2.0:1787119495.340197:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633448448 00000100:00100000:2.0:1787119495.340206:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633448448 00000100:00100000:2.0:1787119495.340244:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5061 00000100:00100000:2.0:1787119495.340253:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633448448:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119495.350048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.350082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.350123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.350149:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633448704 00000100:00100000:1.0:1787119495.350159:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633448704 00002000:00100000:1.0:1787119495.350204:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (6172672->6176767) req@ffff92a63414ce00 x1873929633448704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.350215:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ce00 with x1873929633448704 ext(6172672->6176767) 00002000:00010000:1.0:1787119495.350221:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414ce00 00000100:00100000:1.0:1787119495.350240:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633448832 00000100:00100000:1.0:1787119495.350243:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633448832 00002000:00100000:1.0:1787119495.350258:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (29941760->30011391) req@ffff92a63414ea00 x1873929633448832/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.350267:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ea00 with x1873929633448832 ext(29941760->30011391) 00002000:00010000:1.0:1787119495.350270:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414ea00 00000100:00100000:1.0:1787119495.350282:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633448960 00000100:00100000:1.0:1787119495.350284:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633448960 00002000:00100000:1.0:1787119495.350296:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (29986816->30023679) req@ffff92a63414d880 x1873929633448960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.350304:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d880 with x1873929633448960 ext(29986816->30023679) 00002000:00010000:1.0:1787119495.350307:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414d880 00000100:00100000:1.0:1787119495.350321:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10173 00000100:00100000:2.0:1787119495.351180:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10174 00000100:00100000:1.0:1787119495.351180:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633448704:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.351190:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633448832:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119495.351999:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10175 00000100:00100000:0.0:1787119495.352014:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633448960:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.353411:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633448704:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2233us (3366us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.353424:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10173 00002000:00100000:1.0:1787119495.353436:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (6172672->6176767) req@ffff92a63414ce00 x1873929633448704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.353460:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ce00 with x1873929633448704 ext(6172672->6176767) 00002000:00010000:1.0:1787119495.353476:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414ce00 00000100:00100000:0.0:1787119495.365373:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633448832:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 14167us (15272us total) trans 4294969156 rc 0/0 00000100:00100000:0.0:1787119495.365388:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10174 00002000:00100000:0.0:1787119495.365400:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (29941760->30011391) req@ffff92a63414ea00 x1873929633448832/t4294969156(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.365411:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ea00 with x1873929633448832 ext(29941760->30011391) 00002000:00010000:0.0:1787119495.365417:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414ea00 00000100:00100000:0.0:1787119495.374560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.375267:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633448960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 23253us (25139us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119495.375279:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10175 00002000:00100000:0.0:1787119495.375293:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (29986816->30023679) req@ffff92a63414d880 x1873929633448960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.375302:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d880 with x1873929633448960 ext(29986816->30023679) 00002000:00010000:0.0:1787119495.375307:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414d880 00000001:00080000:1.0:1787119495.375627:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969155 is committed 00000100:00100000:0.0:1787119495.375708:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633448064:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 59997us (61725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119495.375716:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5060 00000100:00100000:0.0:1787119495.375732:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633449088 00000100:00100000:0.0:1787119495.375738:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633449088 00000100:00100000:0.0:1787119495.375817:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5062 00000100:00100000:0.0:1787119495.375826:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633449088:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119495.389141:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633448448:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 48877us (50880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119495.389160:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5061 00000001:00080000:2.0:1787119495.389846:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968893 is committed 00000100:00100000:2.0:1787119495.394232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.394304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.394421:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633449344 00000100:00100000:1.0:1787119495.394431:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633449344 00000100:00100000:1.0:1787119495.394517:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19655 00000100:00100000:1.0:1787119495.394527:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+138:32720:x1873929633449344:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119495.394576:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119495.394603:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e30f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ce3 expref: 138 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.394635:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119495.394639:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119495.394994:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.395009:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.395019:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119495.395065:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976468 00000004:00010000:1.0:1787119495.395086:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd89812e reply state 0000000005632775 transno 4294976469 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119495.395096:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119495.395177:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+140:32720:x1873929633449344:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 650us (951us total) trans 4294976469 rc 0/0 00000100:00100000:1.0:1787119495.395183:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19655 00000020:00080000:1.0:1787119495.395188:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119495.396379:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633449472 00000100:00100000:0.0:1787119495.396391:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633449472 00002000:00100000:0.0:1787119495.396474:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (29941760->30011391) req@ffff92a63eabc380 x1873929633449472/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.396486:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc380 with x1873929633449472 ext(29941760->30011391) 00002000:00010000:0.0:1787119495.396491:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc380 00000100:00100000:0.0:1787119495.396516:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10176 00000100:00100000:0.0:1787119495.396525:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633449472:12345-192.168.201.59@tcp:4:fsx.0 00010000:00010000:1.0:1787119495.400848:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.400870:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.400878:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.400885:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119495.400890:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.401171:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.401189:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119495.401192:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119495.401197:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.401203:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e31ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.401400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.401474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.401514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.401540:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633449728 00000100:00100000:2.0:1787119495.401550:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633449728 00002000:00100000:2.0:1787119495.401594:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (29941760->29945855) req@ffff92a63eabed80 x1873929633449728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.401604:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabed80 with x1873929633449728 ext(29941760->29945855) 00002000:00010000:2.0:1787119495.401609:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabed80 00000100:00100000:2.0:1787119495.401629:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633449600 00000100:00100000:2.0:1787119495.401632:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633449600 00002000:00100000:2.0:1787119495.401646:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (21331968->21336063) req@ffff92a63eabf800 x1873929633449600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.401654:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf800 with x1873929633449600 ext(21331968->21336063) 00002000:00010000:2.0:1787119495.401657:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabf800 00000100:00100000:2.0:1787119495.401669:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633449856 00000100:00100000:2.0:1787119495.401672:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633449856 00002000:00010000:2.0:1787119495.401682:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (47090098->18446744073709551615) 00002000:00100000:2.0:1787119495.401685:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf480 with x1873929633449856 ext(47090098->18446744073709551615) 00002000:00010000:2.0:1787119495.401696:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabf480. 00000100:00100000:2.0:1787119495.401716:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10177 00000100:00100000:2.0:1787119495.401726:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633449728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.402099:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633449728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 373us (703us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.402108:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10177 00002000:00100000:2.0:1787119495.402114:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (29941760->29945855) req@ffff92a63eabed80 x1873929633449728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.402122:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabed80 with x1873929633449728 ext(29941760->29945855) 00002000:00010000:2.0:1787119495.402126:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabed80 00000100:00100000:2.0:1787119495.402146:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10178 00000100:00100000:2.0:1787119495.402157:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633449600:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.402281:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633449600:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 128us (807us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.402289:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10178 00002000:00100000:2.0:1787119495.402295:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (21331968->21336063) req@ffff92a63eabf800 x1873929633449600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.402304:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf800 with x1873929633449600 ext(21331968->21336063) 00002000:00010000:2.0:1787119495.402307:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabf800 00000100:00100000:2.0:1787119495.402323:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10179 00000100:00100000:2.0:1787119495.402331:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633449856:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119495.402572:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 39439060 -> 47090098 00002000:00010000:2.0:1787119495.402576:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119492 -> 1787119494 00002000:00010000:2.0:1787119495.402578:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119495.402580:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119492 -> 1787119494 00002000:00010000:2.0:1787119495.402582:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1293 -> 2447 00000100:00100000:2.0:1787119495.402613:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633449856:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 283us (1099us total) trans 4294968894 rc 0/0 00000100:00100000:2.0:1787119495.402623:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10179 00002000:00010000:2.0:1787119495.402627:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (47090098->18446744073709551615) 00002000:00100000:2.0:1787119495.402629:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf480 with x1873929633449856 ext(47090098->18446744073709551615) 00002000:00010000:2.0:1787119495.402635:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabf480. 00000100:00100000:3.0:1787119495.402743:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633449472:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 6217us (8436us total) trans 4294969157 rc 0/0 00000100:00100000:3.0:1787119495.402753:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10176 00002000:00100000:3.0:1787119495.402760:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (29941760->30011391) req@ffff92a63eabc380 x1873929633449472/t4294969157(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.402770:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc380 with x1873929633449472 ext(29941760->30011391) 00002000:00010000:3.0:1787119495.402774:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc380 00000100:00100000:0.0:1787119495.408223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.408265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.408290:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633449984 00000100:00100000:2.0:1787119495.408303:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633449984 00000100:00100000:0.0:1787119495.408335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.408369:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5063 00000100:00100000:2.0:1787119495.408379:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633449984:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119495.408402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.408493:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633450112 00000100:00100000:3.0:1787119495.408498:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633450112 00002000:00100000:3.0:1787119495.408527:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (21336064->21340159) req@ffff92a506154700 x1873929633450112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.408538:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154700 with x1873929633450112 ext(21336064->21340159) 00002000:00010000:3.0:1787119495.408543:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506154700 00000100:00100000:3.0:1787119495.408567:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633450240 00000100:00100000:3.0:1787119495.408570:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633450240 00002000:00100000:3.0:1787119495.408586:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (29945856->29949951) req@ffff92a506156a00 x1873929633450240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.408594:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156a00 with x1873929633450240 ext(29945856->29949951) 00002000:00010000:3.0:1787119495.408599:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156a00 00000100:00100000:3.0:1787119495.408615:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10180 00000100:00100000:3.0:1787119495.408624:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633450112:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.408823:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10181 00000100:00100000:3.0:1787119495.409014:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633450112:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 390us (747us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.409024:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10180 00002000:00100000:3.0:1787119495.409031:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (21336064->21340159) req@ffff92a506154700 x1873929633450112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.409040:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154700 with x1873929633450112 ext(21336064->21340159) 00002000:00010000:3.0:1787119495.409044:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506154700 00000100:00100000:2.0:1787119495.409137:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633450240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.409303:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633450368 00000100:00100000:3.0:1787119495.409308:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633450368 00002000:00100000:3.0:1787119495.409325:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (47054848->47058943) req@ffff92a506157480 x1873929633450368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.409335:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157480 with x1873929633450368 ext(47054848->47058943) 00002000:00010000:3.0:1787119495.409338:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506157480 00000100:00100000:2.0:1787119495.409479:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633450240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 647us (1142us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.409487:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10181 00002000:00100000:2.0:1787119495.409494:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (29945856->29949951) req@ffff92a506156a00 x1873929633450240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.409503:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156a00 with x1873929633450240 ext(29945856->29949951) 00002000:00010000:2.0:1787119495.409508:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156a00 00000100:00100000:3.0:1787119495.409587:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10182 00000100:00100000:3.0:1787119495.409597:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633450368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.409745:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633450368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 148us (1342us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.409753:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10182 00002000:00100000:3.0:1787119495.409759:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (47054848->47058943) req@ffff92a506157480 x1873929633450368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.409768:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157480 with x1873929633450368 ext(47054848->47058943) 00002000:00010000:3.0:1787119495.409772:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506157480 00000100:00100000:3.0:1787119495.413883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.414049:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633450496 00000100:00100000:0.0:1787119495.414126:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633450496 00002000:00100000:0.0:1787119495.414174:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (47058944->47063039) req@ffff92a634149880 x1873929633450496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.414186:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149880 with x1873929633450496 ext(47058944->47063039) 00002000:00010000:0.0:1787119495.414192:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634149880 00000100:00100000:0.0:1787119495.414224:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10183 00000100:00100000:0.0:1787119495.414234:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633450496:12345-192.168.201.59@tcp:3:fsx.0 00000001:00080000:1.0:1787119495.414727:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969156 is committed 00000100:00100000:3.0:1787119495.414892:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633449088:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 39065us (40340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119495.414906:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5062 00000100:00100000:0.0:1787119495.415138:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633450496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 904us (1262us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.415148:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10183 00002000:00100000:0.0:1787119495.415156:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (47058944->47063039) req@ffff92a634149880 x1873929633450496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.415166:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149880 with x1873929633450496 ext(47058944->47063039) 00002000:00010000:0.0:1787119495.415171:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634149880 00000100:00100000:0.0:1787119495.424239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.424267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.424290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.424796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.425087:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633450624 00000100:00100000:2.0:1787119495.425098:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633450624 00002000:00100000:2.0:1787119495.425148:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (21311488->21377023) req@ffff92a506156300 x1873929633450624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.425159:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156300 with x1873929633450624 ext(21311488->21377023) 00002000:00010000:2.0:1787119495.425165:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506156300 00000100:00100000:2.0:1787119495.425196:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633450752 00000100:00100000:2.0:1787119495.425200:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633450752 00002000:00100000:2.0:1787119495.425229:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (29921280->29986815) req@ffff92a506155180 x1873929633450752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.425237:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155180 with x1873929633450752 ext(29921280->29986815) 00002000:00010000:2.0:1787119495.425241:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155180 00000100:00100000:2.0:1787119495.425259:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633451008 00000100:00100000:2.0:1787119495.425263:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633451008 00002000:00100000:2.0:1787119495.425278:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (34930688->34934783) req@ffff92a506154000 x1873929633451008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.425286:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154000 with x1873929633451008 ext(34930688->34934783) 00002000:00010000:2.0:1787119495.425290:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154000 00000100:00100000:2.0:1787119495.425304:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633450880 00000100:00100000:2.0:1787119495.425307:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633450880 00002000:00100000:2.0:1787119495.425337:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (47034368->47091711) req@ffff92a506155c00 x1873929633450880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.425345:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155c00 with x1873929633450880 ext(47034368->47091711) 00002000:00010000:2.0:1787119495.425348:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155c00 00000100:00100000:2.0:1787119495.425367:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10184 00000100:00100000:2.0:1787119495.425376:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633450624:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.425820:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10185 00000100:00100000:2.0:1787119495.425829:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633450752:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.425979:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10186 00000100:00100000:2.0:1787119495.425989:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633451008:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.426119:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633451008:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 131us (1826us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.426127:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10186 00002000:00100000:2.0:1787119495.426134:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (34930688->34934783) req@ffff92a506154000 x1873929633451008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.426142:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506154000 with x1873929633451008 ext(34930688->34934783) 00002000:00010000:2.0:1787119495.426146:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506154000 00000100:00100000:2.0:1787119495.426168:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10187 00000100:00100000:2.0:1787119495.426177:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633450880:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.441257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.441359:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633451136 00000100:00100000:3.0:1787119495.441369:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633451136 00002000:00100000:3.0:1787119495.441416:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (34979840->34983935) req@ffff92a63eabca80 x1873929633451136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.441428:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabca80 with x1873929633451136 ext(34979840->34983935) 00002000:00010000:3.0:1787119495.441435:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabca80 00000100:00100000:3.0:1787119495.441497:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10188 00000100:00100000:3.0:1787119495.441509:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633451136:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.441562:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633450624:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16185us (17334us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119495.441572:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10184 00002000:00100000:2.0:1787119495.441581:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (21311488->21377023) req@ffff92a506156300 x1873929633450624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.441590:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156300 with x1873929633450624 ext(21311488->21377023) 00002000:00010000:2.0:1787119495.441594:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506156300 00000100:00100000:3.0:1787119495.441712:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633451136:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 205us (464us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.441720:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10188 00002000:00100000:3.0:1787119495.441726:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (34979840->34983935) req@ffff92a63eabca80 x1873929633451136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.441800:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabca80 with x1873929633451136 ext(34979840->34983935) 00002000:00010000:3.0:1787119495.441804:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabca80 00000100:00100000:2.0:1787119495.442495:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633450752:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16664us (18223us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119495.442506:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10185 00002000:00100000:2.0:1787119495.442513:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (29921280->29986815) req@ffff92a506155180 x1873929633450752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.442522:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155180 with x1873929633450752 ext(29921280->29986815) 00002000:00010000:2.0:1787119495.442527:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155180 00000100:00100000:2.0:1787119495.442596:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633450880:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16419us (17799us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1787119495.442603:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10187 00002000:00100000:2.0:1787119495.442609:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (47034368->47091711) req@ffff92a506155c00 x1873929633450880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.442617:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155c00 with x1873929633450880 ext(47034368->47091711) 00002000:00010000:2.0:1787119495.442621:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506155c00 00000100:00100000:0.0:1787119495.461991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.462285:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633451264 00000100:00100000:1.0:1787119495.462295:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633451264 00002000:00100000:1.0:1787119495.462345:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (20422656->20426751) req@ffff92a506156680 x1873929633451264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.462355:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156680 with x1873929633451264 ext(20422656->20426751) 00002000:00010000:1.0:1787119495.462361:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156680 00000100:00100000:1.0:1787119495.464302:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10189 00000100:00100000:1.0:1787119495.464321:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633451264:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.464627:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633451264:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 312us (2647us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.464635:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10189 00002000:00100000:1.0:1787119495.464644:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (20422656->20426751) req@ffff92a506156680 x1873929633451264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.464654:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156680 with x1873929633451264 ext(20422656->20426751) 00002000:00010000:1.0:1787119495.464660:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156680 00000100:00100000:2.0:1787119495.468396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.471191:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633451392 00000100:00100000:0.0:1787119495.471206:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633451392 00002000:00100000:0.0:1787119495.471261:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (55529472->55570431) req@ffff92a63eabc700 x1873929633451392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.471272:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633451392 ext(55529472->55570431) 00002000:00010000:0.0:1787119495.471278:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabc700 00000100:00100000:0.0:1787119495.471313:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10190 00000100:00100000:0.0:1787119495.471322:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633451392:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.474966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.475318:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633451520 00000100:00100000:0.0:1787119495.475436:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633451520 00002000:00100000:0.0:1787119495.475925:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (29986816->30023679) req@ffff92a63414bb80 x1873929633451520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.475937:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414bb80 with x1873929633451520 ext(29986816->30023679) 00002000:00010000:0.0:1787119495.475944:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414bb80 00000100:00100000:0.0:1787119495.475979:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10191 00000100:00100000:0.0:1787119495.475988:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633451520:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.478843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.478916:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633451648 00000100:00100000:3.0:1787119495.478926:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633451648 00002000:00100000:3.0:1787119495.478967:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (6119424->47090097) req@ffff92a63eabdc00 x1873929633451648/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.478979:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdc00 with x1873929633451648 ext(6119424->47090097) 00002000:00010000:3.0:1787119495.478984:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabdc00 00000100:00100000:3.0:1787119495.479014:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10192 00000100:00100000:3.0:1787119495.479023:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633451648:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119495.479729:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633449984:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 71348us (71514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119495.479739:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5063 00000100:00100000:0.0:1787119495.479893:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633451392:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8569us (11504us total) trans 0 rc 40960/40960 00000100:00100000:0.0:1787119495.479901:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10190 00002000:00100000:0.0:1787119495.479909:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (55529472->55570431) req@ffff92a63eabc700 x1873929633451392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.479919:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633451392 ext(55529472->55570431) 00002000:00010000:0.0:1787119495.479923:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabc700 00000001:00080000:1.0:1787119495.480355:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969157 is committed 00000100:00100000:3.0:1787119495.491322:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.491763:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633451520:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15773us (16802us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119495.491775:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10191 00002000:00100000:0.0:1787119495.491789:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (29986816->30023679) req@ffff92a63414bb80 x1873929633451520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.491798:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414bb80 with x1873929633451520 ext(29986816->30023679) 00002000:00010000:0.0:1787119495.491805:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414bb80 00000100:00100000:0.0:1787119495.491831:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633451776 00000100:00100000:0.0:1787119495.491838:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633451776 00002000:00100000:0.0:1787119495.491869:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (5865472->5869567) req@ffff92a634148380 x1873929633451776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.491876:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148380 with x1873929633451776 ext(5865472->5869567) 00002000:00010000:0.0:1787119495.491880:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148380 00000100:00100000:0.0:1787119495.491904:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10193 00000100:00100000:0.0:1787119495.491912:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633451776:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.492091:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633451776:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 179us (780us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.492097:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10193 00002000:00100000:0.0:1787119495.492103:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (5865472->5869567) req@ffff92a634148380 x1873929633451776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.492111:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148380 with x1873929633451776 ext(5865472->5869567) 00002000:00010000:0.0:1787119495.492115:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148380 00000100:00100000:3.0:1787119495.497532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.497697:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633451904 00000100:00100000:2.0:1787119495.497706:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633451904 00002000:00100000:2.0:1787119495.497753:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (9777152->9781247) req@ffff92a63414ad80 x1873929633451904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.497766:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ad80 with x1873929633451904 ext(9777152->9781247) 00002000:00010000:2.0:1787119495.497771:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414ad80 00000100:00100000:2.0:1787119495.497804:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10194 00000100:00100000:2.0:1787119495.497813:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633451904:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.498024:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633451904:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 211us (510us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.498032:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10194 00002000:00100000:2.0:1787119495.498038:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (9777152->9781247) req@ffff92a63414ad80 x1873929633451904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.498046:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ad80 with x1873929633451904 ext(9777152->9781247) 00002000:00010000:2.0:1787119495.498049:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414ad80 00000100:00100000:0.0:1787119495.499028:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633451648:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 20001us (20190us total) trans 4294968895 rc 0/0 00000100:00100000:0.0:1787119495.499038:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10192 00002000:00100000:0.0:1787119495.499047:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (6119424->47090097) req@ffff92a63eabdc00 x1873929633451648/t4294968895(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.499056:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdc00 with x1873929633451648 ext(6119424->47090097) 00002000:00010000:0.0:1787119495.499060:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabdc00 00000100:00100000:3.0:1787119495.502507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.505709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.508450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.513611:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633452032 00000100:00100000:0.0:1787119495.513626:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633452032 00002000:00100000:1.0:1787119495.513781:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (34930688->34934783) req@ffff92a634148700 x1873929633452032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.513793:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148700 with x1873929633452032 ext(34930688->34934783) 00002000:00010000:1.0:1787119495.513800:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148700 00000100:00100000:1.0:1787119495.513844:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633452160 00000100:00100000:1.0:1787119495.513848:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633452160 00002000:00100000:1.0:1787119495.513866:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (5869568->5873663) req@ffff92a63eabd180 x1873929633452160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.513880:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd180 with x1873929633452160 ext(5869568->5873663) 00002000:00010000:1.0:1787119495.513883:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd180 00000100:00100000:1.0:1787119495.513900:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10195 00000100:00100000:1.0:1787119495.513909:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633452032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.514165:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633452032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 255us (11666us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.514173:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10195 00002000:00100000:1.0:1787119495.514180:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (34930688->34934783) req@ffff92a634148700 x1873929633452032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.514188:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148700 with x1873929633452032 ext(34930688->34934783) 00002000:00010000:1.0:1787119495.514192:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148700 00000100:00100000:1.0:1787119495.514224:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10196 00000100:00100000:1.0:1787119495.514232:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633452160:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.514430:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633452160:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 197us (8732us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.514471:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10196 00002000:00100000:1.0:1787119495.514480:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (5869568->5873663) req@ffff92a63eabd180 x1873929633452160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.514487:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd180 with x1873929633452160 ext(5869568->5873663) 00002000:00010000:1.0:1787119495.514491:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd180 00000100:00100000:2.0:1787119495.515822:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.519024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.520589:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633452288 00000100:00100000:3.0:1787119495.520604:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633452288 00000100:00100000:3.0:1787119495.520639:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633452544 00000100:00100000:3.0:1787119495.520643:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633452544 00000100:00100000:3.0:1787119495.520701:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5064 00000100:00100000:3.0:1787119495.520711:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633452544:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119495.524661:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633452416 00000100:00100000:0.0:1787119495.524678:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633452416 00002000:00100000:1.0:1787119495.525057:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (29941760->30011391) req@ffff92a63eabdf80 x1873929633452416/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.525074:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdf80 with x1873929633452416 ext(29941760->30011391) 00002000:00010000:1.0:1787119495.525079:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabdf80 00000100:00100000:1.0:1787119495.525107:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10197 00000100:00100000:1.0:1787119495.525116:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633452416:12345-192.168.201.59@tcp:4:fsx.0 00002000:00100000:2.0:1787119495.527138:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (9781248->9785343) req@ffff92a63eabc000 x1873929633452288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.527153:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633452288 ext(9781248->9785343) 00002000:00010000:2.0:1787119495.527159:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabc000 00000100:00100000:2.0:1787119495.527194:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10198 00000100:00100000:2.0:1787119495.527205:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633452288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.527436:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633452288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 233us (19007us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.528510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.528863:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633452672 00000100:00100000:0.0:1787119495.528873:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633452672 00002000:00100000:0.0:1787119495.528909:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (34979840->34983935) req@ffff92a634149180 x1873929633452672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.528920:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149180 with x1873929633452672 ext(34979840->34983935) 00002000:00010000:0.0:1787119495.528925:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634149180 00000100:00100000:0.0:1787119495.528957:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10199 00000100:00100000:0.0:1787119495.528965:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633452672:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.529147:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633452672:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 182us (640us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.529154:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10199 00002000:00100000:0.0:1787119495.529161:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (34979840->34983935) req@ffff92a634149180 x1873929633452672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.529169:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149180 with x1873929633452672 ext(34979840->34983935) 00002000:00010000:0.0:1787119495.529172:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634149180 00000100:00100000:2.0:1787119495.530705:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10198 00002000:00100000:2.0:1787119495.530718:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (9781248->9785343) req@ffff92a63eabc000 x1873929633452288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.530728:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633452288 ext(9781248->9785343) 00002000:00010000:2.0:1787119495.530732:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabc000 00000100:00100000:2.0:1787119495.549179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.549382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.549413:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.549467:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633452800 00000100:00100000:2.0:1787119495.549477:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633452800 00002000:00100000:2.0:1787119495.549625:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (5844992->5910527) req@ffff92a5098a4700 x1873929633452800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.549636:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633452800 ext(5844992->5910527) 00002000:00010000:2.0:1787119495.549642:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4700 00000100:00100000:2.0:1787119495.549674:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633452928 00000100:00100000:2.0:1787119495.549677:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633452928 00002000:00100000:2.0:1787119495.549694:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (9756672->9822207) req@ffff92a5098a5880 x1873929633452928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.549702:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5880 with x1873929633452928 ext(9756672->9822207) 00002000:00010000:2.0:1787119495.549706:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a5880 00000100:00100000:2.0:1787119495.549718:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633453056 00000100:00100000:2.0:1787119495.549721:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633453056 00002000:00100000:2.0:1787119495.549735:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (20422656->20426751) req@ffff92a5098a5500 x1873929633453056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119495.549746:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10200 00002000:00100000:2.0:1787119495.549747:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633453056 ext(20422656->20426751) 00002000:00010000:2.0:1787119495.549753:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5500 00000100:00100000:3.0:1787119495.549762:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633452800:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.549773:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10201 00000100:00100000:2.0:1787119495.549781:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633452928:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.550056:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10202 00000100:00100000:0.0:1787119495.550066:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633453056:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.556620:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633452416:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 31494us (40794us total) trans 4294969158 rc 0/0 00000100:00100000:1.0:1787119495.556636:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10197 00002000:00100000:1.0:1787119495.556649:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (29941760->30011391) req@ffff92a63eabdf80 x1873929633452416/t4294969158(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.556658:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdf80 with x1873929633452416 ext(29941760->30011391) 00002000:00010000:1.0:1787119495.556665:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabdf80 00000100:00100000:0.0:1787119495.557824:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633453056:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7754us (8404us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.557835:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10202 00002000:00100000:0.0:1787119495.557843:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (20422656->20426751) req@ffff92a5098a5500 x1873929633453056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.557864:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633453056 ext(20422656->20426751) 00002000:00010000:0.0:1787119495.557869:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5500 00000100:00100000:3.0:1787119495.583344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.583794:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633452800:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 34034us (34623us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119495.583806:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10200 00002000:00100000:3.0:1787119495.583820:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (5844992->5910527) req@ffff92a5098a4700 x1873929633452800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.583831:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633452800 ext(5844992->5910527) 00002000:00010000:3.0:1787119495.583837:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4700 00000100:00100000:0.0:1787119495.585129:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633452928:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 35269us (35667us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119495.585141:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10201 00002000:00100000:0.0:1787119495.585152:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (9756672->9822207) req@ffff92a5098a5880 x1873929633452928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.585163:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5880 with x1873929633452928 ext(9756672->9822207) 00002000:00010000:0.0:1787119495.585168:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a5880 00000100:00100000:2.0:1787119495.586282:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633453184 00000100:00100000:2.0:1787119495.586297:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633453184 00000100:00100000:2.0:1787119495.586362:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5065 00000100:00100000:2.0:1787119495.586380:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633453184:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119495.595794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.595829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.595856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.596037:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633453312 00000100:00100000:2.0:1787119495.596048:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633453312 00002000:00100000:2.0:1787119495.596109:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (5910528->5947391) req@ffff92a508da4380 x1873929633453312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.596122:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4380 with x1873929633453312 ext(5910528->5947391) 00002000:00010000:2.0:1787119495.596128:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4380 00000100:00100000:2.0:1787119495.596151:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633453440 00000100:00100000:2.0:1787119495.596154:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633453440 00002000:00100000:2.0:1787119495.596168:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (5865472->5869567) req@ffff92a508da6d80 x1873929633453440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.596183:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6d80 with x1873929633453440 ext(5865472->5869567) 00002000:00010000:2.0:1787119495.596187:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6d80 00000100:00100000:2.0:1787119495.596215:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10203 00000100:00100000:2.0:1787119495.596225:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633453312:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.596749:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10204 00000100:00100000:2.0:1787119495.596759:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633453440:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.596960:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633453440:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 202us (1130us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.596968:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10204 00002000:00100000:2.0:1787119495.596976:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (5865472->5869567) req@ffff92a508da6d80 x1873929633453440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.596984:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6d80 with x1873929633453440 ext(5865472->5869567) 00002000:00010000:2.0:1787119495.596989:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6d80 00000100:00100000:3.0:1787119495.602298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.604605:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633453312:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7417us (7857us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119495.604621:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10203 00002000:00100000:2.0:1787119495.604638:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (5910528->5947391) req@ffff92a508da4380 x1873929633453312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.604927:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4380 with x1873929633453312 ext(5910528->5947391) 00002000:00010000:2.0:1787119495.604933:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4380 00000100:00100000:2.0:1787119495.604961:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633453824 00000100:00100000:2.0:1787119495.604968:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633453824 00002000:00100000:2.0:1787119495.605005:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (5869568->5873663) req@ffff92a508da7480 x1873929633453824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.605014:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7480 with x1873929633453824 ext(5869568->5873663) 00002000:00010000:2.0:1787119495.605017:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7480 00000100:00100000:2.0:1787119495.605042:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10205 00000100:00100000:2.0:1787119495.605548:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633453824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.606000:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633453824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 948us (3713us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.606008:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10205 00002000:00100000:2.0:1787119495.606015:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (5869568->5873663) req@ffff92a508da7480 x1873929633453824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.606023:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7480 with x1873929633453824 ext(5869568->5873663) 00002000:00010000:2.0:1787119495.606028:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7480 00000100:00100000:3.0:1787119495.609224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.610001:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633453952 00000100:00100000:2.0:1787119495.610014:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633453952 00002000:00100000:2.0:1787119495.610493:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (5865472->34983935) req@ffff92a508da4000 x1873929633453952/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.610504:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633453952 ext(5865472->34983935) 00002000:00010000:2.0:1787119495.610509:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4000 00000100:00100000:2.0:1787119495.610536:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10206 00000100:00100000:2.0:1787119495.610547:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633453952:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119495.611616:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633453696 00000100:00100000:0.0:1787119495.611627:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633453696 00000100:00100000:0.0:1787119495.611965:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19656 00000100:00100000:0.0:1787119495.611976:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+139:32724:x1873929633453696:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119495.612025:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119495.612185:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d22 expref: 139 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.612208:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119495.612213:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119495.615360:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119495.615781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.615995:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633454080 00000100:00100000:1.0:1787119495.616006:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633454080 00010000:00010000:0.0:1787119495.616486:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.616499:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119495.616599:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976470 00002000:00100000:1.0:1787119495.616822:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (5844992->5910527) req@ffff92a508da5500 x1873929633454080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.616834:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5500 with x1873929633454080 ext(5844992->5910527) 00002000:00010000:1.0:1787119495.616839:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5500 00000100:00100000:3.0:1787119495.617004:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10207 00000100:00100000:3.0:1787119495.617016:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633454080:12345-192.168.201.59@tcp:3:fsx.0 00000004:00010000:0.0:1787119495.617190:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a490e99 reply state 000000007e6ec542 transno 4294976471 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119495.617201:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119495.618194:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+141:32724:x1873929633453696:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 5344us (21459us total) trans 4294976471 rc 0/0 00000100:00100000:0.0:1787119495.618211:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19656 00000020:00080000:0.0:1787119495.618219:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119495.624241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119495.624294:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.624307:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.624315:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.624334:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038faa00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119495.624339:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.624347:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119495.624473:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633454208 00000100:00100000:1.0:1787119495.624482:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633454208 00002000:00010000:1.0:1787119495.624520:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (63981300->18446744073709551615) 00002000:00100000:1.0:1787119495.624524:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633454208 ext(63981300->18446744073709551615) 00002000:00010000:1.0:1787119495.624533:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509232a00. 00000100:00100000:1.0:1787119495.624553:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10208 00000100:00100000:1.0:1787119495.624563:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633454208:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119495.624831:0:20838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 60381765 -> 63981300 00002000:00010000:1.0:1787119495.624834:0:20838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119493 -> 1787119494 00002000:00010000:1.0:1787119495.624837:0:20838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119495.624838:0:20838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119493 -> 1787119494 00002000:00010000:1.0:1787119495.624840:0:20838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2831 -> 2959 00010000:00010000:0.0:1787119495.626155:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119495.626167:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119495.626178:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.626191:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119495.626353:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633454080:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9336us (10576us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119495.626987:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633454208:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 2421us (2751us total) trans 4294968896 rc 0/0 00000100:00100000:0.0:1787119495.627710:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10207 00002000:00100000:0.0:1787119495.627735:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (5844992->5910527) req@ffff92a508da5500 x1873929633454080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.627747:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5500 with x1873929633454080 ext(5844992->5910527) 00002000:00010000:0.0:1787119495.627754:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5500 00000100:00100000:1.0:1787119495.627960:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10208 00002000:00010000:1.0:1787119495.627964:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (63981300->18446744073709551615) 00002000:00100000:1.0:1787119495.627967:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633454208 ext(63981300->18446744073709551615) 00002000:00010000:1.0:1787119495.627978:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509232a00. 00000100:00100000:1.0:1787119495.633848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.635305:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633453952:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 24753us (26083us total) trans 4294969159 rc 0/0 00000100:00100000:2.0:1787119495.635330:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10206 00002000:00100000:2.0:1787119495.635345:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (5865472->34983935) req@ffff92a508da4000 x1873929633453952/t4294969159(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.635356:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633453952 ext(5865472->34983935) 00002000:00010000:2.0:1787119495.635367:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4000 00000100:00100000:0.0:1787119495.637665:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633454336 00000100:00100000:0.0:1787119495.637683:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633454336 00000100:00100000:0.0:1787119495.637744:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19657 00000100:00100000:0.0:1787119495.637753:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+140:32724:x1873929633454336:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119495.637777:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119495.637797:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d29 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.637991:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.638006:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.638017:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119495.638044:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 63981300 00000004:00200000:0.0:1787119495.638048:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119495.638130:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.638157:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e31b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d29 expref: 142 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.638173:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d29 expref: 141 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.638182:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119495.638185:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119495.638188:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fae00, rc 0) 00000100:00100000:0.0:1787119495.638256:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+141:32724:x1873929633454336:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 504us (4417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119495.638263:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19657 00000001:00080000:2.0:1787119495.639181:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968895 is committed 00000100:00100000:3.0:1787119495.640238:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633452544:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 119520us (121218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119495.640251:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5064 00000100:00100000:2.0:1787119495.641921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.642307:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633454464 00000100:00100000:0.0:1787119495.642329:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633454464 00000100:00100000:0.0:1787119495.642399:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5066 00000100:00100000:0.0:1787119495.642411:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633454464:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119495.647284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.647335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.647375:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633454592 00000100:00100000:0.0:1787119495.647384:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633454592 00002000:00100000:0.0:1787119495.647432:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (5910528->5947391) req@ffff92a509231880 x1873929633454592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.647474:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633454592 ext(5910528->5947391) 00002000:00010000:0.0:1787119495.647479:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231880 00000100:00100000:0.0:1787119495.647504:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10209 00000100:00100000:0.0:1787119495.647513:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633454592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.648308:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633454720 00000100:00100000:1.0:1787119495.648517:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633454720 00000100:00100000:1.0:1787119495.648566:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19658 00000100:00100000:1.0:1787119495.648575:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+141:32720:x1873929633454720:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119495.648589:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119495.648610:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e31c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d30 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.648695:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e31ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.648709:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e31ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.648723:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e31ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119495.648746:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 47090098 00000004:00200000:1.0:1787119495.648751:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119495.648767:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e31ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.648792:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e31c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d30 expref: 143 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.648808:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e31ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d30 expref: 142 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.648817:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119495.648819:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119495.648823:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:1.0:1787119495.649144:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+142:32720:x1873929633454720:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 570us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119495.649151:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19658 00000100:00100000:2.0:1787119495.652197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.652271:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633454848 00000100:00100000:1.0:1787119495.652283:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633454848 00002000:00100000:1.0:1787119495.652345:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (48726016->48730111) req@ffff92a5098a4380 x1873929633454848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.652355:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4380 with x1873929633454848 ext(48726016->48730111) 00002000:00010000:1.0:1787119495.652361:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a4380 00000100:00100000:1.0:1787119495.652399:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10210 00000100:00100000:1.0:1787119495.652411:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633454848:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.652685:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633454848:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 277us (497us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.652693:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10210 00002000:00100000:1.0:1787119495.652700:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (48726016->48730111) req@ffff92a5098a4380 x1873929633454848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.652708:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4380 with x1873929633454848 ext(48726016->48730111) 00002000:00010000:1.0:1787119495.652711:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a4380 00000001:00080000:1.0:1787119495.661965:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969158 is committed 00000100:00100000:1.0:1787119495.667154:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633453184:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 80762us (83817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119495.667170:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5065 00000100:00100000:2.0:1787119495.677229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.677772:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633454592:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 30257us (30496us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119495.677784:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10209 00002000:00100000:2.0:1787119495.677800:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (5910528->5947391) req@ffff92a509231880 x1873929633454592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.677812:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633454592 ext(5910528->5947391) 00002000:00010000:2.0:1787119495.677817:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231880 00000100:00100000:3.0:1787119495.678964:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633455104 00000100:00100000:3.0:1787119495.678977:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633455104 00000100:00100000:3.0:1787119495.679042:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19659 00000100:00100000:3.0:1787119495.679112:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+142:32720:x1873929633455104:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119495.679164:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119495.679189:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e31ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d30 expref: 142 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.679207:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119495.679212:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119495.680602:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.680625:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.680638:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119495.683811:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976472 00000004:00010000:3.0:1787119495.684771:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c10e8619 reply state 000000008c6da8f6 transno 4294976473 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119495.684787:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119495.686952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.686997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.687251:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633455232 00000100:00100000:2.0:1787119495.687262:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633455232 00002000:00100000:2.0:1787119495.687311:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (48730112->48734207) req@ffff92a509230380 x1873929633455232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.687333:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230380 with x1873929633455232 ext(48730112->48734207) 00002000:00010000:2.0:1787119495.687339:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230380 00000100:00100000:2.0:1787119495.687368:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633455360 00000100:00100000:2.0:1787119495.687371:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633455360 00002000:00100000:2.0:1787119495.687390:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (34930688->34934783) req@ffff92a509233800 x1873929633455360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787119495.687668:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10211 00000100:00100000:1.0:1787119495.687680:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633455232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.688250:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+144:32720:x1873929633455104:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 6803us (8636us total) trans 4294976473 rc 0/0 00000100:00100000:3.0:1787119495.688262:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19659 00000020:00080000:3.0:1787119495.688268:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00100000:2.0:1787119495.688626:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233800 with x1873929633455360 ext(34930688->34934783) 00002000:00010000:2.0:1787119495.688631:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233800 00000100:00100000:2.0:1787119495.688836:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10212 00000100:00100000:2.0:1787119495.688846:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633455360:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.689045:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633455232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1366us (2995us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.689625:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10211 00002000:00100000:1.0:1787119495.689636:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (48730112->48734207) req@ffff92a509230380 x1873929633455232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.689646:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230380 with x1873929633455232 ext(48730112->48734207) 00002000:00010000:1.0:1787119495.689651:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230380 00010000:00010000:1.0:1787119495.690302:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.690333:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.690341:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.690348:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119495.690352:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.690359:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119495.690546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.691167:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633455488 00000100:00100000:3.0:1787119495.691177:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633455488 00002000:00010000:3.0:1787119495.691208:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (60381765->18446744073709551615) 00002000:00100000:3.0:1787119495.691212:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633455488 ext(60381765->18446744073709551615) 00002000:00010000:3.0:1787119495.691223:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230a80. 00000100:00100000:3.0:1787119495.691257:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10213 00000100:00100000:3.0:1787119495.691265:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633455488:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:2.0:1787119495.691641:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633455360:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2796us (4642us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.691649:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10212 00002000:00100000:2.0:1787119495.691657:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (34930688->34934783) req@ffff92a509233800 x1873929633455360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.691666:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233800 with x1873929633455360 ext(34930688->34934783) 00002000:00010000:2.0:1787119495.691671:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233800 00010000:00010000:1.0:1787119495.691980:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119495.691984:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119495.691990:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.691997:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e31d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119495.693816:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 47090098 -> 60381765 00002000:00010000:3.0:1787119495.693824:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:3.0:1787119495.693826:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119495.693828:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:3.0:1787119495.693830:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 2447 -> 2831 00000100:00100000:3.0:1787119495.695266:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633455488:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 3993us (4713us total) trans 4294968897 rc 0/0 00000100:00100000:3.0:1787119495.695280:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10213 00002000:00010000:3.0:1787119495.695286:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (60381765->18446744073709551615) 00002000:00100000:3.0:1787119495.695289:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633455488 ext(60381765->18446744073709551615) 00002000:00010000:3.0:1787119495.695298:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509230a80. 00000100:00100000:1.0:1787119495.701247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.701282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.701340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.703925:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633455616 00000100:00100000:3.0:1787119495.703940:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633455616 00002000:00100000:3.0:1787119495.703989:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (34979840->34983935) req@ffff92a63414c380 x1873929633455616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.703999:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c380 with x1873929633455616 ext(34979840->34983935) 00002000:00010000:3.0:1787119495.704006:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414c380 00000100:00100000:3.0:1787119495.704026:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633455744 00000100:00100000:3.0:1787119495.704028:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633455744 00002000:00100000:3.0:1787119495.704040:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (5865472->34983935) req@ffff92a63414ed80 x1873929633455744/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.704047:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ed80 with x1873929633455744 ext(5865472->34983935) 00000100:00100000:2.0:1787119495.704355:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633455872 00000100:00100000:2.0:1787119495.704360:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633455872 00002000:00010000:3.0:1787119495.704534:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414ed80 00000100:00100000:3.0:1787119495.704556:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10214 00000100:00100000:3.0:1787119495.704567:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633455616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.704818:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633455616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 253us (3581us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.704826:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10214 00002000:00100000:3.0:1787119495.704832:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (34979840->34983935) req@ffff92a63414c380 x1873929633455616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.704840:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c380 with x1873929633455616 ext(34979840->34983935) 00002000:00010000:3.0:1787119495.704844:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414c380 00000100:00100000:3.0:1787119495.704874:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10215 00000100:00100000:3.0:1787119495.704881:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633455744:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119495.706120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.707256:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633456000 00000100:00100000:3.0:1787119495.707268:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633456000 00000100:00100000:3.0:1787119495.707331:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19660 00000100:00100000:3.0:1787119495.707342:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+143:32720:x1873929633456000:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119495.707542:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119495.707566:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d37 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.707673:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e31e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.707687:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e31e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.707697:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e31e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119495.707720:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 60381765 00000004:00200000:3.0:1787119495.707724:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119495.707741:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e31e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.707766:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d37 expref: 145 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.707785:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e31e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d37 expref: 144 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.707794:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119495.707797:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119495.707800:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0c00, rc 0) 00000100:00100000:3.0:1787119495.707849:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+144:32720:x1873929633456000:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 508us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119495.707872:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19660 00000100:00100000:0.0:1787119495.713986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.714016:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633456128 00000100:00100000:0.0:1787119495.714025:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633456128 00002000:00100000:0.0:1787119495.714075:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (20422656->20426751) req@ffff92a509231c00 x1873929633456128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.714086:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633456128 ext(20422656->20426751) 00002000:00010000:0.0:1787119495.714092:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231c00 00000100:00100000:0.0:1787119495.714113:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10216 00000100:00100000:0.0:1787119495.714121:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633456128:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.714346:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633456128:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 224us (367us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.714353:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10216 00002000:00100000:0.0:1787119495.714360:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (20422656->20426751) req@ffff92a509231c00 x1873929633456128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.714579:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633456128 ext(20422656->20426751) 00002000:00010000:0.0:1787119495.714583:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231c00 00000100:00100000:0.0:1787119495.715331:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633455744:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 10445us (14043us total) trans 4294969160 rc 0/0 00000100:00100000:0.0:1787119495.715339:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10215 00002000:00100000:0.0:1787119495.715347:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (5865472->34983935) req@ffff92a63414ed80 x1873929633455744/t4294969160(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.715355:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ed80 with x1873929633455744 ext(5865472->34983935) 00002000:00010000:0.0:1787119495.715360:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414ed80 00000100:00100000:3.0:1787119495.716038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:0.0:1787119495.719753:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (48705536->48771071) req@ffff92a63414f800 x1873929633455872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.719769:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f800 with x1873929633455872 ext(48705536->48771071) 00002000:00010000:0.0:1787119495.719776:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414f800 00000100:00100000:3.0:1787119495.720574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.721348:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633456256 00000100:00100000:1.0:1787119495.721359:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633456256 00002000:00100000:1.0:1787119495.721517:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (49610752->49614847) req@ffff92a508da5880 x1873929633456256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.721535:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633456256 ext(49610752->49614847) 00002000:00010000:1.0:1787119495.721540:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da5880 00000100:00100000:1.0:1787119495.721566:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10217 00000100:00100000:1.0:1787119495.721576:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633455872:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.721810:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10218 00000100:00100000:1.0:1787119495.721815:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633456256:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.721920:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633456256:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 104us (5885us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.721925:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10218 00002000:00100000:1.0:1787119495.721929:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (49610752->49614847) req@ffff92a508da5880 x1873929633456256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.721935:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633456256 ext(49610752->49614847) 00002000:00010000:1.0:1787119495.721937:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da5880 00000100:00100000:0.0:1787119495.723149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.723223:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633456512 00000100:00100000:1.0:1787119495.723229:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633456512 00002000:00100000:1.0:1787119495.723261:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (5865472->5869567) req@ffff92a509231180 x1873929633456512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.723271:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633456512 ext(5865472->5869567) 00002000:00010000:1.0:1787119495.723276:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231180 00000100:00100000:1.0:1787119495.723303:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10219 00000100:00100000:1.0:1787119495.723312:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633456512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.723748:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633456512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 435us (603us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.723756:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10219 00002000:00100000:1.0:1787119495.723763:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (5865472->5869567) req@ffff92a509231180 x1873929633456512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.723772:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633456512 ext(5865472->5869567) 00002000:00010000:1.0:1787119495.723775:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231180 00000100:00100000:2.0:1787119495.725656:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633456384 00000100:00100000:2.0:1787119495.725670:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633456384 00000100:00100000:2.0:1787119495.725757:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5067 00000100:00100000:2.0:1787119495.725768:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633456384:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119495.726062:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633455872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4475us (24709us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119495.726071:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10217 00002000:00100000:3.0:1787119495.726080:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (48705536->48771071) req@ffff92a63414f800 x1873929633455872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.726090:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f800 with x1873929633455872 ext(48705536->48771071) 00002000:00010000:3.0:1787119495.726095:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414f800 00000100:00100000:0.0:1787119495.727320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.727679:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633456640 00000100:00100000:2.0:1787119495.727688:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633456640 00002000:00100000:2.0:1787119495.727728:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (5869568->5873663) req@ffff92a509230000 x1873929633456640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.727738:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633456640 ext(5869568->5873663) 00002000:00010000:2.0:1787119495.727742:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230000 00000100:00100000:2.0:1787119495.727775:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10220 00000100:00100000:2.0:1787119495.727784:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633456640:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.728124:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633456640:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 339us (812us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.728132:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10220 00002000:00100000:2.0:1787119495.728138:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (5869568->5873663) req@ffff92a509230000 x1873929633456640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.728147:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633456640 ext(5869568->5873663) 00002000:00010000:2.0:1787119495.728150:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230000 00000100:00100000:0.0:1787119495.729804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.730026:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633456768 00000100:00100000:3.0:1787119495.730034:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633456768 00002000:00100000:3.0:1787119495.730089:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (49614848->49618943) req@ffff92a509231500 x1873929633456768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.730101:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633456768 ext(49614848->49618943) 00002000:00010000:3.0:1787119495.730107:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509231500 00000100:00100000:3.0:1787119495.730139:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10221 00000100:00100000:3.0:1787119495.730148:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633456768:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.730551:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633456768:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 402us (753us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.730559:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10221 00002000:00100000:3.0:1787119495.730565:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (49614848->49618943) req@ffff92a509231500 x1873929633456768/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.730579:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633456768 ext(49614848->49618943) 00002000:00010000:3.0:1787119495.730582:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509231500 00000100:00100000:1.0:1787119495.733361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.733697:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633456896 00000100:00100000:3.0:1787119495.733707:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633456896 00002000:00100000:3.0:1787119495.733750:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (48771072->48807935) req@ffff92a63414ca80 x1873929633456896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.733761:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ca80 with x1873929633456896 ext(48771072->48807935) 00002000:00010000:3.0:1787119495.733767:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414ca80 00000100:00100000:3.0:1787119495.733801:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10222 00000100:00100000:3.0:1787119495.733811:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633456896:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.734883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.735010:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633457024 00000100:00100000:0.0:1787119495.735017:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633457024 00002000:00100000:0.0:1787119495.735058:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (5844992->5910527) req@ffff92a63414c700 x1873929633457024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.735068:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c700 with x1873929633457024 ext(5844992->5910527) 00002000:00010000:0.0:1787119495.735073:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414c700 00000100:00100000:0.0:1787119495.735102:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10223 00000100:00100000:0.0:1787119495.735110:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633457024:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.738570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.738600:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633457152 00000100:00100000:1.0:1787119495.738610:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633457152 00002000:00100000:1.0:1787119495.738655:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (49590272->49655807) req@ffff92a509233100 x1873929633457152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.738665:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233100 with x1873929633457152 ext(49590272->49655807) 00002000:00010000:1.0:1787119495.738670:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509233100 00000100:00100000:1.0:1787119495.738699:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10224 00000100:00100000:1.0:1787119495.738708:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633457152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.738743:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633457024:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3633us (3864us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119495.738752:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10223 00002000:00100000:0.0:1787119495.738758:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (5844992->5910527) req@ffff92a63414c700 x1873929633457024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.738766:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c700 with x1873929633457024 ext(5844992->5910527) 00002000:00010000:0.0:1787119495.738770:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414c700 00000100:00100000:3.0:1787119495.739000:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633456896:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5185us (5642us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119495.739007:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10222 00002000:00100000:3.0:1787119495.739014:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (48771072->48807935) req@ffff92a63414ca80 x1873929633456896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.739022:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ca80 with x1873929633456896 ext(48771072->48807935) 00002000:00010000:3.0:1787119495.739026:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414ca80 00000001:00080000:1.0:1787119495.739502:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969159 is committed 00000100:00100000:0.0:1787119495.746648:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633454464:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 104228us (104724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119495.746661:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5066 00000100:00100000:0.0:1787119495.746752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.746852:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633457280 00000100:00100000:0.0:1787119495.746860:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633457280 00002000:00100000:0.0:1787119495.746901:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (5910528->5947391) req@ffff92a509232300 x1873929633457280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.746912:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232300 with x1873929633457280 ext(5910528->5947391) 00002000:00010000:0.0:1787119495.746918:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509232300 00000100:00100000:0.0:1787119495.746939:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10225 00000100:00100000:0.0:1787119495.746948:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633457280:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.754132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.754262:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633457536 00000100:00100000:3.0:1787119495.754271:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633457536 00000100:00100000:3.0:1787119495.754328:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19661 00000100:00100000:3.0:1787119495.754337:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+144:32724:x1873929633457536:12345-192.168.201.59@tcp:36:fsx.0 00000100:00100000:1.0:1787119495.754352:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633457152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15645us (15793us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119495.754362:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10224 00002000:00100000:1.0:1787119495.754373:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (49590272->49655807) req@ffff92a509233100 x1873929633457152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.754383:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233100 with x1873929633457152 ext(49590272->49655807) 00002000:00010000:1.0:1787119495.754388:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509233100 00010000:00010000:3.0:1787119495.754396:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119495.754422:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e31c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d29 expref: 144 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.754482:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119495.754487:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119495.754675:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.754688:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.754697:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119495.754743:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976474 00000004:00010000:3.0:1787119495.754766:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2030cfe reply state 000000003a348bc1 transno 4294976475 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119495.754774:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119495.754837:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+146:32724:x1873929633457536:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 500us (716us total) trans 4294976475 rc 0/0 00000100:00100000:3.0:1787119495.754845:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19661 00000020:00080000:3.0:1787119495.754849:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119495.758830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.758915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119495.758947:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.758960:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.758966:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.758973:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119495.758978:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.758985:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.759002:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119495.759006:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119495.759010:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.759016:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e31ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119495.759047:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633457664 00000100:00100000:1.0:1787119495.759056:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633457664 00002000:00100000:1.0:1787119495.759098:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (671744->675839) req@ffff92a63414dc00 x1873929633457664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.759108:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414dc00 with x1873929633457664 ext(671744->675839) 00002000:00010000:1.0:1787119495.759114:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414dc00 00000100:00100000:1.0:1787119495.759135:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633457792 00000100:00100000:1.0:1787119495.759138:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633457792 00002000:00010000:1.0:1787119495.759153:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (3317751->18446744073709551615) 00002000:00100000:1.0:1787119495.759156:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d180 with x1873929633457792 ext(3317751->18446744073709551615) 00002000:00010000:1.0:1787119495.759165:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414d180. 00000100:00100000:1.0:1787119495.759182:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10226 00000100:00100000:1.0:1787119495.759190:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633457664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.759427:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633457664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 236us (605us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.759436:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10226 00002000:00100000:1.0:1787119495.759471:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (671744->675839) req@ffff92a63414dc00 x1873929633457664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.759480:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414dc00 with x1873929633457664 ext(671744->675839) 00002000:00010000:1.0:1787119495.759483:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414dc00 00000100:00100000:1.0:1787119495.759501:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10227 00000100:00100000:1.0:1787119495.759508:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633457792:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119495.759799:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 63981300 -> 3317751 00002000:00010000:1.0:1787119495.759803:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119495.759805:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119495.759808:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119495.759810:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:1.0:1787119495.759840:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633457792:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 332us (924us total) trans 4294968898 rc 0/0 00000100:00100000:1.0:1787119495.759851:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10227 00002000:00010000:1.0:1787119495.759855:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (3317751->18446744073709551615) 00002000:00100000:1.0:1787119495.759857:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d180 with x1873929633457792 ext(3317751->18446744073709551615) 00002000:00010000:1.0:1787119495.759862:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414d180. 00000100:00100000:1.0:1787119495.760022:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633457280:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13074us (13269us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119495.760029:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10225 00002000:00100000:1.0:1787119495.760035:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (5910528->5947391) req@ffff92a509232300 x1873929633457280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.760042:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232300 with x1873929633457280 ext(5910528->5947391) 00002000:00010000:1.0:1787119495.760046:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509232300 00000100:00100000:1.0:1787119495.764603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.764828:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633457920 00000100:00100000:0.0:1787119495.764838:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633457920 00002000:00100000:0.0:1787119495.764888:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (49610752->49647615) req@ffff92a63414e680 x1873929633457920/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.764900:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414e680 with x1873929633457920 ext(49610752->49647615) 00002000:00010000:0.0:1787119495.764906:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414e680 00000100:00100000:0.0:1787119495.764944:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10228 00000100:00100000:0.0:1787119495.764954:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633457920:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119495.773203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.773726:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633458176 00000100:00100000:0.0:1787119495.773738:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633458176 00002000:00100000:0.0:1787119495.773792:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (5865472->34983935) req@ffff92a508ffe300 x1873929633458176/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.773804:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633458176 ext(5865472->34983935) 00002000:00010000:0.0:1787119495.773811:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffe300 00000100:00100000:0.0:1787119495.773837:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10229 00000100:00100000:0.0:1787119495.773847:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633458176:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119495.774684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.774771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.774794:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633458048 00000100:00100000:1.0:1787119495.774799:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633458048 00000100:00100000:1.0:1787119495.774835:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19662 00000100:00100000:1.0:1787119495.774844:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+145:32724:x1873929633458048:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119495.774861:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119495.774881:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e31f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d3e expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.774961:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e31f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.774979:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e31f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.774991:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e31f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119495.775015:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 3317751 00000004:00200000:1.0:1787119495.775019:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119495.775045:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e31f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.775073:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e31f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d3e expref: 147 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.775091:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e31f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d3e expref: 146 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.775100:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119495.775103:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119495.775107:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430e00, rc 0) 00000100:00100000:1.0:1787119495.775149:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+146:32724:x1873929633458048:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 306us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119495.775156:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19662 00000100:00100000:1.0:1787119495.775180:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633458304 00000100:00100000:1.0:1787119495.775184:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633458304 00002000:00100000:1.0:1787119495.775205:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (675840->679935) req@ffff92a63414d500 x1873929633458304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.775214:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d500 with x1873929633458304 ext(675840->679935) 00002000:00010000:1.0:1787119495.775219:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414d500 00000100:00100000:1.0:1787119495.775238:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10230 00000100:00100000:1.0:1787119495.775245:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633458304:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.775497:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633458304:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 251us (725us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.775503:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10230 00002000:00100000:1.0:1787119495.775510:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (675840->679935) req@ffff92a63414d500 x1873929633458304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.775518:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d500 with x1873929633458304 ext(675840->679935) 00002000:00010000:1.0:1787119495.775521:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414d500 00000100:00100000:0.0:1787119495.776372:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633457920:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 11416us (11775us total) trans 4294968899 rc 0/0 00000100:00100000:0.0:1787119495.776382:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10228 00002000:00100000:0.0:1787119495.776390:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (49610752->49647615) req@ffff92a63414e680 x1873929633457920/t4294968899(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.776399:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414e680 with x1873929633457920 ext(49610752->49647615) 00002000:00010000:0.0:1787119495.776403:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414e680 00000100:00100000:3.0:1787119495.778059:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633458176:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 4204us (4857us total) trans 4294969161 rc 0/0 00000100:00100000:3.0:1787119495.778072:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10229 00002000:00100000:3.0:1787119495.778081:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (5865472->34983935) req@ffff92a508ffe300 x1873929633458176/t4294969161(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.778091:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633458176 ext(5865472->34983935) 00002000:00010000:3.0:1787119495.778097:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffe300 00000100:00100000:2.0:1787119495.781548:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633456384:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 55770us (60965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119495.781564:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5067 00000001:00080000:2.0:1787119495.782011:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969160 is committed 00000100:00100000:1.0:1787119495.784881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.784978:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633458432 00000100:00100000:0.0:1787119495.784990:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633458432 00000100:00100000:0.0:1787119495.785053:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5068 00000100:00100000:0.0:1787119495.785065:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633458432:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119495.792222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.792268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.792351:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633458688 00000100:00100000:2.0:1787119495.792363:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633458688 00002000:00100000:2.0:1787119495.792418:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (651264->716799) req@ffff92a508ffce00 x1873929633458688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.792429:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffce00 with x1873929633458688 ext(651264->716799) 00002000:00010000:2.0:1787119495.792435:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffce00 00000100:00100000:2.0:1787119495.792495:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10231 00000100:00100000:2.0:1787119495.792506:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633458688:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.793272:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633458560 00000100:00100000:3.0:1787119495.793281:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633458560 00000100:00100000:3.0:1787119495.793358:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5069 00000100:00100000:3.0:1787119495.793366:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633458560:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119495.799508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.799826:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633458688:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7319us (7554us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119495.799840:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10231 00002000:00100000:2.0:1787119495.799853:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (651264->716799) req@ffff92a508ffce00 x1873929633458688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.799865:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffce00 with x1873929633458688 ext(651264->716799) 00002000:00010000:2.0:1787119495.799870:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffce00 00000100:00100000:3.0:1787119495.804673:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633458944 00000100:00100000:3.0:1787119495.804688:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633458944 00000100:00100000:3.0:1787119495.804841:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19663 00000100:00100000:3.0:1787119495.804850:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+146:32724:x1873929633458944:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119495.804904:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119495.804931:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e31f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d3e expref: 146 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.804949:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119495.804954:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119495.805145:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.805157:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.805168:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119495.805216:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976476 00000004:00010000:3.0:1787119495.805238:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007534552d reply state 00000000354c98af transno 4294976477 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119495.805245:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119495.805324:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+148:32724:x1873929633458944:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 475us (8741us total) trans 4294976477 rc 0/0 00000100:00100000:3.0:1787119495.805335:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19663 00000020:00080000:3.0:1787119495.805340:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119495.805606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.805706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.806471:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633459072 00000100:00100000:0.0:1787119495.806481:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633459072 00002000:00100000:0.0:1787119495.806520:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (671744->675839) req@ffff92a508ffdf80 x1873929633459072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.806530:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdf80 with x1873929633459072 ext(671744->675839) 00002000:00010000:0.0:1787119495.806535:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffdf80 00000100:00100000:0.0:1787119495.811074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119495.811497:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.811510:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.811518:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.811525:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119495.811529:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.811537:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.811553:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119495.811556:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119495.811560:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.811567:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e31ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119495.812845:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633459200 00000100:00100000:1.0:1787119495.812860:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633459200 00000100:00100000:0.0:1787119495.812883:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633459328 00000100:00100000:0.0:1787119495.812890:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633459328 00002000:00010000:0.0:1787119495.812913:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (13267460->18446744073709551615) 00002000:00100000:0.0:1787119495.812918:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd180 with x1873929633459328 ext(13267460->18446744073709551615) 00002000:00100000:1.0:1787119495.812923:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (6119424->6123519) req@ffff92a508ffdc00 x1873929633459200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00010000:0.0:1787119495.812930:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffd180. 00000100:00100000:0.0:1787119495.812961:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10232 00000100:00100000:0.0:1787119495.812970:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633459072:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.813183:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633459072:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 212us (7576us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.813191:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10232 00002000:00100000:0.0:1787119495.813198:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (671744->675839) req@ffff92a508ffdf80 x1873929633459072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.813207:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdf80 with x1873929633459072 ext(671744->675839) 00002000:00100000:1.0:1787119495.813212:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdc00 with x1873929633459200 ext(6119424->6123519) 00002000:00010000:0.0:1787119495.813215:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffdf80 00002000:00010000:1.0:1787119495.813220:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffdc00 00000100:00100000:0.0:1787119495.813235:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10233 00000100:00100000:0.0:1787119495.813245:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633459328:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:1.0:1787119495.813248:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10234 00000100:00100000:1.0:1787119495.813261:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633459200:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.813392:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633459200:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 133us (7685us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.813399:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10234 00002000:00100000:1.0:1787119495.813406:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (6119424->6123519) req@ffff92a508ffdc00 x1873929633459200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.813421:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdc00 with x1873929633459200 ext(6119424->6123519) 00002000:00010000:1.0:1787119495.813425:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffdc00 00002000:00010000:1.0:1787119495.823080:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3317751 -> 13267460 00002000:00010000:1.0:1787119495.823089:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119495.823092:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:1.0:1787119495.823095:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119495.823097:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2959 -> 909 00000100:00100000:1.0:1787119495.823190:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633459328:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 9940us (12120us total) trans 4294968900 rc 0/0 00000100:00100000:1.0:1787119495.823202:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10233 00002000:00010000:1.0:1787119495.823208:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (13267460->18446744073709551615) 00002000:00100000:1.0:1787119495.823212:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd180 with x1873929633459328 ext(13267460->18446744073709551615) 00002000:00010000:1.0:1787119495.823219:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508ffd180. 00000100:00100000:3.0:1787119495.825335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.826773:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633459456 00000100:00100000:0.0:1787119495.826785:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633459456 00002000:00100000:0.0:1787119495.826832:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (6172672->6176767) req@ffff92a508da5c00 x1873929633459456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.826844:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5c00 with x1873929633459456 ext(6172672->6176767) 00002000:00010000:0.0:1787119495.826849:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5c00 00000100:00100000:0.0:1787119495.826875:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10235 00000100:00100000:0.0:1787119495.826883:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633459456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.827098:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633459456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 215us (1773us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.827107:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10235 00002000:00100000:0.0:1787119495.827113:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (6172672->6176767) req@ffff92a508da5c00 x1873929633459456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.827121:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5c00 with x1873929633459456 ext(6172672->6176767) 00002000:00010000:0.0:1787119495.827125:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5c00 00000100:00100000:0.0:1787119495.830562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.830671:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633459584 00000100:00100000:1.0:1787119495.830681:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633459584 00002000:00100000:1.0:1787119495.830722:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (675840->679935) req@ffff92a508ffd880 x1873929633459584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.830733:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd880 with x1873929633459584 ext(675840->679935) 00002000:00010000:1.0:1787119495.830738:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd880 00000100:00100000:1.0:1787119495.830766:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10236 00000100:00100000:1.0:1787119495.830774:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633459584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.831000:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633459584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 226us (448us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.831012:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10236 00002000:00100000:1.0:1787119495.831018:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (675840->679935) req@ffff92a508ffd880 x1873929633459584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.831026:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd880 with x1873929633459584 ext(675840->679935) 00002000:00010000:1.0:1787119495.831029:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd880 00000001:00080000:1.0:1787119495.833109:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968899 is committed 00000100:00100000:0.0:1787119495.833274:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633458432:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 48206us (48400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119495.833285:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5068 00000100:00100000:3.0:1787119495.835330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.835415:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633459712 00000100:00100000:1.0:1787119495.835426:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633459712 00000100:00100000:1.0:1787119495.835510:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19664 00000100:00100000:1.0:1787119495.835520:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+147:32724:x1873929633459712:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119495.835545:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119495.835570:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e3206 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d45 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.835665:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e320d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.835679:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e320d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.835689:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e320d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119495.835715:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 13267460 00000004:00200000:1.0:1787119495.835720:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119495.835738:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e320d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.835767:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e3206 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d45 expref: 149 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.835782:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e320d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d45 expref: 148 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.835790:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119495.835792:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119495.835795:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119495.835845:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+148:32724:x1873929633459712:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 327us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119495.835852:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19664 00000001:00080000:0.0:1787119495.838692:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969161 is committed 00000100:00100000:3.0:1787119495.838849:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633458560:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 45478us (46631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119495.838864:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5069 00000100:00100000:3.0:1787119495.856737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.856784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.856890:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633459840 00000100:00100000:1.0:1787119495.856900:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633459840 00002000:00100000:1.0:1787119495.856950:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (651264->716799) req@ffff92a508da5180 x1873929633459840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.856961:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5180 with x1873929633459840 ext(651264->716799) 00002000:00010000:1.0:1787119495.856968:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5180 00000100:00100000:1.0:1787119495.857011:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10237 00000100:00100000:1.0:1787119495.857020:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633459840:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.857735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.857768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.857813:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633460224 00000100:00100000:1.0:1787119495.857818:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633460224 00002000:00100000:1.0:1787119495.857848:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (21331968->21336063) req@ffff92a508cfd500 x1873929633460224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.857857:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd500 with x1873929633460224 ext(21331968->21336063) 00002000:00010000:1.0:1787119495.857863:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfd500 00000100:00100000:1.0:1787119495.857884:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10238 00000100:00100000:1.0:1787119495.857892:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633460224:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.858065:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633460224:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 172us (331us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.858073:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10238 00002000:00100000:1.0:1787119495.858079:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (21331968->21336063) req@ffff92a508cfd500 x1873929633460224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.858086:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd500 with x1873929633460224 ext(21331968->21336063) 00002000:00010000:1.0:1787119495.858089:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfd500 00000100:00100000:3.0:1787119495.859673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.859784:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633460608 00000100:00100000:0.0:1787119495.859793:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633460608 00002000:00100000:0.0:1787119495.859835:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (671744->675839) req@ffff92a508cfe680 x1873929633460608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.859851:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfe680 with x1873929633460608 ext(671744->675839) 00002000:00010000:0.0:1787119495.859856:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfe680 00000100:00100000:0.0:1787119495.859889:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10239 00000100:00100000:0.0:1787119495.859898:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633460608:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.860140:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633460608:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 242us (475us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.860148:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10239 00002000:00100000:0.0:1787119495.860155:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (671744->675839) req@ffff92a508cfe680 x1873929633460608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.860163:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfe680 with x1873929633460608 ext(671744->675839) 00002000:00010000:0.0:1787119495.860166:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfe680 00000100:00100000:3.0:1787119495.864880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.864972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.865073:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633460736 00000100:00100000:0.0:1787119495.865085:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633460736 00002000:00100000:0.0:1787119495.865141:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (21336064->21340159) req@ffff92a508cffb80 x1873929633460736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.865154:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cffb80 with x1873929633460736 ext(21336064->21340159) 00002000:00010000:0.0:1787119495.865160:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cffb80 00000100:00100000:0.0:1787119495.865190:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633460864 00000100:00100000:0.0:1787119495.865194:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633460864 00002000:00100000:0.0:1787119495.865211:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (675840->679935) req@ffff92a508cfc380 x1873929633460864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.865219:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc380 with x1873929633460864 ext(675840->679935) 00002000:00010000:0.0:1787119495.865222:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc380 00000100:00100000:0.0:1787119495.865244:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10240 00000100:00100000:0.0:1787119495.865254:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633460736:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.865565:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633460736:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 312us (695us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.865574:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10240 00002000:00100000:0.0:1787119495.865580:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (21336064->21340159) req@ffff92a508cffb80 x1873929633460736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.865588:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cffb80 with x1873929633460736 ext(21336064->21340159) 00002000:00010000:0.0:1787119495.865591:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cffb80 00000100:00100000:0.0:1787119495.865608:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10241 00000100:00100000:0.0:1787119495.865614:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633460864:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.865711:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633460864:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 97us (738us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.865718:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10241 00002000:00100000:0.0:1787119495.865723:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (675840->679935) req@ffff92a508cfc380 x1873929633460864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.865731:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc380 with x1873929633460864 ext(675840->679935) 00002000:00010000:0.0:1787119495.865735:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc380 00000100:00100000:2.0:1787119495.866307:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633460096 00000100:00100000:2.0:1787119495.866314:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633460096 00000100:00100000:2.0:1787119495.866372:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633460480 00000100:00100000:2.0:1787119495.866376:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633460480 00000100:00100000:2.0:1787119495.866403:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19665 00000100:00100000:2.0:1787119495.866410:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+149:32728:x1873929633460096:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119495.866487:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119495.866516:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e3165 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d06 expref: 149 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.866536:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119495.866541:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119495.866758:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.866773:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.866783:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119495.866832:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976478 00000004:00010000:2.0:1787119495.866857:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057ade66f reply state 00000000228ee59b transno 4294976479 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.866871:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119495.866954:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+151:32728:x1873929633460096:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 543us (10168us total) trans 4294976479 rc 0/0 00000100:00100000:2.0:1787119495.866962:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19665 00000020:00080000:2.0:1787119495.866966:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119495.866983:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19666 00000100:00100000:2.0:1787119495.866991:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+150:32724:x1873929633460480:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119495.867011:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119495.867025:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e320d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d45 expref: 150 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.867037:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119495.867041:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119495.867122:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.867131:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.867138:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119495.867172:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976480 00000004:00010000:2.0:1787119495.867194:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6e18857 reply state 000000001fa679f8 transno 4294976481 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.867201:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119495.867238:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+152:32724:x1873929633460480:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 248us (9468us total) trans 4294976481 rc 0/0 00000100:00100000:2.0:1787119495.867245:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19666 00000020:00080000:2.0:1787119495.867248:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119495.870011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.871592:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633460992 00000100:00100000:0.0:1787119495.871607:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633460992 00002000:00100000:0.0:1787119495.871671:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (21311488->21377023) req@ffff92a508cfc700 x1873929633460992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.871682:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc700 with x1873929633460992 ext(21311488->21377023) 00002000:00010000:0.0:1787119495.871688:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfc700 00000100:00100000:0.0:1787119495.871719:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10242 00000100:00100000:0.0:1787119495.871728:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633460992:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.872315:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633459840:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 15293us (15585us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119495.872325:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10237 00002000:00100000:3.0:1787119495.872332:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (651264->716799) req@ffff92a508da5180 x1873929633459840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.872340:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5180 with x1873929633459840 ext(651264->716799) 00002000:00010000:3.0:1787119495.872345:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5180 00000100:00100000:3.0:1787119495.876689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119495.876777:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.876789:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.876796:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.876802:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119495.876808:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.876815:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.876832:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119495.876835:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119495.876840:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.876846:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e321b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119495.877000:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633460992:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5270us (6998us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119495.877011:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10242 00002000:00100000:3.0:1787119495.877024:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (21311488->21377023) req@ffff92a508cfc700 x1873929633460992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.877034:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc700 with x1873929633460992 ext(21311488->21377023) 00002000:00010000:3.0:1787119495.877038:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfc700 00000100:00100000:3.0:1787119495.877062:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633461120 00000100:00100000:3.0:1787119495.877070:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633461120 00002000:00100000:3.0:1787119495.877118:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (651264->716799) req@ffff92a509135180 x1873929633461120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.877127:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135180 with x1873929633461120 ext(651264->716799) 00002000:00010000:3.0:1787119495.877132:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135180 00000100:00100000:3.0:1787119495.877154:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10243 00000100:00100000:3.0:1787119495.877163:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633461120:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:1.0:1787119495.878600:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.878616:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.878624:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.878631:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119495.878635:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.878643:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.878659:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119495.878663:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119495.878668:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119495.878674:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3214 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119495.881434:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.882127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.882727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.882820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.882950:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633461248 00000100:00100000:2.0:1787119495.882961:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633461248 00002000:00010000:2.0:1787119495.883003:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (7104934->18446744073709551615) 00002000:00100000:2.0:1787119495.883008:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134380 with x1873929633461248 ext(7104934->18446744073709551615) 00002000:00010000:2.0:1787119495.883020:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509134380. 00000100:00100000:2.0:1787119495.883051:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633461376 00000100:00100000:2.0:1787119495.883054:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633461376 00002000:00010000:2.0:1787119495.883066:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (47090098->18446744073709551615) 00002000:00100000:2.0:1787119495.883070:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134e00 with x1873929633461376 ext(47090098->18446744073709551615) 00002000:00010000:2.0:1787119495.883076:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509134e00. 00000100:00100000:2.0:1787119495.883088:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633461504 00000100:00100000:2.0:1787119495.883091:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633461504 00002000:00100000:2.0:1787119495.883111:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (6119424->6123519) req@ffff92a509136680 x1873929633461504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.883122:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136680 with x1873929633461504 ext(6119424->6123519) 00002000:00010000:2.0:1787119495.883126:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136680 00000100:00100000:2.0:1787119495.883137:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633461632 00000100:00100000:2.0:1787119495.883140:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633461632 00002000:00100000:2.0:1787119495.883154:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (55529472->55570431) req@ffff92a509137480 x1873929633461632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.883162:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509137480 with x1873929633461632 ext(55529472->55570431) 00002000:00010000:2.0:1787119495.883165:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509137480 00000100:00100000:2.0:1787119495.883181:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10244 00000100:00100000:2.0:1787119495.883190:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633461248:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119495.883537:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 13267460 -> 7104934 00002000:00010000:2.0:1787119495.883541:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:2.0:1787119495.883544:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119495.883546:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:2.0:1787119495.883548:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 909 -> 909 00000100:00100000:2.0:1787119495.883611:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633461248:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 419us (2185us total) trans 4294968901 rc 0/0 00000100:00100000:2.0:1787119495.883618:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10244 00002000:00010000:2.0:1787119495.883621:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (7104934->18446744073709551615) 00002000:00100000:2.0:1787119495.883624:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134380 with x1873929633461248 ext(7104934->18446744073709551615) 00002000:00010000:2.0:1787119495.883629:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509134380. 00000100:00100000:2.0:1787119495.883875:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10245 00000100:00100000:2.0:1787119495.883884:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633461376:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119495.884070:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 39439060 -> 47090098 00002000:00010000:2.0:1787119495.884073:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119493 -> 1787119494 00002000:00010000:2.0:1787119495.884075:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119495.884077:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119493 -> 1787119494 00002000:00010000:2.0:1787119495.884080:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1293 -> 2447 00000100:00100000:2.0:1787119495.884106:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633461376:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 224us (1981us total) trans 4294969162 rc 0/0 00000100:00100000:2.0:1787119495.884113:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10245 00002000:00010000:2.0:1787119495.884116:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (47090098->18446744073709551615) 00002000:00100000:2.0:1787119495.884119:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134e00 with x1873929633461376 ext(47090098->18446744073709551615) 00002000:00010000:2.0:1787119495.884124:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509134e00. 00000100:00100000:2.0:1787119495.884138:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10246 00000100:00100000:2.0:1787119495.884145:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633461504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.884325:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633461504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 173us (1594us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.884332:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10246 00002000:00100000:2.0:1787119495.884339:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (6119424->6123519) req@ffff92a509136680 x1873929633461504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.884347:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136680 with x1873929633461504 ext(6119424->6123519) 00002000:00010000:2.0:1787119495.884351:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136680 00000100:00100000:2.0:1787119495.884365:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10247 00000100:00100000:2.0:1787119495.884372:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633461632:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.886114:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633461120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8942us (9426us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119495.886126:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10243 00002000:00100000:2.0:1787119495.886137:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (651264->716799) req@ffff92a509135180 x1873929633461120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.886147:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135180 with x1873929633461120 ext(651264->716799) 00002000:00010000:2.0:1787119495.886152:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135180 00000100:00100000:1.0:1787119495.898862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.900577:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633461760 00000100:00100000:3.0:1787119495.900591:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633461760 00002000:00100000:2.0:1787119495.901052:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (47054848->47058943) req@ffff92a62a998000 x1873929633461760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.901065:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a998000 with x1873929633461760 ext(47054848->47058943) 00002000:00010000:2.0:1787119495.901071:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a998000 00000100:00100000:2.0:1787119495.901139:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10248 00000100:00100000:2.0:1787119495.901161:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633461760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.901553:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633461760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 401us (2700us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.901561:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10248 00002000:00100000:2.0:1787119495.901567:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (47054848->47058943) req@ffff92a62a998000 x1873929633461760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.901575:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a998000 with x1873929633461760 ext(47054848->47058943) 00002000:00010000:2.0:1787119495.901579:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a998000 00000100:00100000:2.0:1787119495.905591:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633461632:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20937us (22488us total) trans 0 rc 40960/40960 00000100:00100000:2.0:1787119495.905606:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10247 00002000:00100000:2.0:1787119495.905619:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (55529472->55570431) req@ffff92a509137480 x1873929633461632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.905631:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509137480 with x1873929633461632 ext(55529472->55570431) 00002000:00010000:2.0:1787119495.905637:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509137480 00000100:00100000:0.0:1787119495.907137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.907311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.907542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.907621:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633461888 00000100:00100000:1.0:1787119495.907631:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633461888 00002000:00100000:1.0:1787119495.907691:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (6172672->6176767) req@ffff92a508fffb80 x1873929633461888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.907702:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fffb80 with x1873929633461888 ext(6172672->6176767) 00002000:00010000:1.0:1787119495.907709:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508fffb80 00000100:00100000:1.0:1787119495.907738:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633462144 00000100:00100000:1.0:1787119495.907741:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633462144 00002000:00100000:1.0:1787119495.907757:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (47058944->47063039) req@ffff92a508ffd500 x1873929633462144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.907766:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd500 with x1873929633462144 ext(47058944->47063039) 00002000:00010000:1.0:1787119495.907770:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd500 00000100:00100000:1.0:1787119495.907788:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10249 00000100:00100000:1.0:1787119495.907798:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633461888:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.908048:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633461888:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 250us (735us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.908056:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10249 00002000:00100000:1.0:1787119495.908062:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (6172672->6176767) req@ffff92a508fffb80 x1873929633461888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.908079:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fffb80 with x1873929633461888 ext(6172672->6176767) 00002000:00010000:1.0:1787119495.908082:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508fffb80 00000100:00100000:1.0:1787119495.908099:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10250 00000100:00100000:1.0:1787119495.908106:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633462144:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.908195:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633462144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 89us (653us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.908203:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10250 00002000:00100000:1.0:1787119495.908209:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (47058944->47063039) req@ffff92a508ffd500 x1873929633462144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.908217:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd500 with x1873929633462144 ext(47058944->47063039) 00002000:00010000:1.0:1787119495.908220:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd500 00000100:00100000:3.0:1787119495.908863:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633462016 00000100:00100000:3.0:1787119495.908870:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633462016 00000100:00100000:3.0:1787119495.908957:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19667 00000100:00100000:3.0:1787119495.908966:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+150:32724:x1873929633462016:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119495.908985:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119495.909008:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3222 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.909107:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.909125:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.909136:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119495.909165:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 7104934 00000004:00200000:3.0:1787119495.909170:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119495.909192:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.909222:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3222 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d4c expref: 152 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.909243:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d4c expref: 151 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119495.909252:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119495.909255:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119495.909260:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1400, rc 0) 00000100:00100000:3.0:1787119495.909307:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+151:32724:x1873929633462016:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 342us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119495.909556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.909628:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633462272 00000100:00100000:0.0:1787119495.909632:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633462272 00002000:00100000:0.0:1787119495.909678:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (6119424->6123519) req@ffff92a508ffe680 x1873929633462272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.909689:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe680 with x1873929633462272 ext(6119424->6123519) 00002000:00010000:0.0:1787119495.909694:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffe680 00000100:00100000:0.0:1787119495.909714:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10251 00000100:00100000:0.0:1787119495.909722:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633462272:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.909894:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633462272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 172us (338us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.909901:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10251 00002000:00100000:0.0:1787119495.909907:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (6119424->6123519) req@ffff92a508ffe680 x1873929633462272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.909915:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe680 with x1873929633462272 ext(6119424->6123519) 00002000:00010000:0.0:1787119495.909919:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffe680 00000100:00100000:3.0:1787119495.909994:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19667 00000100:00100000:3.0:1787119495.910299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.910515:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633462400 00000100:00100000:0.0:1787119495.910521:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633462400 00002000:00100000:0.0:1787119495.910549:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (9777152->9781247) req@ffff92a509135c00 x1873929633462400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.910558:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135c00 with x1873929633462400 ext(9777152->9781247) 00002000:00010000:0.0:1787119495.910562:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509135c00 00000100:00100000:0.0:1787119495.910584:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10252 00000100:00100000:0.0:1787119495.910591:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633462400:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.911106:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633462400:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 513us (805us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.911115:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10252 00002000:00100000:0.0:1787119495.911122:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (9777152->9781247) req@ffff92a509135c00 x1873929633462400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.911130:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135c00 with x1873929633462400 ext(9777152->9781247) 00002000:00010000:0.0:1787119495.911133:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509135c00 00000100:00100000:3.0:1787119495.920569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.920713:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633462528 00000100:00100000:1.0:1787119495.920724:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633462528 00002000:00100000:1.0:1787119495.920777:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (47034368->47091711) req@ffff92a509136300 x1873929633462528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.920789:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136300 with x1873929633462528 ext(47034368->47091711) 00002000:00010000:1.0:1787119495.920794:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136300 00000100:00100000:1.0:1787119495.920828:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10253 00000100:00100000:1.0:1787119495.920840:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633462528:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.924213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.924282:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633462784 00000100:00100000:2.0:1787119495.924294:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633462784 00000100:00100000:2.0:1787119495.924374:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19668 00000100:00100000:2.0:1787119495.924383:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+151:32727:x1873929633462784:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119495.924473:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119495.924503:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d0d expref: 151 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.924523:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119495.924528:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119495.924735:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.924749:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.924757:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119495.924812:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976482 00000004:00010000:2.0:1787119495.924837:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c6b0c8c reply state 00000000af4b61b7 transno 4294976483 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.924846:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119495.924947:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+153:32727:x1873929633462784:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 564us (744us total) trans 4294976483 rc 0/0 00000100:00100000:2.0:1787119495.924955:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19668 00000020:00080000:2.0:1787119495.924959:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119495.925055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.925325:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633462912 00000100:00100000:0.0:1787119495.925334:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633462912 00000100:00100000:2.0:1787119495.925556:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633462528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4718us (4996us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1787119495.925566:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10253 00002000:00100000:2.0:1787119495.925577:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (47034368->47091711) req@ffff92a509136300 x1873929633462528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.925587:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136300 with x1873929633462528 ext(47034368->47091711) 00002000:00010000:2.0:1787119495.925592:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136300 00002000:00100000:0.0:1787119495.925668:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (6172672->6176767) req@ffff92a509136a00 x1873929633462912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.925677:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136a00 with x1873929633462912 ext(6172672->6176767) 00002000:00010000:0.0:1787119495.925683:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136a00 00000100:00100000:0.0:1787119495.925715:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10254 00000100:00100000:0.0:1787119495.925727:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633462912:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.925940:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633462912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 217us (885us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.925947:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10254 00002000:00100000:0.0:1787119495.925953:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (6172672->6176767) req@ffff92a509136a00 x1873929633462912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.925961:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136a00 with x1873929633462912 ext(6172672->6176767) 00002000:00010000:0.0:1787119495.925964:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509136a00 00010000:00010000:2.0:1787119495.927485:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.927504:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.927512:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.927520:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119495.927525:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.927532:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.927547:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119495.927549:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119495.927552:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.927557:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3230 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119495.933674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.933726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.933954:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633463168 00000100:00100000:2.0:1787119495.933965:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633463168 00002000:00100000:2.0:1787119495.934020:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (6119424->47090097) req@ffff92a50986c380 x1873929633463168/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.934031:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c380 with x1873929633463168 ext(6119424->47090097) 00002000:00010000:2.0:1787119495.934037:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c380 00000100:00100000:2.0:1787119495.934070:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633463296 00000100:00100000:2.0:1787119495.934074:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633463296 00002000:00100000:2.0:1787119495.934090:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (9781248->9785343) req@ffff92a50986ed80 x1873929633463296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.934105:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ed80 with x1873929633463296 ext(9781248->9785343) 00002000:00010000:2.0:1787119495.934108:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986ed80 00000100:00100000:2.0:1787119495.934135:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10255 00000100:00100000:2.0:1787119495.934145:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633463168:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119495.934563:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10256 00000100:00100000:0.0:1787119495.934575:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633463296:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.934919:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633463296:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 345us (1191us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119495.934928:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10256 00002000:00100000:0.0:1787119495.934935:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (9781248->9785343) req@ffff92a50986ed80 x1873929633463296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.934943:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ed80 with x1873929633463296 ext(9781248->9785343) 00002000:00010000:0.0:1787119495.934947:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986ed80 00000100:00100000:3.0:1787119495.937058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.937225:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633463040 00000100:00100000:1.0:1787119495.937238:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633463040 00002000:00010000:1.0:1787119495.937294:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (47090098->18446744073709551615) 00002000:00100000:1.0:1787119495.937301:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ca80 with x1873929633463040 ext(47090098->18446744073709551615) 00002000:00010000:1.0:1787119495.937331:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ca80. 00000100:00100000:1.0:1787119495.937673:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10257 00000100:00100000:1.0:1787119495.937684:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633463040:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119495.937965:0:19245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 39439060 -> 47090098 00002000:00010000:1.0:1787119495.937970:0:19245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119493 -> 1787119494 00002000:00010000:1.0:1787119495.937972:0:19245:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119495.937974:0:19245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119493 -> 1787119494 00002000:00010000:1.0:1787119495.937976:0:19245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1293 -> 2447 00000100:00100000:1.0:1787119495.938034:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633463040:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 352us (988us total) trans 4294969163 rc 0/0 00000100:00100000:1.0:1787119495.938042:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10257 00002000:00010000:1.0:1787119495.938046:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (47090098->18446744073709551615) 00002000:00100000:1.0:1787119495.938048:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ca80 with x1873929633463040 ext(47090098->18446744073709551615) 00002000:00010000:1.0:1787119495.938054:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ca80. 00000100:00100000:2.0:1787119495.941278:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633463168:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 7119us (7600us total) trans 4294969164 rc 0/0 00000100:00100000:2.0:1787119495.941295:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10255 00002000:00100000:2.0:1787119495.941311:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (6119424->47090097) req@ffff92a50986c380 x1873929633463168/t4294969164(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.941323:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c380 with x1873929633463168 ext(6119424->47090097) 00002000:00010000:2.0:1787119495.941331:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c380 00000100:00100000:3.0:1787119495.948914:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.948973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.949044:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633463424 00000100:00100000:2.0:1787119495.949051:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633463552 00000100:00100000:2.0:1787119495.949056:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633463552 00000100:00100000:0.0:1787119495.949056:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633463424 00002000:00100000:2.0:1787119495.949108:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (47054848->47058943) req@ffff92a50986d180 x1873929633463552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119495.949108:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (9756672->9822207) req@ffff92a50986f800 x1873929633463424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.949121:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986d180 with x1873929633463552 ext(47054848->47058943) 00002000:00100000:0.0:1787119495.949121:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986f800 with x1873929633463424 ext(9756672->9822207) 00002000:00010000:2.0:1787119495.949127:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986d180 00002000:00010000:0.0:1787119495.949127:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986f800 00000100:00100000:2.0:1787119495.949167:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10258 00000100:00100000:0.0:1787119495.949172:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10259 00000100:00100000:2.0:1787119495.949175:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633463552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119495.949177:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633463424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.949473:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633463552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 263us (465us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.949480:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10258 00002000:00100000:2.0:1787119495.949488:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (47054848->47058943) req@ffff92a50986d180 x1873929633463552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.949497:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986d180 with x1873929633463552 ext(47054848->47058943) 00002000:00010000:2.0:1787119495.949500:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986d180 00000100:00100000:1.0:1787119495.951323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.951374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.951608:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633463808 00000100:00100000:2.0:1787119495.951622:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633463808 00000100:00100000:0.0:1787119495.951657:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633463936 00000100:00100000:0.0:1787119495.951661:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633463936 00000100:00100000:2.0:1787119495.951675:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19669 00000100:00100000:2.0:1787119495.951683:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+152:32729:x1873929633463808:12345-192.168.201.59@tcp:36:fsx.0 00000100:00100000:0.0:1787119495.951689:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5070 00000100:00100000:0.0:1787119495.951695:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633463936:12345-192.168.201.59@tcp:16:fsx.0 00010000:00010000:2.0:1787119495.951754:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119495.951781:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3181 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d14 expref: 152 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.951801:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119495.951806:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119495.952023:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.952038:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.952049:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119495.952105:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976484 00000004:00010000:2.0:1787119495.952132:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000788ae3a6 reply state 00000000e19379a7 transno 4294976485 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.952142:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119495.952237:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+154:32729:x1873929633463808:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 553us (924us total) trans 4294976485 rc 0/0 00000100:00100000:2.0:1787119495.952245:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19669 00000020:00080000:2.0:1787119495.952250:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119495.956869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.956948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.956978:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633464320 00000100:00100000:0.0:1787119495.956990:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633464320 00002000:00010000:0.0:1787119495.957033:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (47090098->18446744073709551615) 00002000:00100000:0.0:1787119495.957039:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643b80 with x1873929633464320 ext(47090098->18446744073709551615) 00002000:00010000:0.0:1787119495.957052:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643b80. 00000100:00100000:0.0:1787119495.957079:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10260 00000100:00100000:0.0:1787119495.957089:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633464320:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119495.957766:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 39439060 -> 47090098 00002000:00010000:0.0:1787119495.957772:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119493 -> 1787119494 00002000:00010000:0.0:1787119495.957774:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119495.957777:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119493 -> 1787119494 00002000:00010000:0.0:1787119495.957780:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1293 -> 2447 00000100:00100000:0.0:1787119495.957841:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633464320:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 752us (891us total) trans 4294969165 rc 0/0 00000100:00100000:0.0:1787119495.957860:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10260 00002000:00010000:0.0:1787119495.957865:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (47090098->18446744073709551615) 00002000:00100000:0.0:1787119495.957868:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643b80 with x1873929633464320 ext(47090098->18446744073709551615) 00002000:00010000:0.0:1787119495.957873:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509643b80. 00010000:00010000:2.0:1787119495.958273:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.958286:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.958293:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.958300:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119495.958306:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.958324:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.958341:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119495.958344:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119495.958349:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.958366:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3237 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.958607:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633464192 00000100:00100000:2.0:1787119495.958615:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633464192 00000100:00100000:2.0:1787119495.958718:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19670 00000100:00100000:2.0:1787119495.958729:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+153:32724:x1873929633464192:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119495.958798:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119495.958818:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d4c expref: 153 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.958831:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119495.958836:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119495.959515:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.959532:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.959542:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119495.959599:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976486 00000004:00010000:2.0:1787119495.959627:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000821b2a6c reply state 0000000046717c5b transno 4294976487 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.959636:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119495.959738:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+155:32724:x1873929633464192:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1010us (2886us total) trans 4294976487 rc 0/0 00000100:00100000:2.0:1787119495.959747:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19670 00000020:00080000:2.0:1787119495.959751:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119495.962173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.962482:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633464448 00000100:00100000:3.0:1787119495.962493:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633464448 00002000:00100000:3.0:1787119495.962546:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (47058944->47063039) req@ffff92a5098a6680 x1873929633464448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.962557:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6680 with x1873929633464448 ext(47058944->47063039) 00002000:00010000:3.0:1787119495.962563:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6680 00000100:00100000:3.0:1787119495.962594:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10261 00000100:00100000:3.0:1787119495.962605:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633464448:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.963006:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633464448:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 401us (840us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.963013:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10261 00002000:00100000:3.0:1787119495.963021:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (47058944->47063039) req@ffff92a5098a6680 x1873929633464448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.963029:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6680 with x1873929633464448 ext(47058944->47063039) 00002000:00010000:3.0:1787119495.963033:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6680 00000100:00100000:2.0:1787119495.963555:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633463424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14373us (14651us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119495.963565:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10259 00002000:00100000:2.0:1787119495.963572:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (9756672->9822207) req@ffff92a50986f800 x1873929633463424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.963581:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986f800 with x1873929633463424 ext(9756672->9822207) 00002000:00010000:2.0:1787119495.963585:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986f800 00000100:00100000:2.0:1787119495.965649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.965680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119495.965710:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.965722:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.965731:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.965739:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119495.965744:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.965752:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.965781:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119495.965786:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119495.965790:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.965796:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e323e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.965834:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633464576 00000100:00100000:2.0:1787119495.965844:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633464576 00002000:00100000:2.0:1787119495.966079:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (47054848->47058943) req@ffff92a5098a4e00 x1873929633464576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.966090:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633464576 ext(47054848->47058943) 00002000:00010000:2.0:1787119495.966095:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:2.0:1787119495.966120:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633464704 00000100:00100000:2.0:1787119495.966124:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633464704 00002000:00010000:2.0:1787119495.966139:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (64600736->18446744073709551615) 00002000:00100000:2.0:1787119495.966143:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7800 with x1873929633464704 ext(64600736->18446744073709551615) 00002000:00010000:2.0:1787119495.966155:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a7800. 00000100:00100000:2.0:1787119495.966177:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10262 00000100:00100000:2.0:1787119495.966188:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633464576:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.967167:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633464576:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 975us (1523us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119495.967177:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10262 00002000:00100000:2.0:1787119495.967185:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (47054848->47058943) req@ffff92a5098a4e00 x1873929633464576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.967194:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633464576 ext(47054848->47058943) 00002000:00010000:2.0:1787119495.967199:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:2.0:1787119495.967222:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10263 00000100:00100000:2.0:1787119495.967232:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633464704:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119495.967481:0:20838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7104934 -> 64600736 00002000:00010000:2.0:1787119495.967484:0:20838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:2.0:1787119495.967487:0:20838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119491 00002000:00010000:2.0:1787119495.967490:0:20838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:2.0:1787119495.967492:0:20838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 909 -> 909 00000100:00100000:2.0:1787119495.969919:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633464704:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 2676us (4225us total) trans 4294968902 rc 0/0 00000100:00100000:2.0:1787119495.969935:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10263 00002000:00010000:2.0:1787119495.969941:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (64600736->18446744073709551615) 00002000:00100000:2.0:1787119495.969945:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7800 with x1873929633464704 ext(64600736->18446744073709551615) 00002000:00010000:2.0:1787119495.969955:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a7800. 00000100:00100000:2.0:1787119495.970833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.972695:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633464832 00000100:00100000:3.0:1787119495.972712:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633464832 00002000:00100000:3.0:1787119495.972770:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (47034368->47091711) req@ffff92a5098a5180 x1873929633464832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.972780:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5180 with x1873929633464832 ext(47034368->47091711) 00002000:00010000:3.0:1787119495.972786:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5180 00000100:00100000:3.0:1787119495.972824:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10264 00000100:00100000:3.0:1787119495.972833:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633464832:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.974034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.976945:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633464960 00000100:00100000:3.0:1787119495.976961:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633464960 00002000:00100000:3.0:1787119495.977011:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (47058944->47063039) req@ffff92a5098a6a00 x1873929633464960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.977023:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6a00 with x1873929633464960 ext(47058944->47063039) 00002000:00010000:3.0:1787119495.977029:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6a00 00000100:00100000:3.0:1787119495.977056:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10265 00000100:00100000:3.0:1787119495.977065:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633464960:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.978062:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633464960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 995us (4036us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.978071:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10265 00002000:00100000:3.0:1787119495.978078:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (47058944->47063039) req@ffff92a5098a6a00 x1873929633464960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.978085:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6a00 with x1873929633464960 ext(47058944->47063039) 00002000:00010000:3.0:1787119495.978088:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6a00 00000100:00100000:0.0:1787119495.978962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119495.979091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.980032:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633465344 00000100:00100000:1.0:1787119495.980045:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633465344 00002000:00100000:1.0:1787119495.980090:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (64561152->64565247) req@ffff92a509641500 x1873929633465344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.980102:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641500 with x1873929633465344 ext(64561152->64565247) 00002000:00010000:1.0:1787119495.980107:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641500 00000100:00100000:1.0:1787119495.980134:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10266 00000100:00100000:1.0:1787119495.980143:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633465344:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119495.980392:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633465344:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 249us (1300us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119495.980401:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10266 00002000:00100000:1.0:1787119495.980408:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (64561152->64565247) req@ffff92a509641500 x1873929633465344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.980417:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509641500 with x1873929633465344 ext(64561152->64565247) 00002000:00010000:1.0:1787119495.980421:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509641500 00000100:00100000:3.0:1787119495.981199:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633464832:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8362us (10368us total) trans 0 rc 49152/49152 00000100:00100000:3.0:1787119495.981210:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10264 00002000:00100000:3.0:1787119495.981217:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (47034368->47091711) req@ffff92a5098a5180 x1873929633464832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.981226:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5180 with x1873929633464832 ext(47034368->47091711) 00002000:00010000:3.0:1787119495.981230:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5180 00000100:00100000:0.0:1787119495.982288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119495.982372:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633465472 00000100:00100000:1.0:1787119495.982381:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633465472 00002000:00100000:1.0:1787119495.982419:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (47034368->47091711) req@ffff92a509642d80 x1873929633465472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.982429:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642d80 with x1873929633465472 ext(47034368->47091711) 00002000:00010000:1.0:1787119495.982434:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509642d80 00000100:00100000:1.0:1787119495.982491:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10267 00000100:00100000:1.0:1787119495.982500:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633465472:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119495.983136:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633465216 00000100:00100000:2.0:1787119495.983144:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633465216 00000100:00100000:2.0:1787119495.983187:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19671 00000100:00100000:2.0:1787119495.983195:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+154:32720:x1873929633465216:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119495.983240:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119495.983276:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e31e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d37 expref: 154 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.983297:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119495.983303:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119495.983713:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.983727:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.983738:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119495.983791:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976488 00000004:00010000:2.0:1787119495.983815:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a3f74ab reply state 00000000a39aba67 transno 4294976489 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119495.983823:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119495.983921:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+156:32720:x1873929633465216:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 726us (4963us total) trans 4294976489 rc 0/0 00000100:00100000:2.0:1787119495.983928:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19671 00000020:00080000:2.0:1787119495.983934:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119495.987796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.987879:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633465600 00000100:00100000:3.0:1787119495.987890:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633465600 00002000:00100000:3.0:1787119495.987936:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (6119424->47090097) req@ffff92a5098a6d80 x1873929633465600/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.987948:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633465600 ext(6119424->47090097) 00002000:00010000:3.0:1787119495.987953:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6d80 00000100:00100000:3.0:1787119495.987984:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10268 00000100:00100000:3.0:1787119495.987993:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633465600:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119495.988578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119495.988674:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.988685:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.988693:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.988699:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119495.988704:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.988711:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.988726:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119495.988730:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119495.988735:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119495.988741:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3245 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119495.988879:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633465728 00000100:00100000:3.0:1787119495.988884:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633465728 00002000:00100000:3.0:1787119495.988911:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (64565248->64569343) req@ffff92a5098a7100 x1873929633465728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.988919:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7100 with x1873929633465728 ext(64565248->64569343) 00002000:00010000:3.0:1787119495.988923:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a7100 00000100:00100000:3.0:1787119495.988944:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10269 00000100:00100000:3.0:1787119495.988951:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633465728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119495.989193:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633465728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 240us (615us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119495.989203:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10269 00002000:00100000:3.0:1787119495.989210:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (64565248->64569343) req@ffff92a5098a7100 x1873929633465728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 488/4536 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.989218:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7100 with x1873929633465728 ext(64565248->64569343) 00002000:00010000:3.0:1787119495.989221:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a7100 00000100:00100000:2.0:1787119495.989756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119495.990723:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633465856 00000100:00100000:3.0:1787119495.990736:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633465856 00002000:00010000:3.0:1787119495.990768:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (63981300->18446744073709551615) 00002000:00100000:3.0:1787119495.990773:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7b80 with x1873929633465856 ext(63981300->18446744073709551615) 00002000:00010000:3.0:1787119495.990840:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a7b80. 00000100:00100000:1.0:1787119495.991305:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633465472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8803us (9021us total) trans 0 rc 49152/49152 00000100:00100000:1.0:1787119495.991315:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10267 00002000:00100000:1.0:1787119495.991324:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (47034368->47091711) req@ffff92a509642d80 x1873929633465472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/440 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119495.991333:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509642d80 with x1873929633465472 ext(47034368->47091711) 00002000:00010000:1.0:1787119495.991337:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509642d80 00000100:00100000:1.0:1787119495.991371:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10270 00000100:00100000:1.0:1787119495.991383:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633465856:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119495.991657:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 60381765 -> 63981300 00002000:00010000:1.0:1787119495.991662:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119495.991664:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119495.991666:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119495.991668:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 2831 -> 2959 00000100:00100000:1.0:1787119495.991691:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633465856:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 311us (1937us total) trans 4294968903 rc 0/0 00000100:00100000:1.0:1787119495.991698:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10270 00002000:00010000:1.0:1787119495.991702:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (63981300->18446744073709551615) 00002000:00100000:1.0:1787119495.991705:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7b80 with x1873929633465856 ext(63981300->18446744073709551615) 00002000:00010000:1.0:1787119495.991710:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a7b80. 00000100:00100000:3.0:1787119495.997475:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633465600:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9438us (9644us total) trans 4294969166 rc 0/0 00000100:00100000:3.0:1787119495.997493:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10268 00002000:00100000:3.0:1787119495.997508:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (6119424->47090097) req@ffff92a5098a6d80 x1873929633465600/t4294969166(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119495.997525:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633465600 ext(6119424->47090097) 00002000:00010000:3.0:1787119495.997533:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6d80 00000100:00100000:2.0:1787119495.998656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.998790:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119495.998817:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633466112 00000100:00100000:2.0:1787119495.998825:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633466112 00002000:00100000:2.0:1787119495.998873:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (6119424->47090097) req@ffff92a5098a2300 x1873929633466112/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/0 e 0 to 0 dl 1787119506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119495.998885:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2300 with x1873929633466112 ext(6119424->47090097) 00002000:00010000:2.0:1787119495.998889:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a2300 00000100:00100000:2.0:1787119495.998917:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10271 00000100:00100000:2.0:1787119495.998927:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633466112:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119495.999026:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633465984 00000100:00100000:0.0:1787119495.999031:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633465984 00000100:00100000:0.0:1787119495.999068:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19672 00000100:00100000:0.0:1787119495.999074:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+155:32720:x1873929633465984:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119495.999089:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119495.999109:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fbe00/0xcaba3de8463e324c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d53 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.999190:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e3253 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.999204:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e3253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.999214:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e3253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119495.999238:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 63981300 00000004:00200000:0.0:1787119495.999242:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119495.999261:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e3253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.999286:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fbe00/0xcaba3de8463e324c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d53 expref: 157 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.999303:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e3253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d53 expref: 156 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119495.999311:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119495.999315:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119495.999634:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038faa00, rc 0) 00000100:00100000:0.0:1787119495.999668:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+156:32720:x1873929633465984:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 593us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119495.999676:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19672 00000100:00100000:3.0:1787119496.000044:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.000733:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633466240 00000100:00100000:2.0:1787119496.000742:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633466240 00002000:00100000:2.0:1787119496.000775:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (64540672->64602111) req@ffff92a50986c700 x1873929633466240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.000787:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c700 with x1873929633466240 ext(64540672->64602111) 00002000:00010000:2.0:1787119496.000792:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986c700 00000100:00100000:2.0:1787119496.000820:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10272 00000100:00100000:2.0:1787119496.000828:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633466240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.003666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.003782:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633466368 00000100:00100000:0.0:1787119496.003793:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633466368 00000100:00100000:0.0:1787119496.003841:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5071 00000100:00100000:0.0:1787119496.003850:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2374:x1873929633466368:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119496.010476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.010513:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633466496 00000100:00100000:2.0:1787119496.010526:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633466496 00002000:00100000:2.0:1787119496.010572:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (48726016->48730111) req@ffff92a5098a0380 x1873929633466496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.010584:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0380 with x1873929633466496 ext(48726016->48730111) 00002000:00010000:2.0:1787119496.010591:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a0380 00000100:00100000:2.0:1787119496.010617:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10273 00000100:00100000:2.0:1787119496.010626:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633466496:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.011230:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633466496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 601us (796us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.011239:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10273 00002000:00100000:2.0:1787119496.011248:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (48726016->48730111) req@ffff92a5098a0380 x1873929633466496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.011257:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0380 with x1873929633466496 ext(48726016->48730111) 00002000:00010000:2.0:1787119496.011261:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a0380 00000100:00100000:3.0:1787119496.011647:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633466240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10817us (11601us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1787119496.011655:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10272 00002000:00100000:3.0:1787119496.011661:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (64540672->64602111) req@ffff92a50986c700 x1873929633466240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.011670:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c700 with x1873929633466240 ext(64540672->64602111) 00002000:00010000:3.0:1787119496.011674:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50986c700 00000001:00080000:0.0:1787119496.013436:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969163 is committed 00000001:00080000:0.0:1787119496.013478:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969164 is committed 00000100:00100000:0.0:1787119496.013820:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633463936:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 62118us (62440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.013830:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5070 00000100:00100000:0.0:1787119496.017144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.017244:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633466624 00000100:00100000:3.0:1787119496.017257:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633466624 00002000:00100000:3.0:1787119496.017313:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (48730112->48734207) req@ffff92a509643100 x1873929633466624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.017325:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643100 with x1873929633466624 ext(48730112->48734207) 00002000:00010000:3.0:1787119496.017332:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509643100 00000100:00100000:3.0:1787119496.017377:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10274 00000100:00100000:3.0:1787119496.017387:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633466624:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.017636:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633466624:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 250us (502us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.017644:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10274 00002000:00100000:3.0:1787119496.017651:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (48730112->48734207) req@ffff92a509643100 x1873929633466624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.017659:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643100 with x1873929633466624 ext(48730112->48734207) 00002000:00010000:3.0:1787119496.017663:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509643100 00000100:00100000:0.0:1787119496.019172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.020370:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633466752 00000100:00100000:3.0:1787119496.020383:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633466752 00000100:00100000:3.0:1787119496.020465:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19673 00000100:00100000:3.0:1787119496.020476:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+156:32728:x1873929633466752:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119496.020494:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119496.020516:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e325a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d5a expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.020601:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3261 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.020615:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.020627:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119496.020653:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 47090098 00000004:00200000:3.0:1787119496.020657:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119496.020676:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.020703:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e325a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d5a expref: 158 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.020721:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d5a expref: 157 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.020731:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119496.020734:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119496.020737:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119496.020795:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+157:32728:x1873929633466752:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 321us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.020802:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19673 00000100:00100000:2.0:1787119496.021529:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633466112:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 22600us (22735us total) trans 4294969167 rc 0/0 00000100:00100000:2.0:1787119496.021539:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10271 00002000:00100000:2.0:1787119496.021548:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (6119424->47090097) req@ffff92a5098a2300 x1873929633466112/t4294969167(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:531/0 lens 504/448 e 0 to 0 dl 1787119506 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.021557:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a2300 with x1873929633466112 ext(6119424->47090097) 00002000:00010000:2.0:1787119496.021562:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a2300 00000100:00100000:0.0:1787119496.024283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.024370:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633466880 00000100:00100000:2.0:1787119496.024380:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633466880 00002000:00100000:2.0:1787119496.024426:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (64561152->64600735) req@ffff92a509640a80 x1873929633466880/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.024462:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640a80 with x1873929633466880 ext(64561152->64600735) 00002000:00010000:2.0:1787119496.024469:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640a80 00000100:00100000:2.0:1787119496.024503:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10275 00000100:00100000:2.0:1787119496.024513:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633466880:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119496.028768:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633466880:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 4242us (4479us total) trans 4294968904 rc 0/0 00000100:00100000:0.0:1787119496.028785:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10275 00002000:00100000:0.0:1787119496.028801:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (64561152->64600735) req@ffff92a509640a80 x1873929633466880/t4294968904(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.028812:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509640a80 with x1873929633466880 ext(64561152->64600735) 00002000:00010000:0.0:1787119496.028820:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509640a80 00000100:00100000:3.0:1787119496.031235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.031332:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633467008 00000100:00100000:2.0:1787119496.031342:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633467008 00000100:00100000:2.0:1787119496.031549:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5072 00000100:00100000:2.0:1787119496.031562:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633467008:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119496.034594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.034701:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633467264 00000100:00100000:1.0:1787119496.034711:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633467264 00000100:00100000:1.0:1787119496.034773:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19674 00000100:00100000:1.0:1787119496.034784:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+157:32728:x1873929633467264:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119496.034843:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119496.034886:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3261 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d5a expref: 157 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.034904:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119496.034909:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119496.035113:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.035128:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.035140:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119496.035187:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976490 00000004:00010000:1.0:1787119496.035212:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089b68cb2 reply state 00000000a26dacde transno 4294976491 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.035221:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119496.035302:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+159:32728:x1873929633467264:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 519us (716us total) trans 4294976491 rc 0/0 00000100:00100000:1.0:1787119496.035309:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19674 00000020:00080000:1.0:1787119496.035314:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119496.040980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.041023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.041079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119496.041108:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.041124:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.041133:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.041141:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119496.041147:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.041156:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.041175:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119496.041178:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119496.041182:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.041188:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.041257:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633467392 00000100:00100000:1.0:1787119496.041266:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633467392 00002000:00100000:1.0:1787119496.041309:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (48705536->48771071) req@ffff92a509643800 x1873929633467392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.041326:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643800 with x1873929633467392 ext(48705536->48771071) 00002000:00010000:1.0:1787119496.041331:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509643800 00000100:00100000:1.0:1787119496.041363:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633467648 00000100:00100000:1.0:1787119496.041366:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633467648 00002000:00010000:1.0:1787119496.041381:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (60381765->18446744073709551615) 00002000:00100000:1.0:1787119496.041384:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2d80 with x1873929633467648 ext(60381765->18446744073709551615) 00002000:00010000:1.0:1787119496.041393:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2d80. 00000100:00100000:1.0:1787119496.041411:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10276 00000100:00100000:1.0:1787119496.041419:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633467392:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.041683:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10277 00000100:00100000:1.0:1787119496.041691:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633467648:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119496.042005:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 47090098 -> 60381765 00002000:00010000:1.0:1787119496.042009:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119496.042012:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119496.042014:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119496.042017:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2447 -> 2831 00000100:00100000:1.0:1787119496.042053:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633467648:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 362us (973us total) trans 4294969168 rc 0/0 00000100:00100000:1.0:1787119496.042060:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10277 00002000:00010000:1.0:1787119496.042063:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (60381765->18446744073709551615) 00002000:00100000:1.0:1787119496.042066:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2d80 with x1873929633467648 ext(60381765->18446744073709551615) 00002000:00010000:1.0:1787119496.042070:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2d80. 00000100:00100000:2.0:1787119496.042274:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633467520 00000100:00100000:2.0:1787119496.042280:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633467520 00000100:00100000:2.0:1787119496.042321:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5073 00000100:00100000:2.0:1787119496.042328:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633467520:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119496.045528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.046274:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633467776 00000100:00100000:3.0:1787119496.046286:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633467776 00000100:00100000:3.0:1787119496.046353:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19675 00000100:00100000:3.0:1787119496.046470:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+158:32728:x1873929633467776:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119496.046500:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119496.046525:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e326f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d61 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.046614:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.046628:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.046639:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119496.046667:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 60381765 00000004:00200000:3.0:1787119496.046671:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119496.046690:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.046716:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e326f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d61 expref: 160 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.048193:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d61 expref: 159 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.048204:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119496.048207:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119496.048211:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0600, rc 0) 00000100:00100000:3.0:1787119496.048266:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+159:32728:x1873929633467776:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1802us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.048274:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19675 00000100:00100000:3.0:1787119496.048531:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633467392:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7112us (7561us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119496.048537:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10276 00002000:00100000:3.0:1787119496.048545:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (48705536->48771071) req@ffff92a509643800 x1873929633467392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.048551:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509643800 with x1873929633467392 ext(48705536->48771071) 00002000:00010000:3.0:1787119496.048556:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509643800 00000001:00080000:3.0:1787119496.052125:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969165 is committed 00000001:00080000:3.0:1787119496.052148:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969166 is committed 00000100:00100000:2.0:1787119496.055313:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633466368:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 51452us (51648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119496.055335:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5071 00000100:00100000:3.0:1787119496.055826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.056691:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633467904 00000100:00100000:3.0:1787119496.056702:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633467904 00002000:00100000:3.0:1787119496.056748:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (49610752->49614847) req@ffff92a50986ce00 x1873929633467904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.056760:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ce00 with x1873929633467904 ext(49610752->49614847) 00002000:00010000:3.0:1787119496.056765:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ce00 00000100:00100000:3.0:1787119496.056788:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10278 00000100:00100000:3.0:1787119496.056798:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633467904:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.057055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.057346:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633468032 00000100:00100000:2.0:1787119496.057351:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633468032 00002000:00100000:2.0:1787119496.057479:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (48771072->48807935) req@ffff92a62a999f80 x1873929633468032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.057500:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999f80 with x1873929633468032 ext(48771072->48807935) 00002000:00010000:2.0:1787119496.057505:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a999f80 00000100:00100000:2.0:1787119496.057524:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10279 00000100:00100000:2.0:1787119496.057539:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633468032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.058227:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633467904:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1426us (2397us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.058236:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10278 00002000:00100000:3.0:1787119496.058244:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (49610752->49614847) req@ffff92a50986ce00 x1873929633467904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.058253:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ce00 with x1873929633467904 ext(49610752->49614847) 00002000:00010000:3.0:1787119496.058257:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ce00 00000100:00100000:3.0:1787119496.061003:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633468032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3462us (3938us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119496.061016:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10279 00002000:00100000:3.0:1787119496.061029:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (48771072->48807935) req@ffff92a62a999f80 x1873929633468032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.061040:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999f80 with x1873929633468032 ext(48771072->48807935) 00002000:00010000:3.0:1787119496.061046:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a999f80 00000100:00100000:2.0:1787119496.061519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.061576:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633468160 00000100:00100000:3.0:1787119496.061585:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633468160 00000100:00100000:3.0:1787119496.061666:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19676 00000100:00100000:3.0:1787119496.061675:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+159:32727:x1873929633468160:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119496.061694:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119496.061713:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e327d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d68 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.061799:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3284 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.061813:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.061824:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119496.061850:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 47090098 00000004:00200000:3.0:1787119496.061866:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119496.061882:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.061907:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e327d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d68 expref: 161 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.061923:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3284 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d68 expref: 160 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.061931:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119496.061934:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119496.061938:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0800, rc 0) 00000100:00100000:3.0:1787119496.061970:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+160:32727:x1873929633468160:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 296us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.061981:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19676 00000100:00100000:3.0:1787119496.075590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.076637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.076680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.076769:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633468544 00000100:00100000:0.0:1787119496.076779:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633468544 00000100:00100000:0.0:1787119496.076831:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633468800 00000100:00100000:0.0:1787119496.076834:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633468800 00000100:00100000:0.0:1787119496.076856:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19677 00000100:00100000:0.0:1787119496.076864:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+161:32720:x1873929633468544:12345-192.168.201.59@tcp:36:fsx.0 00000100:00100000:2.0:1787119496.076869:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19678 00000100:00100000:2.0:1787119496.076876:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+161:32727:x1873929633468800:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119496.076912:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119496.076912:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119496.076942:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3284 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d68 expref: 161 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.076942:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e3253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d53 expref: 161 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.076963:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119496.076963:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119496.076967:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119496.076967:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119496.077172:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.077182:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633468288 00000100:00100000:1.0:1787119496.077186:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633468288 00010000:00010000:2.0:1787119496.077188:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.077197:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1787119496.077429:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (49614848->49618943) req@ffff92a50986ea00 x1873929633468288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.077465:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ea00 with x1873929633468288 ext(49614848->49618943) 00002000:00010000:1.0:1787119496.077470:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ea00 00000100:00100000:1.0:1787119496.077492:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10280 00000100:00100000:1.0:1787119496.077500:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633468288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.077693:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633468288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 193us (2111us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.077701:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10280 00002000:00100000:1.0:1787119496.077709:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (49614848->49618943) req@ffff92a50986ea00 x1873929633468288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.077717:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986ea00 with x1873929633468288 ext(49614848->49618943) 00002000:00010000:1.0:1787119496.077720:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986ea00 00010000:00010000:0.0:1787119496.079576:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.079598:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.079608:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119496.079662:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976493 00000004:00010000:0.0:1787119496.079690:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000626f1fa3 reply state 000000007640db4f transno 4294976494 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.079700:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119496.079805:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+163:32720:x1873929633468544:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 2938us (3168us total) trans 4294976494 rc 0/0 00000100:00100000:0.0:1787119496.079814:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19677 00000020:00080000:0.0:1787119496.079818:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1787119496.082621:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976492 00000004:00010000:2.0:1787119496.082696:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d638e9d reply state 000000005d1dc2b2 transno 4294976495 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.082709:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119496.083926:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+164:32727:x1873929633468800:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 7041us (7236us total) trans 4294976495 rc 0/0 00000100:00100000:2.0:1787119496.083939:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19678 00000020:00080000:2.0:1787119496.083946:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119496.086716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.086803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.086827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.086846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.086888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.086916:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633469184 00000100:00100000:0.0:1787119496.086927:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633469184 00000100:00100000:2.0:1787119496.087564:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633469056 00000100:00100000:2.0:1787119496.087571:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633469056 00010000:00010000:0.0:1787119496.088053:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.088068:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.088075:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.088080:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119496.088085:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.088092:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.088108:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119496.088111:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119496.088116:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.088122:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3292 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.088149:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633469440 00000100:00100000:0.0:1787119496.088154:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633469440 00000100:00100000:3.0:1787119496.088167:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633469312 00000100:00100000:3.0:1787119496.088170:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633469312 00002000:00010000:0.0:1787119496.088182:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (3317751->18446744073709551615) 00002000:00100000:0.0:1787119496.088186:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1c00 with x1873929633469440 ext(3317751->18446744073709551615) 00002000:00010000:0.0:1787119496.088196:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e1c00. 00000100:00100000:3.0:1787119496.088203:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 574 00000100:00100000:0.0:1787119496.088212:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10281 00000100:00100000:3.0:1787119496.088213:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633469184:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119496.088217:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633469440:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:3.0:1787119496.088273:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633469184:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 61us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.088280:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 574 00000100:00100000:3.0:1787119496.088296:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 575 00000100:00100000:3.0:1787119496.088301:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633469312:12345-192.168.201.59@tcp:400:kworker.0 00000100:00080000:0.0:1787119496.088938:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119496.088944:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787119496.088947:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119496.089107:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633468928 00000100:00100000:1.0:1787119496.089115:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633468928 00000100:00100000:1.0:1787119496.089149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 514 00000100:00100000:1.0:1787119496.089157:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633468928:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119496.089382:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 679 00000100:00100000:2.0:1787119496.089391:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2376:x1873929633469056:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119496.089479:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633469312:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 1175us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.089487:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 575 00002000:00010000:0.0:1787119496.089662:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 63981300 -> 3317751 00002000:00010000:0.0:1787119496.089666:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:0.0:1787119496.089669:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119496.089671:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:0.0:1787119496.089674:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:1.0:1787119496.092084:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633468928:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 2914us (5364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.092097:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 514 00000100:00100000:1.0:1787119496.092309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119496.092577:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.092589:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.092596:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.092601:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119496.092606:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.092613:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.092714:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119496.092718:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119496.092723:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.092729:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e328b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.092774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.092914:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633469568 00000100:00100000:3.0:1787119496.092922:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633469568 00002000:00100000:3.0:1787119496.092958:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (49590272->49655807) req@ffff92a62a999880 x1873929633469568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.092967:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999880 with x1873929633469568 ext(49590272->49655807) 00002000:00010000:3.0:1787119496.092972:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a999880 00000100:00100000:3.0:1787119496.092996:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633469696 00000100:00100000:3.0:1787119496.093000:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633469696 00002000:00010000:3.0:1787119496.093010:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (60381765->18446744073709551615) 00002000:00100000:3.0:1787119496.093013:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99bb80 with x1873929633469696 ext(60381765->18446744073709551615) 00002000:00010000:3.0:1787119496.093022:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99bb80. 00000100:00100000:3.0:1787119496.093037:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10282 00000100:00100000:3.0:1787119496.093045:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633469568:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.093543:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10283 00000100:00100000:1.0:1787119496.093554:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633469696:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119496.093788:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 47090098 -> 60381765 00002000:00010000:1.0:1787119496.093792:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119496.093795:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119496.093797:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119496.093799:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 2447 -> 2831 00000100:00100000:1.0:1787119496.093841:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633469696:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 289us (1066us total) trans 4294969169 rc 0/0 00000100:00100000:1.0:1787119496.093848:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10283 00002000:00010000:1.0:1787119496.093858:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (60381765->18446744073709551615) 00002000:00100000:1.0:1787119496.093861:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99bb80 with x1873929633469696 ext(60381765->18446744073709551615) 00002000:00010000:1.0:1787119496.093867:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99bb80. 00000100:00100000:2.0:1787119496.096424:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2376:x1873929633469056:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 7024us (9585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119496.096465:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 679 00000100:00100000:0.0:1787119496.097495:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633469440:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 9268us (10597us total) trans 4294968905 rc 0/0 00000100:00100000:0.0:1787119496.097508:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10281 00002000:00010000:0.0:1787119496.097513:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (3317751->18446744073709551615) 00002000:00100000:0.0:1787119496.097517:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e1c00 with x1873929633469440 ext(3317751->18446744073709551615) 00002000:00010000:0.0:1787119496.097528:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e1c00. 00000100:00100000:2.0:1787119496.100967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.104646:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633469568:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11580us (12315us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119496.104662:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10282 00002000:00100000:0.0:1787119496.104677:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (49590272->49655807) req@ffff92a62a999880 x1873929633469568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.104688:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a999880 with x1873929633469568 ext(49590272->49655807) 00002000:00010000:0.0:1787119496.104694:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a999880 00000100:00100000:3.0:1787119496.104823:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633469824 00000100:00100000:3.0:1787119496.104833:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633469824 00000100:00100000:0.0:1787119496.105470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.105479:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633469952 00000100:00100000:3.0:1787119496.105483:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633469952 00000100:00100000:0.0:1787119496.105500:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19679 00000100:00100000:3.0:1787119496.105507:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19680 00000100:00100000:0.0:1787119496.105510:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+163:32727:x1873929633469824:12345-192.168.201.59@tcp:101:fsx.0 00000100:00100000:3.0:1787119496.105513:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+163:32720:x1873929633469952:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119496.105802:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119496.105824:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d76 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.105835:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119496.105847:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e32a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d6f expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.105922:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e32a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.105937:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e32a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.105949:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e32a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.105964:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e32ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.105972:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e32ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119496.105975:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 60381765 00010000:00010000:3.0:1787119496.105979:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e32ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119496.105979:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00200000:3.0:1787119496.105990:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 3317751 00000004:00200000:3.0:1787119496.105993:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119496.105997:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e32a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787119496.106000:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e32ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.106024:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d76 expref: 167 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.106024:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e32a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d6f expref: 167 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.106042:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e32ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d76 expref: 165 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.106042:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e32a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d6f expref: 165 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.106052:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119496.106052:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119496.106055:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119496.106055:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119496.106059:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00010000:00010000:0.0:1787119496.106059:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038faa00, rc 0) 00000100:00100000:3.0:1787119496.106628:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+165:32720:x1873929633469952:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1111us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.106638:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19680 00000100:00100000:0.0:1787119496.106667:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+164:32727:x1873929633469824:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1157us (5708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.106673:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19679 00000001:00080000:3.0:1787119496.106816:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969168 is committed 00000100:00100000:0.0:1787119496.106898:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633467008:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 75339us (75674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.106910:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5072 00000001:00080000:3.0:1787119496.108181:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968904 is committed 00000100:00100000:2.0:1787119496.108576:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633467520:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 66244us (67548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119496.108586:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5073 00000100:00100000:3.0:1787119496.111152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.111400:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633470080 00000100:00100000:0.0:1787119496.111411:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633470080 00002000:00100000:0.0:1787119496.111498:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (49610752->49614847) req@ffff92a50986c000 x1873929633470080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.111510:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c000 with x1873929633470080 ext(49610752->49614847) 00002000:00010000:0.0:1787119496.111515:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c000 00000100:00100000:0.0:1787119496.111545:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10284 00000100:00100000:0.0:1787119496.111555:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50986c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633470080:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.111787:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50986c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633470080:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 233us (645us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.111795:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10284 00002000:00100000:0.0:1787119496.111801:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (49610752->49614847) req@ffff92a50986c000 x1873929633470080/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.111809:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50986c000 with x1873929633470080 ext(49610752->49614847) 00002000:00010000:0.0:1787119496.111813:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50986c000 00000100:00100000:3.0:1787119496.113410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.114023:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633470208 00000100:00100000:2.0:1787119496.114036:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633470208 00000100:00100000:2.0:1787119496.114119:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19681 00000100:00100000:2.0:1787119496.114131:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+164:32729:x1873929633470208:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119496.114158:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119496.114185:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e32b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d7d expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.114296:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e32bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.114392:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e32bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.114408:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e32bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119496.114484:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 47090098 00000004:00200000:2.0:1787119496.114489:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119496.114514:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e32bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.114543:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e32b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d7d expref: 166 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.114560:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e32bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d7d expref: 165 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.114569:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119496.114572:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119496.114576:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92000, rc 0) 00000100:00100000:2.0:1787119496.114715:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+165:32729:x1873929633470208:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 586us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119496.114722:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19681 00000100:00100000:2.0:1787119496.118033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.118070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.118107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.118189:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633470336 00000100:00100000:3.0:1787119496.118199:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633470336 00000100:00100000:3.0:1787119496.118250:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633470592 00000100:00100000:3.0:1787119496.118253:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633470592 00000100:00100000:3.0:1787119496.118279:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19682 00000100:00100000:3.0:1787119496.118288:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+166:32724:x1873929633470336:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119496.118310:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119496.118338:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e32c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.118416:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633470720 00000100:00100000:0.0:1787119496.118421:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633470720 00010000:00010000:3.0:1787119496.118431:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e32ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.118476:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e32ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787119496.118481:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (49614848->49618943) req@ffff92a5098a0000 x1873929633470720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787119496.118487:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e32ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787119496.118490:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0000 with x1873929633470720 ext(49614848->49618943) 00002000:00010000:0.0:1787119496.118495:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0000 00000100:00100000:0.0:1787119496.118513:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10285 00000004:00200000:3.0:1787119496.118514:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 64600736 00000004:00200000:3.0:1787119496.118518:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1787119496.118520:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633470720:12345-192.168.201.59@tcp:3:fsx.0 00000004:00010000:3.0:1787119496.118536:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e32ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.118561:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e32c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d84 expref: 168 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.118579:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e32ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d84 expref: 167 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.118587:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:3.0:1787119496.118589:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119496.118592:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1600, rc 0) 00000100:00100000:3.0:1787119496.118660:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+167:32724:x1873929633470336:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 373us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.118666:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19682 00000100:00100000:3.0:1787119496.118682:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19683 00000100:00100000:3.0:1787119496.118688:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+166:32720:x1873929633470592:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119496.118713:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119496.118729:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e32ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d76 expref: 166 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.118730:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633470720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 211us (622us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.118737:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10285 00010000:00010000:3.0:1787119496.118740:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119496.118743:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1787119496.118743:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (49614848->49618943) req@ffff92a5098a0000 x1873929633470720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.118750:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0000 with x1873929633470720 ext(49614848->49618943) 00002000:00010000:0.0:1787119496.118753:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0000 00010000:00010000:3.0:1787119496.118936:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.118946:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.118954:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119496.119001:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976496 00000004:00010000:3.0:1787119496.119025:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006909dcab reply state 000000005f1d639d transno 4294976497 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.119035:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119496.119077:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+168:32720:x1873929633470592:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 388us (1007us total) trans 4294976497 rc 0/0 00000100:00100000:3.0:1787119496.119084:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19683 00000020:00080000:3.0:1787119496.119088:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119496.121831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.121983:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633470848 00000100:00100000:3.0:1787119496.121993:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633470848 00002000:00100000:3.0:1787119496.122036:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (49610752->49647615) req@ffff92a5098a1f80 x1873929633470848/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.122049:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1f80 with x1873929633470848 ext(49610752->49647615) 00002000:00010000:3.0:1787119496.122055:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a1f80 00000100:00100000:3.0:1787119496.122134:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10286 00000100:00100000:3.0:1787119496.122149:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633470848:12345-192.168.201.59@tcp:4:fsx.0 00010000:00010000:0.0:1787119496.123347:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.123363:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.123370:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.123377:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119496.123381:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.123389:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.123417:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119496.123420:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119496.123424:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.123429:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e32d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.124326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.125476:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633470976 00000100:00100000:3.0:1787119496.125488:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633470976 00002000:00010000:3.0:1787119496.125528:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (13267460->18446744073709551615) 00002000:00100000:3.0:1787119496.125534:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3b80 with x1873929633470976 ext(13267460->18446744073709551615) 00002000:00010000:3.0:1787119496.125546:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a3b80. 00000100:00100000:3.0:1787119496.125582:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10287 00000100:00100000:3.0:1787119496.125592:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633470976:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119496.126174:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 3317751 -> 13267460 00002000:00010000:3.0:1787119496.126193:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:3.0:1787119496.126196:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119496.126198:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:3.0:1787119496.126200:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:3.0:1787119496.127491:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633470976:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1891us (3165us total) trans 4294968906 rc 0/0 00000100:00100000:0.0:1787119496.127491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.127504:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10287 00002000:00010000:3.0:1787119496.127511:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (13267460->18446744073709551615) 00002000:00100000:3.0:1787119496.127514:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a3b80 with x1873929633470976 ext(13267460->18446744073709551615) 00002000:00010000:3.0:1787119496.127524:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a3b80. 00000100:00100000:3.0:1787119496.127551:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633471104 00000100:00100000:3.0:1787119496.127559:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633471104 00002000:00100000:3.0:1787119496.127592:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (4575232->4579327) req@ffff92a5069e0000 x1873929633471104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.127602:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0000 with x1873929633471104 ext(4575232->4579327) 00002000:00010000:3.0:1787119496.127607:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e0000 00000100:00100000:3.0:1787119496.127999:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10288 00000100:00100000:3.0:1787119496.128010:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633471104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.128290:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633471104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 281us (808us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.128297:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10288 00002000:00100000:3.0:1787119496.128304:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (4575232->4579327) req@ffff92a5069e0000 x1873929633471104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.128321:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e0000 with x1873929633471104 ext(4575232->4579327) 00002000:00010000:3.0:1787119496.128326:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5069e0000 00000100:00100000:3.0:1787119496.134264:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633470848:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 12105us (12427us total) trans 4294969170 rc 0/0 00000100:00100000:3.0:1787119496.134280:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10286 00002000:00100000:3.0:1787119496.134513:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (49610752->49647615) req@ffff92a5098a1f80 x1873929633470848/t4294969170(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.134523:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1f80 with x1873929633470848 ext(49610752->49647615) 00002000:00010000:3.0:1787119496.134529:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a1f80 00000100:00100000:0.0:1787119496.135136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.135180:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633471232 00000100:00100000:1.0:1787119496.135188:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633471232 00002000:00100000:1.0:1787119496.135227:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (49590272->49655807) req@ffff92a5069e2a00 x1873929633471232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.135236:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2a00 with x1873929633471232 ext(49590272->49655807) 00002000:00010000:1.0:1787119496.135240:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2a00 00000100:00100000:1.0:1787119496.135269:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10289 00000100:00100000:1.0:1787119496.135278:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5069e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633471232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.136008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.136044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.136064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.136283:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633471360 00000100:00100000:0.0:1787119496.136291:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633471360 00002000:00100000:0.0:1787119496.136392:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (4579328->4583423) req@ffff92a62041ed80 x1873929633471360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.136403:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ed80 with x1873929633471360 ext(4579328->4583423) 00002000:00010000:0.0:1787119496.136408:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041ed80 00000100:00100000:0.0:1787119496.136433:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10290 00000100:00100000:0.0:1787119496.136469:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633471360:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.136491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.136563:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633471872 00000100:00100000:2.0:1787119496.136567:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633471872 00000100:00100000:2.0:1787119496.136601:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5074 00000100:00100000:2.0:1787119496.136608:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633471872:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119496.136647:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633471616 00000100:00100000:2.0:1787119496.136650:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633471616 00000100:00100000:0.0:1787119496.136655:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633471360:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 213us (650us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.136662:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10290 00002000:00100000:0.0:1787119496.136668:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (4579328->4583423) req@ffff92a62041ed80 x1873929633471360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787119496.136672:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633471744 00000100:00100000:2.0:1787119496.136674:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633471744 00002000:00100000:0.0:1787119496.136677:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ed80 with x1873929633471360 ext(4579328->4583423) 00002000:00010000:0.0:1787119496.136681:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041ed80 00000100:00100000:2.0:1787119496.136690:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19684 00000100:00100000:2.0:1787119496.136696:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+168:32729:x1873929633471616:12345-192.168.201.59@tcp:36:fsx.0 00000100:00100000:0.0:1787119496.136702:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19685 00000100:00100000:0.0:1787119496.136708:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+168:32720:x1873929633471744:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119496.136716:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119496.136738:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119496.136738:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e32d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d8b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.136763:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e32bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d7d expref: 169 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.136778:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119496.136782:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119496.136806:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e32df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.136817:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e32df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.136826:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e32df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119496.136859:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 13267460 00000004:00200000:0.0:1787119496.136864:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119496.136882:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e32df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.136906:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e32d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d8b expref: 169 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.136921:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e32df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d8b expref: 168 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.136928:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119496.136931:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119496.136933:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa200, rc 0) 00000100:00100000:0.0:1787119496.136955:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+168:32720:x1873929633471744:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 247us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.136961:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19685 00010000:00010000:2.0:1787119496.138435:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.138481:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.138490:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119496.138553:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976498 00000004:00010000:2.0:1787119496.138575:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008acbceda reply state 000000004482c5cc transno 4294976499 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.138583:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119496.138677:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+170:32729:x1873929633471616:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1978us (2630us total) trans 4294976499 rc 0/0 00000100:00100000:2.0:1787119496.138684:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19684 00000020:00080000:2.0:1787119496.138689:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787119496.162996:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119496.163523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119496.163622:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.163635:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.163643:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.163654:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119496.163659:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.163667:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.163682:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119496.163686:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119496.163691:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.163697:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e32e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.163821:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633472000 00000100:00100000:2.0:1787119496.163832:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633472000 00002000:00100000:2.0:1787119496.163889:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (4554752->4620287) req@ffff92a62041ca80 x1873929633472000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.163906:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ca80 with x1873929633472000 ext(4554752->4620287) 00002000:00010000:2.0:1787119496.163911:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041ca80 00000100:00100000:2.0:1787119496.163940:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10291 00000100:00100000:2.0:1787119496.163949:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633472000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.164564:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5069e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633471232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 29284us (29426us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119496.164573:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10289 00002000:00100000:1.0:1787119496.164581:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (49590272->49655807) req@ffff92a5069e2a00 x1873929633471232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.164589:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5069e2a00 with x1873929633471232 ext(49590272->49655807) 00002000:00010000:1.0:1787119496.164593:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5069e2a00 00000100:00100000:1.0:1787119496.169288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.170020:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633472128 00000100:00100000:2.0:1787119496.170035:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633472128 00002000:00010000:2.0:1787119496.170081:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (60381765->18446744073709551615) 00002000:00100000:2.0:1787119496.170086:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99b800 with x1873929633472128 ext(60381765->18446744073709551615) 00002000:00010000:2.0:1787119496.170100:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99b800. 00000100:00100000:2.0:1787119496.170144:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10292 00000100:00100000:2.0:1787119496.170156:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633472128:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119496.170601:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 47090098 -> 60381765 00002000:00010000:2.0:1787119496.170607:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:2.0:1787119496.170610:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119496.170612:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:2.0:1787119496.170614:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 2447 -> 2831 00000100:00100000:2.0:1787119496.170695:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633472128:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 541us (1844us total) trans 4294969171 rc 0/0 00000100:00100000:2.0:1787119496.170703:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10292 00002000:00010000:2.0:1787119496.170708:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (60381765->18446744073709551615) 00002000:00100000:2.0:1787119496.170711:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99b800 with x1873929633472128 ext(60381765->18446744073709551615) 00002000:00010000:2.0:1787119496.170717:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99b800. 00000001:00080000:1.0:1787119496.181079:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969169 is committed 00000001:00080000:1.0:1787119496.181095:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969170 is committed 00000100:00100000:3.0:1787119496.181224:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633471872:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 44610us (44726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.181235:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5074 00000100:00100000:1.0:1787119496.183847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.184001:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633472384 00000100:00100000:2.0:1787119496.184011:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633472384 00000100:00100000:2.0:1787119496.184106:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19686 00000100:00100000:2.0:1787119496.184117:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+169:32720:x1873929633472384:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119496.184173:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119496.184203:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa200/0xcaba3de8463e32df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d8b expref: 169 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.184225:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119496.184231:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119496.184592:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.184607:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.184617:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119496.184668:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976500 00000004:00010000:2.0:1787119496.184693:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002beefd94 reply state 0000000011bdaceb transno 4294976501 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.184702:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119496.184789:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+171:32720:x1873929633472384:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 674us (952us total) trans 4294976501 rc 0/0 00000100:00100000:2.0:1787119496.184797:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19686 00000020:00080000:2.0:1787119496.184802:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119496.185925:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633472000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 21970us (22401us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119496.185937:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10291 00002000:00100000:2.0:1787119496.185949:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (4554752->4620287) req@ffff92a62041ca80 x1873929633472000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.185960:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ca80 with x1873929633472000 ext(4554752->4620287) 00002000:00010000:2.0:1787119496.185966:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041ca80 00000100:00100000:3.0:1787119496.191745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.192126:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633472512 00000100:00100000:1.0:1787119496.192137:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633472512 00000100:00100000:1.0:1787119496.192197:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19687 00000100:00100000:1.0:1787119496.192207:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+171:32729:x1873929633472512:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119496.192230:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119496.192252:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e32f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d92 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.192609:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e32fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.192625:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e32fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.192641:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e32fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119496.192669:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 60381765 00000004:00200000:1.0:1787119496.192673:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119496.192692:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e32fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.192718:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431000/0xcaba3de8463e32f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d92 expref: 173 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.192737:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e32fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d92 expref: 172 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.192745:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119496.192748:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119496.192751:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430e00, rc 0) 00000100:00100000:1.0:1787119496.192806:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+172:32729:x1873929633472512:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 600us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.192813:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19687 00000100:00100000:3.0:1787119496.193224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.193259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.193565:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633472640 00000100:00100000:1.0:1787119496.193573:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633472640 00002000:00100000:1.0:1787119496.193609:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (49610752->49647615) req@ffff92a62041d500 x1873929633472640/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.193618:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633472640 ext(49610752->49647615) 00002000:00010000:1.0:1787119496.193623:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d500 00000100:00100000:1.0:1787119496.193641:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633472768 00000100:00100000:1.0:1787119496.193645:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633472768 00002000:00010000:1.0:1787119496.193659:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (7104934->18446744073709551615) 00002000:00100000:1.0:1787119496.193663:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041df80 with x1873929633472768 ext(7104934->18446744073709551615) 00002000:00010000:1.0:1787119496.193671:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041df80. 00000100:00100000:1.0:1787119496.193686:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10293 00000100:00100000:1.0:1787119496.193694:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633472640:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119496.193815:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10294 00000100:00100000:1.0:1787119496.193822:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633472768:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119496.194726:0:19243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 13267460 -> 7104934 00002000:00010000:1.0:1787119496.194733:0:19243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119496.194735:0:19243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119496.194738:0:19243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:1.0:1787119496.194740:0:19243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:1.0:1787119496.194781:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633472768:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 957us (1519us total) trans 4294968907 rc 0/0 00000100:00100000:1.0:1787119496.194790:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10294 00002000:00010000:1.0:1787119496.194794:0:19243:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (7104934->18446744073709551615) 00002000:00100000:1.0:1787119496.194796:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041df80 with x1873929633472768 ext(7104934->18446744073709551615) 00002000:00010000:1.0:1787119496.194801:0:19243:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041df80. 00010000:00010000:0.0:1787119496.195711:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.195731:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.195739:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.195747:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119496.195752:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.195760:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.195777:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119496.195780:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119496.195785:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.195791:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e32ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.204331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.204599:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633472896 00000100:00100000:1.0:1787119496.204610:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633472896 00002000:00100000:1.0:1787119496.204660:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (21331968->21336063) req@ffff92a519cde680 x1873929633472896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.204671:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cde680 with x1873929633472896 ext(21331968->21336063) 00002000:00010000:1.0:1787119496.204677:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cde680 00000100:00100000:1.0:1787119496.204708:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10295 00000100:00100000:1.0:1787119496.204718:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633472896:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.206341:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633472640:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 12638us (13108us total) trans 4294969172 rc 0/0 00000100:00100000:3.0:1787119496.206600:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10293 00002000:00100000:3.0:1787119496.206613:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (49610752->49647615) req@ffff92a62041d500 x1873929633472640/t4294969172(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.206631:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633472640 ext(49610752->49647615) 00002000:00010000:3.0:1787119496.206636:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d500 00000100:00100000:1.0:1787119496.207280:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633472896:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2560us (2968us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.207291:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10295 00002000:00100000:1.0:1787119496.207298:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (21331968->21336063) req@ffff92a519cde680 x1873929633472896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.207306:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cde680 with x1873929633472896 ext(21331968->21336063) 00002000:00010000:1.0:1787119496.207323:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cde680 00000100:00100000:2.0:1787119496.208619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.208658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.208695:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.208765:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633473152 00000100:00100000:1.0:1787119496.208774:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633473152 00002000:00100000:1.0:1787119496.208816:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (4575232->4587519) req@ffff92a5098a1c00 x1873929633473152/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 12776/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.208826:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1c00 with x1873929633473152 ext(4575232->4587519) 00002000:00010000:1.0:1787119496.208832:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a1c00 00000100:00100000:1.0:1787119496.208869:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633473024 00000100:00100000:1.0:1787119496.208873:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633473024 00002000:00100000:1.0:1787119496.208888:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (49610752->49614847) req@ffff92a5098a0a80 x1873929633473024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.208896:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0a80 with x1873929633473024 ext(49610752->49614847) 00002000:00010000:1.0:1787119496.208900:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0a80 00000100:00100000:1.0:1787119496.208915:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10296 00000100:00100000:1.0:1787119496.208924:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633473152:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119496.209545:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633473152:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 619us (930us total) trans 4294968908 rc 0/0 00000100:00100000:1.0:1787119496.209554:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10296 00002000:00100000:1.0:1787119496.209561:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (4575232->4587519) req@ffff92a5098a1c00 x1873929633473152/t4294968908(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 12776/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.209570:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a1c00 with x1873929633473152 ext(4575232->4587519) 00002000:00010000:1.0:1787119496.209574:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a1c00 00000100:00100000:1.0:1787119496.209596:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10297 00000100:00100000:1.0:1787119496.209604:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633473024:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.209736:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633473024:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 132us (1077us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.209743:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10297 00002000:00100000:1.0:1787119496.209749:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (49610752->49614847) req@ffff92a5098a0a80 x1873929633473024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.209756:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0a80 with x1873929633473024 ext(49610752->49614847) 00002000:00010000:1.0:1787119496.209759:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a0a80 00000100:00100000:3.0:1787119496.210583:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633473280 00000100:00100000:3.0:1787119496.210593:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633473280 00000100:00100000:3.0:1787119496.210641:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19688 00000100:00100000:3.0:1787119496.210649:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+171:32720:x1873929633473280:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119496.210667:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119496.210688:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3302 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715d99 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.210764:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3309 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.210778:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.210790:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119496.210814:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7104934 00000004:00200000:3.0:1787119496.210818:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119496.210836:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.210983:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3302 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d99 expref: 173 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.211002:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d99 expref: 172 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.211011:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119496.211014:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119496.211017:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119496.211140:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+172:32720:x1873929633473280:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 492us (2444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.211147:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19688 00000100:00100000:0.0:1787119496.211952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.212627:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633473408 00000100:00100000:1.0:1787119496.212637:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633473408 00000100:00100000:1.0:1787119496.212698:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5075 00000100:00100000:1.0:1787119496.212707:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633473408:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119496.213747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.213816:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633473536 00000100:00100000:1.0:1787119496.213823:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633473536 00002000:00100000:1.0:1787119496.213866:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (21336064->21340159) req@ffff92a519cdd500 x1873929633473536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.213878:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd500 with x1873929633473536 ext(21336064->21340159) 00002000:00010000:1.0:1787119496.213885:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd500 00000100:00100000:1.0:1787119496.213915:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10298 00000100:00100000:1.0:1787119496.213923:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633473536:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.214153:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633473536:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 230us (409us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.214160:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10298 00002000:00100000:1.0:1787119496.214166:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (21336064->21340159) req@ffff92a519cdd500 x1873929633473536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.214173:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd500 with x1873929633473536 ext(21336064->21340159) 00002000:00010000:1.0:1787119496.214176:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd500 00000100:00100000:3.0:1787119496.229033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.229092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.229209:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633473664 00000100:00100000:1.0:1787119496.229223:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633473664 00000100:00100000:1.0:1787119496.229302:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5076 00000100:00100000:1.0:1787119496.229329:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633473664:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119496.229536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.235556:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633473792 00000100:00100000:0.0:1787119496.235578:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633473792 00002000:00100000:0.0:1787119496.235938:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (21311488->21377023) req@ffff92a519cdd880 x1873929633473792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.235955:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd880 with x1873929633473792 ext(21311488->21377023) 00002000:00010000:0.0:1787119496.235963:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd880 00000100:00100000:0.0:1787119496.236005:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633473920 00000100:00100000:0.0:1787119496.236009:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633473920 00002000:00100000:0.0:1787119496.236029:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (49614848->49618943) req@ffff92a519cdfb80 x1873929633473920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.236036:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdfb80 with x1873929633473920 ext(49614848->49618943) 00002000:00010000:0.0:1787119496.236040:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdfb80 00000100:00100000:0.0:1787119496.236070:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10299 00000100:00100000:0.0:1787119496.236080:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633473792:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.237068:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10300 00000100:00100000:3.0:1787119496.237083:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633473920:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.237250:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633473920:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 171us (7715us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.237258:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10300 00002000:00100000:3.0:1787119496.237265:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (49614848->49618943) req@ffff92a519cdfb80 x1873929633473920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.237274:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdfb80 with x1873929633473920 ext(49614848->49618943) 00002000:00010000:3.0:1787119496.237279:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdfb80 00000100:00100000:0.0:1787119496.248987:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633473792:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12895us (19881us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119496.249001:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10299 00002000:00100000:0.0:1787119496.249015:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (21311488->21377023) req@ffff92a519cdd880 x1873929633473792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.249027:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdd880 with x1873929633473792 ext(21311488->21377023) 00002000:00010000:0.0:1787119496.249033:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdd880 00000100:00100000:3.0:1787119496.251868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.251913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.251950:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633474176 00000100:00100000:2.0:1787119496.251959:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633474176 00000100:00100000:2.0:1787119496.252024:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19689 00000100:00100000:2.0:1787119496.252033:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+172:32720:x1873929633474176:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119496.252090:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119496.252126:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3309 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d99 expref: 172 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.252146:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119496.252151:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119496.252484:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.252500:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.252510:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119496.252563:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976502 00000004:00010000:2.0:1787119496.252592:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f64c4fd7 reply state 000000005b900353 transno 4294976503 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.252601:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119496.252700:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+174:32720:x1873929633474176:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 666us (841us total) trans 4294976503 rc 0/0 00000100:00100000:2.0:1787119496.252708:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19689 00000020:00080000:2.0:1787119496.252713:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119496.252738:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633474304 00000100:00100000:2.0:1787119496.252743:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633474304 00002000:00100000:2.0:1787119496.252770:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (49590272->49655807) req@ffff92a519cdf480 x1873929633474304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.252780:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf480 with x1873929633474304 ext(49590272->49655807) 00002000:00010000:2.0:1787119496.252784:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf480 00000100:00100000:2.0:1787119496.252804:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10301 00000100:00100000:2.0:1787119496.252810:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633474304:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:0.0:1787119496.259653:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.259670:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.259678:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.259685:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119496.259690:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.259703:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.259728:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119496.259731:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119496.259735:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.259741:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3310 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.268104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.268140:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.268618:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633474560 00000100:00100000:0.0:1787119496.268629:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633474560 00002000:00100000:0.0:1787119496.268681:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (55529472->55570431) req@ffff92a519c68380 x1873929633474560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.268692:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68380 with x1873929633474560 ext(55529472->55570431) 00002000:00010000:0.0:1787119496.268698:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c68380 00000100:00100000:0.0:1787119496.268721:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633474432 00000100:00100000:0.0:1787119496.268725:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633474432 00002000:00010000:0.0:1787119496.268738:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (64600736->18446744073709551615) 00002000:00100000:0.0:1787119496.268741:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68700 with x1873929633474432 ext(64600736->18446744073709551615) 00002000:00010000:0.0:1787119496.268752:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c68700. 00000100:00100000:0.0:1787119496.268771:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10302 00000100:00100000:0.0:1787119496.268779:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633474560:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.269766:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10303 00000100:00100000:0.0:1787119496.269778:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633474432:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119496.270125:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 7104934 -> 64600736 00002000:00010000:0.0:1787119496.270129:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:0.0:1787119496.270131:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119496.270133:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:0.0:1787119496.270134:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 2959 -> 909 00000100:00100000:0.0:1787119496.270172:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633474432:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 395us (2032us total) trans 4294968909 rc 0/0 00000100:00100000:0.0:1787119496.270179:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10303 00002000:00010000:0.0:1787119496.270183:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (64600736->18446744073709551615) 00002000:00100000:0.0:1787119496.270187:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68700 with x1873929633474432 ext(64600736->18446744073709551615) 00002000:00010000:0.0:1787119496.270193:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c68700. 00000100:00100000:2.0:1787119496.272098:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633474304:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 19277us (20174us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119496.272110:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10301 00002000:00100000:2.0:1787119496.272121:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (49590272->49655807) req@ffff92a519cdf480 x1873929633474304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.272132:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf480 with x1873929633474304 ext(49590272->49655807) 00002000:00010000:2.0:1787119496.272137:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf480 00000100:00100000:0.0:1787119496.275203:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.275433:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633474688 00000100:00100000:3.0:1787119496.275471:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633474688 00002000:00100000:3.0:1787119496.275519:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (64561152->64565247) req@ffff92a519c6a680 x1873929633474688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.275531:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a680 with x1873929633474688 ext(64561152->64565247) 00002000:00010000:3.0:1787119496.275536:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6a680 00000100:00100000:3.0:1787119496.275984:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10304 00000100:00100000:3.0:1787119496.275996:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633474688:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.276266:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633474688:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 272us (1072us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.276273:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10304 00002000:00100000:3.0:1787119496.276279:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (64561152->64565247) req@ffff92a519c6a680 x1873929633474688/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.276288:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a680 with x1873929633474688 ext(64561152->64565247) 00002000:00010000:3.0:1787119496.276292:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6a680 00000100:00100000:1.0:1787119496.279576:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633473408:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 66860us (67618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.279590:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5075 00000001:00080000:1.0:1787119496.279628:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969171 is committed 00000001:00080000:1.0:1787119496.279639:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969172 is committed 00000100:00100000:3.0:1787119496.279982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.280074:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633474816 00000100:00100000:3.0:1787119496.280081:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633474816 00002000:00100000:3.0:1787119496.280121:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (49610752->49647615) req@ffff92a519cdc700 x1873929633474816/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.280130:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdc700 with x1873929633474816 ext(49610752->49647615) 00002000:00010000:3.0:1787119496.280136:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdc700 00000100:00100000:3.0:1787119496.280159:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10305 00000100:00100000:3.0:1787119496.280168:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633474816:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119496.282729:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633474560:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13939us (14624us total) trans 0 rc 40960/40960 00000100:00100000:2.0:1787119496.282742:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10302 00002000:00100000:2.0:1787119496.282753:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (55529472->55570431) req@ffff92a519c68380 x1873929633474560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.282763:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c68380 with x1873929633474560 ext(55529472->55570431) 00002000:00010000:2.0:1787119496.282769:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c68380 00000100:00100000:2.0:1787119496.288789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.290057:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633474944 00000100:00100000:3.0:1787119496.290070:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633474944 00002000:00100000:3.0:1787119496.290117:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (64565248->64569343) req@ffff92a5098a0700 x1873929633474944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.290129:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0700 with x1873929633474944 ext(64565248->64569343) 00002000:00010000:3.0:1787119496.290135:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a0700 00000100:00100000:3.0:1787119496.290165:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10306 00000100:00100000:3.0:1787119496.290174:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633474944:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.290700:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633474944:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 523us (1919us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.290709:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10306 00002000:00100000:3.0:1787119496.290716:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (64565248->64569343) req@ffff92a5098a0700 x1873929633474944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.290726:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a0700 with x1873929633474944 ext(64565248->64569343) 00002000:00010000:3.0:1787119496.290730:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5098a0700 00000100:00100000:3.0:1787119496.290819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.290989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.291422:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633474816:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 11254us (11439us total) trans 4294969173 rc 0/0 00000100:00100000:3.0:1787119496.291430:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10305 00002000:00100000:3.0:1787119496.291472:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (49610752->49647615) req@ffff92a519cdc700 x1873929633474816/t4294969173(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.291482:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdc700 with x1873929633474816 ext(49610752->49647615) 00002000:00010000:3.0:1787119496.291487:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdc700 00000100:00100000:3.0:1787119496.291503:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633475072 00000100:00100000:3.0:1787119496.291507:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633475072 00002000:00100000:3.0:1787119496.291528:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (21331968->21336063) req@ffff92a519cdce00 x1873929633475072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.291536:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdce00 with x1873929633475072 ext(21331968->21336063) 00002000:00010000:3.0:1787119496.291540:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdce00 00000100:00100000:3.0:1787119496.291556:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633475200 00000100:00100000:3.0:1787119496.291559:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633475200 00002000:00100000:3.0:1787119496.291571:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (9777152->9781247) req@ffff92a519cdf800 x1873929633475200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.291579:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf800 with x1873929633475200 ext(9777152->9781247) 00002000:00010000:3.0:1787119496.291582:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf800 00000100:00100000:3.0:1787119496.291614:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10307 00000100:00100000:3.0:1787119496.291624:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633475072:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.291754:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633475072:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 130us (934us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.291761:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10307 00002000:00100000:3.0:1787119496.291766:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (21331968->21336063) req@ffff92a519cdce00 x1873929633475072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.291774:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdce00 with x1873929633475072 ext(21331968->21336063) 00002000:00010000:3.0:1787119496.291777:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdce00 00000100:00100000:3.0:1787119496.291789:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10308 00000100:00100000:3.0:1787119496.291795:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633475200:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.291878:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633475200:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 81us (889us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.291884:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10308 00002000:00100000:3.0:1787119496.291891:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (9777152->9781247) req@ffff92a519cdf800 x1873929633475200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.291899:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cdf800 with x1873929633475200 ext(9777152->9781247) 00002000:00010000:3.0:1787119496.291902:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cdf800 00000100:00100000:3.0:1787119496.298693:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.299858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.299887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.299908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.299944:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633475328 00000100:00100000:3.0:1787119496.299954:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633475328 00000100:00100000:3.0:1787119496.300004:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5077 00000100:00100000:3.0:1787119496.300015:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633475328:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119496.300586:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633475456 00000100:00100000:1.0:1787119496.300591:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633475456 00002000:00100000:1.0:1787119496.300619:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (21336064->21340159) req@ffff92a63dfbb480 x1873929633475456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.300631:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb480 with x1873929633475456 ext(21336064->21340159) 00002000:00010000:1.0:1787119496.300702:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb480 00000100:00100000:1.0:1787119496.300725:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633475584 00000100:00100000:1.0:1787119496.300729:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633475584 00002000:00100000:1.0:1787119496.300746:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (9781248->9785343) req@ffff92a63dfba300 x1873929633475584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.300754:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfba300 with x1873929633475584 ext(9781248->9785343) 00002000:00010000:1.0:1787119496.300758:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfba300 00000100:00100000:1.0:1787119496.300771:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633475712 00000100:00100000:1.0:1787119496.300774:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633475712 00002000:00100000:1.0:1787119496.300790:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (64540672->64602111) req@ffff92a63dfbad80 x1873929633475712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.300797:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbad80 with x1873929633475712 ext(64540672->64602111) 00002000:00010000:1.0:1787119496.300801:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbad80 00000100:00100000:1.0:1787119496.300816:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10309 00000100:00100000:1.0:1787119496.300824:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633475456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.300868:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10310 00000100:00100000:3.0:1787119496.300876:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633475584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.301544:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633475584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 665us (1653us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.301554:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10310 00002000:00100000:3.0:1787119496.301561:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (9781248->9785343) req@ffff92a63dfba300 x1873929633475584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.301571:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfba300 with x1873929633475584 ext(9781248->9785343) 00002000:00010000:3.0:1787119496.301575:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfba300 00000100:00100000:3.0:1787119496.301595:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10311 00000100:00100000:3.0:1787119496.301603:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633475712:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.301771:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633475456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 947us (1919us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.301779:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10309 00002000:00100000:1.0:1787119496.301785:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (21336064->21340159) req@ffff92a63dfbb480 x1873929633475456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.301793:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb480 with x1873929633475456 ext(21336064->21340159) 00002000:00010000:1.0:1787119496.301797:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb480 00000001:00080000:3.0:1787119496.309080:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968905 is committed 00000001:00080000:3.0:1787119496.309097:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968908 is committed 00000100:00100000:3.0:1787119496.310758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.310825:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633475840 00000100:00100000:3.0:1787119496.310836:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633475840 00002000:00100000:3.0:1787119496.310884:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (21311488->21377023) req@ffff92a63dfbb800 x1873929633475840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.310896:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb800 with x1873929633475840 ext(21311488->21377023) 00002000:00010000:3.0:1787119496.310901:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb800 00000100:00100000:3.0:1787119496.310930:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10312 00000100:00100000:3.0:1787119496.310940:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633475840:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.311266:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633475712:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9662us (11355us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1787119496.311274:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10311 00002000:00100000:3.0:1787119496.311280:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (64540672->64602111) req@ffff92a63dfbad80 x1873929633475712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.311288:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbad80 with x1873929633475712 ext(64540672->64602111) 00002000:00010000:3.0:1787119496.311292:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbad80 00000100:00100000:3.0:1787119496.313383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.313423:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633475968 00000100:00100000:3.0:1787119496.313434:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633475968 00002000:00100000:3.0:1787119496.313499:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (9756672->9822207) req@ffff92a63dfb9f80 x1873929633475968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.314005:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633475968 ext(9756672->9822207) 00002000:00010000:3.0:1787119496.314012:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000100:00100000:3.0:1787119496.314054:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10313 00000100:00100000:3.0:1787119496.314065:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633475968:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.316866:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633473664:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 87532us (87827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.316882:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5076 00000100:00100000:3.0:1787119496.318498:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633475840:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7550us (7739us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119496.318510:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10312 00002000:00100000:3.0:1787119496.318523:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (21311488->21377023) req@ffff92a63dfbb800 x1873929633475840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.318535:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb800 with x1873929633475840 ext(21311488->21377023) 00002000:00010000:3.0:1787119496.318541:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb800 00000100:00100000:3.0:1787119496.321815:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633475968:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7740us (8429us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119496.321831:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10313 00002000:00100000:3.0:1787119496.321845:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (9756672->9822207) req@ffff92a63dfb9f80 x1873929633475968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.321856:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633475968 ext(9756672->9822207) 00002000:00010000:3.0:1787119496.321862:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000100:00100000:0.0:1787119496.332026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.332096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.332170:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633476224 00000100:00100000:3.0:1787119496.332183:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633476224 00002000:00100000:3.0:1787119496.332253:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (55529472->55570431) req@ffff92a519c6b800 x1873929633476224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.332265:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b800 with x1873929633476224 ext(55529472->55570431) 00002000:00010000:3.0:1787119496.332270:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6b800 00000100:00100000:3.0:1787119496.332301:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10314 00000100:00100000:3.0:1787119496.332312:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633476224:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.332702:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633476096 00000100:00100000:0.0:1787119496.332707:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633476096 00002000:00100000:0.0:1787119496.332730:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (64561152->64600735) req@ffff92a519c69c00 x1873929633476096/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.332739:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69c00 with x1873929633476096 ext(64561152->64600735) 00002000:00010000:0.0:1787119496.332743:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c69c00 00000100:00100000:0.0:1787119496.332766:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10315 00000100:00100000:0.0:1787119496.332774:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633476096:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119496.344151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.344305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.344381:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633476224:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12068us (12367us total) trans 0 rc 40960/40960 00000100:00100000:3.0:1787119496.344393:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10314 00002000:00100000:3.0:1787119496.344406:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (55529472->55570431) req@ffff92a519c6b800 x1873929633476224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.344416:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b800 with x1873929633476224 ext(55529472->55570431) 00002000:00010000:3.0:1787119496.344423:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6b800 00000100:00100000:3.0:1787119496.344477:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633476352 00000100:00100000:3.0:1787119496.344485:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633476352 00002000:00100000:3.0:1787119496.344517:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x22:0x0] (10141696->10145791) req@ffff92a519c6b100 x1873929633476352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.344526:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b100 with x1873929633476352 ext(10141696->10145791) 00002000:00010000:3.0:1787119496.344529:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6b100 00000100:00100000:2.0:1787119496.344576:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633476608 00000100:00100000:2.0:1787119496.344580:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633476608 00000100:00100000:2.0:1787119496.344616:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19690 00000100:00100000:2.0:1787119496.344626:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+173:32728:x1873929633476608:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119496.344742:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787119496.344760:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633476096:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 11987us (12663us total) trans 4294968910 rc 0/0 00000100:00100000:0.0:1787119496.344767:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10315 00010000:00010000:2.0:1787119496.344768:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d61 expref: 173 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787119496.344773:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (64561152->64600735) req@ffff92a519c69c00 x1873929633476096/t4294968910(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.344781:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69c00 with x1873929633476096 ext(64561152->64600735) 00002000:00010000:0.0:1787119496.344784:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c69c00 00010000:00010000:2.0:1787119496.344786:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119496.344790:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119496.344797:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10316 00000100:00100000:0.0:1787119496.344802:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633476352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.344936:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633476352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 133us (797us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.344943:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10316 00002000:00100000:0.0:1787119496.344948:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (10141696->10145791) req@ffff92a519c6b100 x1873929633476352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.344955:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6b100 with x1873929633476352 ext(10141696->10145791) 00002000:00010000:0.0:1787119496.344959:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c6b100 00010000:00010000:2.0:1787119496.345201:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.345217:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.345228:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119496.345277:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976504 00000004:00010000:2.0:1787119496.345300:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cdde827 reply state 00000000927b0c1d transno 4294976505 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.345310:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119496.345363:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+175:32728:x1873929633476608:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 738us (1057us total) trans 4294976505 rc 0/0 00000100:00100000:2.0:1787119496.345371:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19690 00000020:00080000:2.0:1787119496.345374:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119496.353304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.353341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.353364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.353387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119496.353410:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.353422:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.353431:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.353466:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119496.353473:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.353482:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.353500:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119496.353503:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119496.353507:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.353514:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e3317 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.353540:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633476992 00000100:00100000:3.0:1787119496.353548:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633476992 00000100:00100000:3.0:1787119496.353590:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5078 00000100:00100000:3.0:1787119496.353599:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633476992:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119496.356881:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633476736 00000100:00100000:2.0:1787119496.356897:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633476736 00002000:00010000:2.0:1787119496.356940:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (63981300->18446744073709551615) 00002000:00100000:2.0:1787119496.356945:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9500 with x1873929633476736 ext(63981300->18446744073709551615) 00002000:00010000:2.0:1787119496.356957:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9500. 00000100:00100000:2.0:1787119496.356981:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633476864 00000100:00100000:2.0:1787119496.356985:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633476864 00002000:00100000:2.0:1787119496.357009:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (9777152->9781247) req@ffff92a63dfb8700 x1873929633476864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.357020:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633476864 ext(9777152->9781247) 00002000:00010000:2.0:1787119496.357025:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb8700 00000100:00100000:2.0:1787119496.357036:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633477120 00000100:00100000:2.0:1787119496.357038:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633477120 00002000:00100000:2.0:1787119496.357052:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (10145792->10149887) req@ffff92a50655e300 x1873929633477120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.357061:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655e300 with x1873929633477120 ext(10145792->10149887) 00002000:00010000:2.0:1787119496.357064:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655e300 00000100:00100000:2.0:1787119496.357081:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10317 00000100:00100000:2.0:1787119496.357090:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633476736:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119496.358495:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 60381765 -> 63981300 00002000:00010000:2.0:1787119496.358501:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119494 -> 1787119494 00002000:00010000:2.0:1787119496.358504:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119496.358506:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119494 -> 1787119494 00002000:00010000:2.0:1787119496.358509:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2831 -> 2959 00000100:00100000:2.0:1787119496.358582:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633476736:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1489us (5283us total) trans 4294969174 rc 0/0 00000100:00100000:2.0:1787119496.358592:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10317 00002000:00010000:2.0:1787119496.358597:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (63981300->18446744073709551615) 00002000:00100000:2.0:1787119496.358601:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9500 with x1873929633476736 ext(63981300->18446744073709551615) 00002000:00010000:2.0:1787119496.358608:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9500. 00000100:00100000:2.0:1787119496.358700:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10318 00000100:00100000:2.0:1787119496.358713:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633476864:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.358875:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633476864:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 166us (5533us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.358883:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10318 00002000:00100000:2.0:1787119496.358890:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (9777152->9781247) req@ffff92a63dfb8700 x1873929633476864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.359393:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633476864 ext(9777152->9781247) 00002000:00010000:2.0:1787119496.359400:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb8700 00000100:00100000:2.0:1787119496.359420:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10319 00000100:00100000:2.0:1787119496.359429:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633477120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.359574:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633477120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 146us (6185us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.359582:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10319 00002000:00100000:2.0:1787119496.359587:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (10145792->10149887) req@ffff92a50655e300 x1873929633477120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.359602:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655e300 with x1873929633477120 ext(10145792->10149887) 00002000:00010000:2.0:1787119496.359606:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655e300 00000100:00100000:3.0:1787119496.365676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.365739:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633477248 00000100:00100000:1.0:1787119496.365750:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633477248 00000100:00100000:1.0:1787119496.365811:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19691 00000100:00100000:1.0:1787119496.365821:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+174:32728:x1873929633477248:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119496.365845:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119496.365877:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e331e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715da0 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.365986:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.366000:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.366010:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119496.366035:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 63981300 00000004:00200000:1.0:1787119496.366039:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119496.366057:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.366082:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e331e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715da0 expref: 176 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.366099:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715da0 expref: 175 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.366107:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119496.366109:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119496.366113:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119496.366174:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+175:32728:x1873929633477248:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 354us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.366185:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19691 00000100:00100000:2.0:1787119496.369369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.369490:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633477376 00000100:00100000:2.0:1787119496.369501:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633477376 00002000:00100000:2.0:1787119496.369547:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (9781248->9785343) req@ffff92a51282d880 x1873929633477376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.369559:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d880 with x1873929633477376 ext(9781248->9785343) 00002000:00010000:2.0:1787119496.369564:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282d880 00000100:00100000:2.0:1787119496.369591:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10320 00000100:00100000:2.0:1787119496.369600:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633477376:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.369807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.369827:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633477376:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 227us (468us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.369836:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10320 00002000:00100000:2.0:1787119496.369842:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (9781248->9785343) req@ffff92a51282d880 x1873929633477376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.369850:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d880 with x1873929633477376 ext(9781248->9785343) 00002000:00010000:2.0:1787119496.369854:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282d880 00000100:00100000:2.0:1787119496.369869:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633477504 00000100:00100000:2.0:1787119496.369873:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633477504 00002000:00100000:2.0:1787119496.369889:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (10121216->10186751) req@ffff92a50655ea00 x1873929633477504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.369897:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ea00 with x1873929633477504 ext(10121216->10186751) 00002000:00010000:2.0:1787119496.369902:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ea00 00000100:00100000:2.0:1787119496.369917:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10321 00000100:00100000:2.0:1787119496.369924:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633477504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.375147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.375194:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633477632 00000100:00100000:1.0:1787119496.375205:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633477632 00002000:00100000:1.0:1787119496.375257:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (48726016->48730111) req@ffff92a50655d880 x1873929633477632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.375270:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d880 with x1873929633477632 ext(48726016->48730111) 00002000:00010000:1.0:1787119496.375275:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d880 00000100:00100000:1.0:1787119496.375314:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10322 00000100:00100000:1.0:1787119496.375323:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633477632:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.375591:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633477632:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 267us (456us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.375598:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10322 00002000:00100000:1.0:1787119496.375605:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (48726016->48730111) req@ffff92a50655d880 x1873929633477632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.375612:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d880 with x1873929633477632 ext(48726016->48730111) 00002000:00010000:1.0:1787119496.375616:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d880 00000100:00100000:3.0:1787119496.381036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.381285:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633477760 00000100:00100000:3.0:1787119496.381295:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633477760 00002000:00100000:3.0:1787119496.382188:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (9756672->9822207) req@ffff92a50655f800 x1873929633477760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.382200:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f800 with x1873929633477760 ext(9756672->9822207) 00002000:00010000:3.0:1787119496.382206:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655f800 00000100:00100000:3.0:1787119496.382233:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10323 00000100:00100000:3.0:1787119496.382243:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633477760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.383092:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633477504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13161us (13279us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119496.383102:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10321 00002000:00100000:3.0:1787119496.383112:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (10121216->10186751) req@ffff92a50655ea00 x1873929633477504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.383121:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ea00 with x1873929633477504 ext(10121216->10186751) 00002000:00010000:3.0:1787119496.383126:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ea00 00000100:00100000:3.0:1787119496.384659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.384744:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633477888 00000100:00100000:0.0:1787119496.384754:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633477888 00002000:00100000:0.0:1787119496.384799:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (48730112->48734207) req@ffff92a50655ed80 x1873929633477888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.384816:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ed80 with x1873929633477888 ext(48730112->48734207) 00002000:00010000:0.0:1787119496.384821:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655ed80 00000100:00100000:0.0:1787119496.384866:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10324 00000100:00100000:0.0:1787119496.384876:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633477888:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.385088:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633477888:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 212us (434us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.385095:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10324 00002000:00100000:0.0:1787119496.385102:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (48730112->48734207) req@ffff92a50655ed80 x1873929633477888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.385111:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ed80 with x1873929633477888 ext(48730112->48734207) 00002000:00010000:0.0:1787119496.385114:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655ed80 00000100:00100000:3.0:1787119496.386672:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633477760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4425us (5638us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119496.386685:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10323 00002000:00100000:3.0:1787119496.386696:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (9756672->9822207) req@ffff92a50655f800 x1873929633477760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.386706:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f800 with x1873929633477760 ext(9756672->9822207) 00002000:00010000:3.0:1787119496.386711:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655f800 00000100:00100000:3.0:1787119496.389842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.391713:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.392668:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633478016 00000100:00100000:2.0:1787119496.392684:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633478016 00002000:00100000:2.0:1787119496.392749:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (17801216->17817599) req@ffff92a50655c380 x1873929633478016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.392762:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c380 with x1873929633478016 ext(17801216->17817599) 00002000:00010000:2.0:1787119496.392769:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655c380 00000100:00100000:2.0:1787119496.392799:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633478144 00000100:00100000:2.0:1787119496.392803:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633478144 00002000:00100000:2.0:1787119496.392821:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (48705536->48771071) req@ffff92a50655f480 x1873929633478144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.392831:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f480 with x1873929633478144 ext(48705536->48771071) 00002000:00010000:2.0:1787119496.392835:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655f480 00000100:00100000:2.0:1787119496.395496:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10325 00000100:00100000:2.0:1787119496.395516:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633478016:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.396107:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633478016:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 597us (6274us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787119496.396116:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10325 00002000:00100000:2.0:1787119496.396126:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (17801216->17817599) req@ffff92a50655c380 x1873929633478016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/16824 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.396135:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c380 with x1873929633478016 ext(17801216->17817599) 00002000:00010000:2.0:1787119496.396141:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655c380 00000100:00100000:2.0:1787119496.396162:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10326 00000100:00100000:2.0:1787119496.396169:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633478144:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.398662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.398840:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633478400 00000100:00100000:0.0:1787119496.399010:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633478400 00000100:00100000:0.0:1787119496.399069:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19692 00000100:00100000:0.0:1787119496.399080:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+175:32727:x1873929633478400:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119496.399146:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119496.399175:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038faa00/0xcaba3de8463e32a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d6f expref: 175 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.399196:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119496.399201:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119496.400203:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.400226:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.400238:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119496.400300:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976506 00000004:00010000:0.0:1787119496.400501:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000556ad500 reply state 0000000013e75c9d transno 4294976507 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.400511:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119496.400620:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+177:32727:x1873929633478400:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1540us (1967us total) trans 4294976507 rc 0/0 00000100:00100000:0.0:1787119496.400630:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19692 00000020:00080000:0.0:1787119496.400635:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119496.404359:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633478144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8168us (12633us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119496.404372:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10326 00002000:00100000:2.0:1787119496.404382:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (48705536->48771071) req@ffff92a50655f480 x1873929633478144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.404390:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655f480 with x1873929633478144 ext(48705536->48771071) 00002000:00010000:2.0:1787119496.404395:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655f480 00000100:00100000:0.0:1787119496.408788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.408819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.408848:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633478528 00000100:00100000:0.0:1787119496.408860:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633478528 00002000:00100000:0.0:1787119496.408917:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (43814912->43819007) req@ffff92a519c69f80 x1873929633478528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.408928:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69f80 with x1873929633478528 ext(43814912->43819007) 00002000:00010000:0.0:1787119496.408933:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c69f80 00000100:00100000:0.0:1787119496.408955:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633478656 00000100:00100000:0.0:1787119496.408958:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633478656 00002000:00010000:0.0:1787119496.408971:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (63981300->18446744073709551615) 00002000:00100000:0.0:1787119496.408974:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a300 with x1873929633478656 ext(63981300->18446744073709551615) 00002000:00010000:0.0:1787119496.408985:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6a300. 00000100:00100000:0.0:1787119496.409005:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10327 00000100:00100000:0.0:1787119496.409013:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633478528:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119496.409390:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.409402:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.409411:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.409418:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119496.409422:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.409429:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.409483:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119496.409486:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119496.409492:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.409498:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e332c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.409697:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633478528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 682us (920us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.409705:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10327 00002000:00100000:0.0:1787119496.409713:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (43814912->43819007) req@ffff92a519c69f80 x1873929633478528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.409721:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c69f80 with x1873929633478528 ext(43814912->43819007) 00002000:00010000:0.0:1787119496.409724:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519c69f80 00000100:00100000:0.0:1787119496.409741:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10328 00000100:00100000:0.0:1787119496.409749:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633478656:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119496.409955:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 60381765 -> 63981300 00002000:00010000:0.0:1787119496.409959:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119494 -> 1787119495 00002000:00010000:0.0:1787119496.409962:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119496.409964:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119494 -> 1787119495 00002000:00010000:0.0:1787119496.409966:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 2831 -> 2959 00000100:00100000:0.0:1787119496.409996:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633478656:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 248us (1176us total) trans 4294969175 rc 0/0 00000100:00100000:0.0:1787119496.410003:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10328 00002000:00010000:0.0:1787119496.410007:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (63981300->18446744073709551615) 00002000:00100000:0.0:1787119496.410010:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6a300 with x1873929633478656 ext(63981300->18446744073709551615) 00002000:00010000:0.0:1787119496.410015:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6a300. 00000100:00100000:0.0:1787119496.417366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.417399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.417502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.417603:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633478784 00000100:00100000:0.0:1787119496.417613:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633478784 00002000:00100000:0.0:1787119496.417665:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (48771072->48807935) req@ffff92a519c6aa00 x1873929633478784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.417677:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6aa00 with x1873929633478784 ext(48771072->48807935) 00002000:00010000:0.0:1787119496.417687:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6aa00 00000100:00100000:0.0:1787119496.417711:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633478912 00000100:00100000:0.0:1787119496.417714:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633478912 00002000:00100000:0.0:1787119496.417730:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (43819008->43823103) req@ffff92a512846a00 x1873929633478912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.417738:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633478912 ext(43819008->43823103) 00002000:00010000:0.0:1787119496.417741:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512846a00 00000100:00100000:0.0:1787119496.417760:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10329 00000100:00100000:0.0:1787119496.417769:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633478784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.418108:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10330 00000100:00100000:3.0:1787119496.418119:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633478912:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.418276:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633478912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 159us (875us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.418289:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10330 00002000:00100000:3.0:1787119496.418296:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x22:0x0] (43819008->43823103) req@ffff92a512846a00 x1873929633478912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.418305:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633478912 ext(43819008->43823103) 00002000:00010000:3.0:1787119496.418308:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512846a00 00000100:00100000:0.0:1787119496.420808:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633478784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3029us (3444us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119496.420821:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10329 00002000:00100000:0.0:1787119496.420831:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (48771072->48807935) req@ffff92a519c6aa00 x1873929633478784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.420842:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519c6aa00 with x1873929633478784 ext(48771072->48807935) 00002000:00010000:0.0:1787119496.420847:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519c6aa00 00000100:00100000:2.0:1787119496.421814:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633479040 00000100:00100000:2.0:1787119496.421824:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633479040 00000100:00100000:2.0:1787119496.421936:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19693 00000100:00100000:2.0:1787119496.421946:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+176:32727:x1873929633479040:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119496.421969:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119496.421990:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715da7 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.422073:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e333a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.422087:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e333a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.422100:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e333a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119496.422125:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 63981300 00000004:00200000:2.0:1787119496.422130:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119496.422149:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e333a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.422173:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e3333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715da7 expref: 178 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.422190:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e333a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715da7 expref: 177 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.422199:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119496.422202:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119496.422206:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93000, rc 0) 00000100:00100000:2.0:1787119496.422244:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+177:32727:x1873929633479040:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 301us (4742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119496.422252:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19693 00000001:00080000:1.0:1787119496.422588:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969173 is committed 00000100:00100000:3.0:1787119496.424582:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633475328:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 124561us (125894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.424593:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5077 00000100:00100000:0.0:1787119496.428574:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633476992:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 74965us (75198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.428590:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5078 00000001:00080000:3.0:1787119496.429536:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968910 is committed 00000100:00100000:3.0:1787119496.430763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.431016:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633479168 00000100:00100000:0.0:1787119496.431025:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633479168 00002000:00100000:0.0:1787119496.431068:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (43794432->43859967) req@ffff92a50655dc00 x1873929633479168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.431080:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655dc00 with x1873929633479168 ext(43794432->43859967) 00002000:00010000:0.0:1787119496.431085:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655dc00 00000100:00100000:0.0:1787119496.431116:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10331 00000100:00100000:0.0:1787119496.431135:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633479168:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.433889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.433930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.434017:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633479424 00000100:00100000:0.0:1787119496.434030:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633479424 00002000:00100000:0.0:1787119496.434075:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (21331968->21336063) req@ffff92a50655d500 x1873929633479424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.434084:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d500 with x1873929633479424 ext(21331968->21336063) 00002000:00010000:0.0:1787119496.434090:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d500 00000100:00100000:0.0:1787119496.434117:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10332 00000100:00100000:3.0:1787119496.434135:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633479168:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3011us (3378us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119496.434137:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633479424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.434143:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10331 00002000:00100000:3.0:1787119496.434150:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (43794432->43859967) req@ffff92a50655dc00 x1873929633479168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.434156:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655dc00 with x1873929633479168 ext(43794432->43859967) 00002000:00010000:3.0:1787119496.434160:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655dc00 00000100:00100000:0.0:1787119496.434346:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633479424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 221us (415us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.434354:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10332 00002000:00100000:0.0:1787119496.434359:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (21331968->21336063) req@ffff92a50655d500 x1873929633479424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.434367:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655d500 with x1873929633479424 ext(21331968->21336063) 00002000:00010000:0.0:1787119496.434371:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655d500 00000100:00100000:1.0:1787119496.434509:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633479296 00000100:00100000:1.0:1787119496.434513:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633479296 00000100:00100000:1.0:1787119496.434593:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19694 00000100:00100000:1.0:1787119496.434602:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+177:32720:x1873929633479296:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119496.434614:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119496.434633:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e3341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715dae expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.434717:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.434730:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.434741:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119496.434766:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 64600736 00000004:00200000:1.0:1787119496.434770:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119496.434787:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.434814:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431e00/0xcaba3de8463e3341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dae expref: 179 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.434831:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dae expref: 178 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.434840:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119496.434843:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119496.434846:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431a00, rc 0) 00000100:00100000:1.0:1787119496.434879:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+178:32720:x1873929633479296:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 278us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.434886:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19694 00000100:00100000:2.0:1787119496.439614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.439673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.440058:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633479552 00000100:00100000:0.0:1787119496.440070:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633479552 00002000:00100000:0.0:1787119496.440123:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (48726016->48730111) req@ffff92a51282fb80 x1873929633479552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.440135:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282fb80 with x1873929633479552 ext(48726016->48730111) 00002000:00010000:0.0:1787119496.440141:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282fb80 00000100:00100000:0.0:1787119496.440175:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10333 00000100:00100000:0.0:1787119496.440184:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633479552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.440426:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633479552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 242us (821us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.440434:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10333 00002000:00100000:0.0:1787119496.440481:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (48726016->48730111) req@ffff92a51282fb80 x1873929633479552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.440490:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282fb80 with x1873929633479552 ext(48726016->48730111) 00002000:00010000:0.0:1787119496.440494:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282fb80 00000100:00100000:1.0:1787119496.440655:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633479808 00000100:00100000:1.0:1787119496.440659:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633479808 00000100:00100000:1.0:1787119496.440699:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19695 00000100:00100000:1.0:1787119496.440706:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+178:32728:x1873929633479808:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119496.440745:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119496.440771:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715da0 expref: 178 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.440788:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119496.440793:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119496.440995:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.441009:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.441018:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119496.441068:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976508 00000004:00010000:1.0:1787119496.441094:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed847738 reply state 000000003ba73acd transno 4294976509 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.441104:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119496.441175:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+180:32728:x1873929633479808:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 469us (1501us total) trans 4294976509 rc 0/0 00000100:00100000:1.0:1787119496.441183:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19695 00000020:00080000:1.0:1787119496.441186:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119496.441258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.441375:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633480064 00000100:00100000:1.0:1787119496.441380:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633480064 00002000:00100000:1.0:1787119496.441404:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (4575232->4579327) req@ffff92a50655df80 x1873929633480064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.441419:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655df80 with x1873929633480064 ext(4575232->4579327) 00002000:00010000:1.0:1787119496.441422:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655df80 00000100:00100000:1.0:1787119496.441633:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10334 00000100:00100000:1.0:1787119496.441643:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633480064:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.441978:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633480064:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 336us (719us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.441985:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10334 00002000:00100000:1.0:1787119496.441992:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (4575232->4579327) req@ffff92a50655df80 x1873929633480064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.442001:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655df80 with x1873929633480064 ext(4575232->4579327) 00002000:00010000:1.0:1787119496.442005:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655df80 00000100:00100000:0.0:1787119496.442404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.442522:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633480192 00000100:00100000:2.0:1787119496.442528:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633480192 00002000:00100000:2.0:1787119496.442555:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x22:0x0] (43814912->43839487) req@ffff92a512844380 x1873929633480192/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.442565:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844380 with x1873929633480192 ext(43814912->43839487) 00002000:00010000:2.0:1787119496.442569:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844380 00000100:00100000:0.0:1787119496.442693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.443093:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633479936 00000100:00100000:2.0:1787119496.443098:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633479936 00002000:00100000:2.0:1787119496.443119:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (21336064->21340159) req@ffff92a512844a80 x1873929633479936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.443134:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633479936 ext(21336064->21340159) 00002000:00010000:2.0:1787119496.443138:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844a80 00000100:00100000:3.0:1787119496.443168:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10335 00000100:00100000:3.0:1787119496.443178:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633480192:12345-192.168.201.59@tcp:4:fsx.0 00010000:00010000:0.0:1787119496.443724:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.443736:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.443744:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.443752:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119496.443756:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.443765:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.443781:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119496.443784:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119496.443788:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.443794:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e334f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.443867:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10336 00000100:00100000:1.0:1787119496.443879:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633479936:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.444078:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633479936:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 202us (1385us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.444086:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10336 00002000:00100000:1.0:1787119496.444092:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (21336064->21340159) req@ffff92a512844a80 x1873929633479936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.444100:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633479936 ext(21336064->21340159) 00002000:00010000:1.0:1787119496.444104:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844a80 00000100:00100000:0.0:1787119496.445042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.445109:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633480320 00000100:00100000:3.0:1787119496.445119:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633480320 00002000:00010000:3.0:1787119496.445151:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (3317751->18446744073709551615) 00002000:00100000:3.0:1787119496.445156:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633480320 ext(3317751->18446744073709551615) 00002000:00010000:3.0:1787119496.445168:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844000. 00000100:00100000:3.0:1787119496.445197:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10337 00000100:00100000:3.0:1787119496.445205:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633480320:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119496.445593:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 63981300 -> 3317751 00002000:00010000:3.0:1787119496.445598:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119494 -> 1787119495 00002000:00010000:3.0:1787119496.445601:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119496.445603:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119494 -> 1787119495 00002000:00010000:3.0:1787119496.445605:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:3.0:1787119496.445657:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633480320:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 453us (620us total) trans 4294969176 rc 0/0 00000100:00100000:3.0:1787119496.445665:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10337 00002000:00010000:3.0:1787119496.445669:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (3317751->18446744073709551615) 00002000:00100000:3.0:1787119496.445672:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633480320 ext(3317751->18446744073709551615) 00002000:00010000:3.0:1787119496.445677:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844000. 00000100:00100000:3.0:1787119496.447389:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633480192:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 4202us (4975us total) trans 4294968911 rc 0/0 00000100:00100000:3.0:1787119496.447401:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10335 00002000:00100000:3.0:1787119496.447414:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (43814912->43839487) req@ffff92a512844380 x1873929633480192/t4294968911(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.447424:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844380 with x1873929633480192 ext(43814912->43839487) 00002000:00010000:3.0:1787119496.447430:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844380 00000100:00100000:1.0:1787119496.448799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.448894:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633480448 00000100:00100000:2.0:1787119496.448904:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633480448 00002000:00100000:2.0:1787119496.448951:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (4579328->4583423) req@ffff92a62a998a80 x1873929633480448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.448960:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a998a80 with x1873929633480448 ext(4579328->4583423) 00002000:00010000:2.0:1787119496.448964:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a998a80 00000100:00100000:2.0:1787119496.449034:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10338 00000100:00100000:2.0:1787119496.449043:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633480448:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.449261:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633480448:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 218us (471us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.449269:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10338 00002000:00100000:2.0:1787119496.449275:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (4579328->4583423) req@ffff92a62a998a80 x1873929633480448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.449282:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a998a80 with x1873929633480448 ext(4579328->4583423) 00002000:00010000:2.0:1787119496.449285:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62a998a80 00000100:00100000:0.0:1787119496.451005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.451138:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633480576 00000100:00100000:2.0:1787119496.451147:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633480576 00000100:00100000:2.0:1787119496.451227:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19696 00000100:00100000:2.0:1787119496.451237:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+179:32728:x1873929633480576:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119496.451258:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119496.451279:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3356 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715db5 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.451384:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e335d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.451398:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e335d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.451410:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e335d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119496.451484:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 3317751 00000004:00200000:2.0:1787119496.451490:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119496.451514:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e335d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.451540:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3356 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715db5 expref: 181 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.451559:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e335d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715db5 expref: 180 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.451568:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119496.451571:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119496.451575:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119496.451629:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+180:32728:x1873929633480576:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 393us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119496.451635:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19696 00000100:00100000:0.0:1787119496.454818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.454919:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633480704 00000100:00100000:3.0:1787119496.454930:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633480704 00002000:00100000:3.0:1787119496.454987:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (21311488->21377023) req@ffff92a512846300 x1873929633480704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.455000:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846300 with x1873929633480704 ext(21311488->21377023) 00002000:00010000:3.0:1787119496.455006:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846300 00000100:00100000:3.0:1787119496.455072:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10339 00000100:00100000:3.0:1787119496.455082:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633480704:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.458940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.459057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.459154:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633481088 00000100:00100000:2.0:1787119496.459163:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633481088 00002000:00100000:2.0:1787119496.459213:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (4554752->4620287) req@ffff92a50655fb80 x1873929633481088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.459225:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655fb80 with x1873929633481088 ext(4554752->4620287) 00002000:00010000:2.0:1787119496.459231:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655fb80 00000100:00100000:2.0:1787119496.459269:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10340 00000100:00100000:2.0:1787119496.459279:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633481088:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.459743:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633480704:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4658us (4931us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119496.459754:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10339 00002000:00100000:3.0:1787119496.459764:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (21311488->21377023) req@ffff92a512846300 x1873929633480704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.459773:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846300 with x1873929633480704 ext(21311488->21377023) 00002000:00010000:3.0:1787119496.459779:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846300 00000100:00100000:0.0:1787119496.460855:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633480832 00000100:00100000:0.0:1787119496.460864:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633480832 00000100:00100000:0.0:1787119496.460948:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5079 00000100:00100000:0.0:1787119496.460957:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633480832:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119496.465012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.465055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.465130:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633481344 00000100:00100000:3.0:1787119496.465142:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633481344 00000100:00100000:3.0:1787119496.465201:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19697 00000100:00100000:3.0:1787119496.465211:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+180:32728:x1873929633481344:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119496.465262:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119496.465294:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e335d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715db5 expref: 180 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.465325:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119496.465330:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119496.465597:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.465611:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.465622:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119496.465678:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976510 00000004:00010000:3.0:1787119496.465704:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030683f7d reply state 0000000065a487a2 transno 4294976511 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.465714:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119496.465798:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+182:32728:x1873929633481344:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 587us (742us total) trans 4294976511 rc 0/0 00000100:00100000:3.0:1787119496.465806:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19697 00000020:00080000:3.0:1787119496.465812:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119496.466094:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633480960 00000100:00100000:2.0:1787119496.466100:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633480960 00002000:00100000:2.0:1787119496.466136:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (48730112->48734207) req@ffff92a62a99ad80 x1873929633480960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.466147:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99ad80 with x1873929633480960 ext(48730112->48734207) 00002000:00010000:2.0:1787119496.466152:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99ad80 00000100:00100000:2.0:1787119496.466178:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10341 00000100:00100000:2.0:1787119496.466186:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a99ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633480960:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.466539:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a99ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633480960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 351us (1535us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.466546:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10341 00002000:00100000:2.0:1787119496.466554:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (48730112->48734207) req@ffff92a62a99ad80 x1873929633480960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.466562:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a99ad80 with x1873929633480960 ext(48730112->48734207) 00002000:00010000:2.0:1787119496.466566:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a99ad80 00000100:00100000:1.0:1787119496.470226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.470339:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633481472 00000100:00100000:3.0:1787119496.470358:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633481472 00002000:00100000:3.0:1787119496.470406:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (55529472->55570431) req@ffff92a634967100 x1873929633481472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.470419:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967100 with x1873929633481472 ext(55529472->55570431) 00002000:00010000:3.0:1787119496.470425:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634967100 00000100:00100000:3.0:1787119496.470484:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10342 00000100:00100000:3.0:1787119496.470494:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633481472:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119496.470704:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.470715:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.470723:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.470731:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119496.470736:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.470743:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.470759:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119496.470762:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119496.470767:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.470773:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3364 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.472272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.473759:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633481600 00000100:00100000:3.0:1787119496.473776:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633481600 00002000:00010000:2.0:1787119496.474843:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (13267460->18446744073709551615) 00002000:00100000:2.0:1787119496.474851:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965180 with x1873929633481600 ext(13267460->18446744073709551615) 00002000:00010000:2.0:1787119496.474864:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634965180. 00000100:00100000:2.0:1787119496.474904:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10343 00000100:00100000:2.0:1787119496.474914:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633481600:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119496.475125:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3317751 -> 13267460 00002000:00010000:2.0:1787119496.475129:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:2.0:1787119496.475130:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119496.475133:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:2.0:1787119496.475135:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:2.0:1787119496.475195:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633481600:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 281us (2928us total) trans 4294969177 rc 0/0 00000100:00100000:2.0:1787119496.475202:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10343 00002000:00010000:2.0:1787119496.475205:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (13267460->18446744073709551615) 00002000:00100000:2.0:1787119496.475208:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965180 with x1873929633481600 ext(13267460->18446744073709551615) 00002000:00010000:2.0:1787119496.475212:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634965180. 00000100:00100000:2.0:1787119496.476271:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633481088:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16989us (17209us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119496.476281:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10340 00002000:00100000:2.0:1787119496.476291:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (4554752->4620287) req@ffff92a50655fb80 x1873929633481088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.476302:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655fb80 with x1873929633481088 ext(4554752->4620287) 00002000:00010000:2.0:1787119496.476316:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655fb80 00000100:00100000:1.0:1787119496.482245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.482273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.482334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.482374:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633481856 00000100:00100000:1.0:1787119496.482383:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633481856 00000100:00100000:1.0:1787119496.482435:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19698 00000100:00100000:1.0:1787119496.482474:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+181:32728:x1873929633481856:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119496.482496:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119496.482516:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e336b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715dbc expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.482600:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e3372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.482614:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e3372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.482626:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e3372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119496.482653:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 13267460 00000004:00200000:1.0:1787119496.482658:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119496.482677:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e3372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.482706:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e336b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dbc expref: 183 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.482731:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e3372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dbc expref: 182 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.482739:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119496.482743:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119496.482746:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431800, rc 0) 00000100:00100000:1.0:1787119496.482788:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+182:32728:x1873929633481856:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 317us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.482793:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19698 00000100:00100000:3.0:1787119496.483550:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633481472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13053us (13329us total) trans 0 rc 40960/40960 00000100:00100000:3.0:1787119496.483560:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10342 00002000:00100000:3.0:1787119496.483570:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (55529472->55570431) req@ffff92a634967100 x1873929633481472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.483579:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967100 with x1873929633481472 ext(55529472->55570431) 00002000:00010000:3.0:1787119496.483584:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634967100 00000100:00100000:3.0:1787119496.483601:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633481984 00000100:00100000:3.0:1787119496.483605:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633481984 00002000:00100000:3.0:1787119496.483629:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (4575232->4587519) req@ffff92a634965c00 x1873929633481984/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 12776/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.483638:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965c00 with x1873929633481984 ext(4575232->4587519) 00002000:00010000:3.0:1787119496.483641:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634965c00 00000100:00100000:3.0:1787119496.483656:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633481728 00000100:00100000:3.0:1787119496.483660:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633481728 00002000:00100000:3.0:1787119496.483673:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (48705536->48771071) req@ffff92a634966680 x1873929633481728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.483682:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966680 with x1873929633481728 ext(48705536->48771071) 00002000:00010000:3.0:1787119496.483685:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966680 00000100:00100000:3.0:1787119496.483699:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10344 00000100:00100000:3.0:1787119496.483705:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633481984:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119496.484159:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633481984:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 451us (1923us total) trans 4294968912 rc 0/0 00000100:00100000:3.0:1787119496.484167:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10344 00002000:00100000:3.0:1787119496.484175:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (4575232->4587519) req@ffff92a634965c00 x1873929633481984/t4294968912(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 12776/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.484183:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965c00 with x1873929633481984 ext(4575232->4587519) 00002000:00010000:3.0:1787119496.484186:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634965c00 00000100:00100000:3.0:1787119496.484202:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10345 00000100:00100000:3.0:1787119496.484209:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633481728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.488567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.488644:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633482112 00000100:00100000:3.0:1787119496.488654:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633482112 00000100:00100000:3.0:1787119496.488749:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5080 00000100:00100000:3.0:1787119496.488761:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633482112:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119496.488942:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633481728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4732us (6667us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119496.488951:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10345 00002000:00100000:3.0:1787119496.488963:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (48705536->48771071) req@ffff92a634966680 x1873929633481728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.488974:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966680 with x1873929633481728 ext(48705536->48771071) 00002000:00010000:3.0:1787119496.488979:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966680 00000100:00100000:1.0:1787119496.495564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.495716:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633482240 00000100:00100000:3.0:1787119496.495729:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633482240 00002000:00100000:3.0:1787119496.495785:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (9777152->9781247) req@ffff92a634966d80 x1873929633482240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.495798:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966d80 with x1873929633482240 ext(9777152->9781247) 00002000:00010000:3.0:1787119496.495806:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966d80 00000100:00100000:3.0:1787119496.495845:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10346 00000100:00100000:3.0:1787119496.495855:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633482240:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.496870:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633482240:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1010us (1312us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.496881:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10346 00002000:00100000:3.0:1787119496.496891:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (9777152->9781247) req@ffff92a634966d80 x1873929633482240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.496901:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966d80 with x1873929633482240 ext(9777152->9781247) 00002000:00010000:3.0:1787119496.496905:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966d80 00000001:00080000:3.0:1787119496.498700:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968911 is committed 00000100:00100000:0.0:1787119496.499758:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633480832:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 38786us (40812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.499777:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5079 00000100:00100000:0.0:1787119496.507298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.507470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.507540:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633482368 00000100:00100000:3.0:1787119496.507550:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633482368 00002000:00100000:3.0:1787119496.507600:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (48771072->48807935) req@ffff92a512847100 x1873929633482368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.507620:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847100 with x1873929633482368 ext(48771072->48807935) 00002000:00010000:3.0:1787119496.507625:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847100 00000100:00100000:3.0:1787119496.507651:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633482752 00000100:00100000:3.0:1787119496.507655:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633482752 00002000:00100000:3.0:1787119496.507670:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (9781248->9785343) req@ffff92a506577b80 x1873929633482752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.507679:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577b80 with x1873929633482752 ext(9781248->9785343) 00002000:00010000:3.0:1787119496.507683:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577b80 00000100:00100000:3.0:1787119496.507702:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10347 00000100:00100000:3.0:1787119496.507712:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633482368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.507931:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10348 00000100:00100000:3.0:1787119496.507939:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633482752:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.508065:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633482752:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 126us (714us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.508073:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10348 00002000:00100000:3.0:1787119496.508080:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (9781248->9785343) req@ffff92a506577b80 x1873929633482752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.508088:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577b80 with x1873929633482752 ext(9781248->9785343) 00002000:00010000:3.0:1787119496.508091:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506577b80 00000100:00100000:0.0:1787119496.510127:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.510180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.510802:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633482624 00000100:00100000:3.0:1787119496.510813:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633482624 00000100:00100000:3.0:1787119496.510876:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19699 00000100:00100000:3.0:1787119496.510886:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+182:32728:x1873929633482624:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119496.511001:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119496.511032:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e3372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dbc expref: 182 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.511053:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119496.511059:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119496.511273:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.511286:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.511296:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119496.511429:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976512 00000004:00010000:3.0:1787119496.511506:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003a84034 reply state 00000000e300319e transno 4294976513 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.511515:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119496.511601:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+184:32728:x1873929633482624:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 716us (1483us total) trans 4294976513 rc 0/0 00000100:00100000:3.0:1787119496.511609:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19699 00000020:00080000:3.0:1787119496.511614:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119496.511974:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633482880 00000100:00100000:0.0:1787119496.511981:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633482880 00002000:00100000:0.0:1787119496.512014:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (6209536->6213631) req@ffff92a506576d80 x1873929633482880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.512024:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576d80 with x1873929633482880 ext(6209536->6213631) 00002000:00010000:0.0:1787119496.512029:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506576d80 00000100:00100000:0.0:1787119496.512052:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10349 00000100:00100000:0.0:1787119496.512060:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633482880:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.512263:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633482880:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 202us (2081us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.512270:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10349 00002000:00100000:0.0:1787119496.512277:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (6209536->6213631) req@ffff92a506576d80 x1873929633482880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.512286:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576d80 with x1873929633482880 ext(6209536->6213631) 00002000:00010000:0.0:1787119496.512290:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506576d80 00000100:00100000:3.0:1787119496.518727:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633482368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11003us (11424us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119496.518741:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10347 00002000:00100000:3.0:1787119496.518755:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (48771072->48807935) req@ffff92a512847100 x1873929633482368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.518773:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847100 with x1873929633482368 ext(48771072->48807935) 00002000:00010000:3.0:1787119496.518779:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847100 00000100:00100000:3.0:1787119496.520246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.520276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119496.520328:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.520340:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.520347:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.520363:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119496.520368:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.520377:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.520393:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119496.520396:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119496.520400:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.520406:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e3379 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.520636:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633483008 00000100:00100000:3.0:1787119496.520646:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633483008 00002000:00100000:3.0:1787119496.520688:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (9756672->9822207) req@ffff92a50655c700 x1873929633483008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.520698:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c700 with x1873929633483008 ext(9756672->9822207) 00002000:00010000:3.0:1787119496.520703:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655c700 00000100:00100000:3.0:1787119496.520723:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633483136 00000100:00100000:3.0:1787119496.520727:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633483136 00002000:00100000:3.0:1787119496.520743:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (393216->413695) req@ffff92a50655ca80 x1873929633483136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.520751:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ca80 with x1873929633483136 ext(393216->413695) 00002000:00010000:3.0:1787119496.520755:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ca80 00000100:00100000:3.0:1787119496.520771:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10350 00000100:00100000:3.0:1787119496.520779:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633483008:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.521022:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10351 00000100:00100000:3.0:1787119496.521031:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50655ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633483136:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.531569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.531624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.531757:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633483520 00000100:00100000:3.0:1787119496.531768:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633483520 00000100:00100000:3.0:1787119496.531831:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19700 00000100:00100000:3.0:1787119496.531841:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+183:32727:x1873929633483520:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119496.531896:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119496.531924:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e333a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715da7 expref: 183 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.531944:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119496.531949:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119496.532158:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.532173:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.532184:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119496.532240:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976514 00000004:00010000:3.0:1787119496.532266:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c3152fa reply state 0000000090757f18 transno 4294976515 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.532276:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119496.532631:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+185:32727:x1873929633483520:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 790us (1005us total) trans 4294976515 rc 0/0 00000100:00100000:3.0:1787119496.532640:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19700 00000020:00080000:3.0:1787119496.532646:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119496.533365:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633483264 00000100:00100000:0.0:1787119496.533374:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633483264 00002000:00010000:0.0:1787119496.533401:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (7104934->18446744073709551615) 00002000:00100000:0.0:1787119496.533406:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965500 with x1873929633483264 ext(7104934->18446744073709551615) 00002000:00010000:0.0:1787119496.533414:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634965500. 00000100:00100000:0.0:1787119496.533461:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10352 00000100:00100000:0.0:1787119496.533473:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633483264:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119496.533678:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 13267460 -> 7104934 00002000:00010000:0.0:1787119496.533682:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119496.533685:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119496.533687:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119496.533689:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:0.0:1787119496.535237:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633483264:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1757us (3668us total) trans 4294969178 rc 0/0 00000100:00100000:0.0:1787119496.535252:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10352 00002000:00010000:0.0:1787119496.535257:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (7104934->18446744073709551615) 00002000:00100000:0.0:1787119496.535261:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965500 with x1873929633483264 ext(7104934->18446744073709551615) 00002000:00010000:0.0:1787119496.535269:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634965500. 00000100:00100000:3.0:1787119496.536271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.536295:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633483648 00000100:00100000:3.0:1787119496.536302:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633483648 00002000:00010000:3.0:1787119496.536341:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (3317751->18446744073709551615) 00002000:00100000:3.0:1787119496.536345:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19180 with x1873929633483648 ext(3317751->18446744073709551615) 00002000:00010000:3.0:1787119496.536725:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19180. 00000100:00100000:3.0:1787119496.537949:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10353 00000100:00100000:3.0:1787119496.537964:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633483648:12345-192.168.201.59@tcp:10:fsx.0 00010000:00010000:0.0:1787119496.538534:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.538543:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.538548:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.538552:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6069f4a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119496.538556:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.538562:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.538574:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119496.538576:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119496.538579:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.538583:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e3380 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.539105:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633483136:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18072us (18824us total) trans 0 rc 20480/20480 00000100:00100000:1.0:1787119496.539112:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10351 00002000:00100000:1.0:1787119496.539121:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (393216->413695) req@ffff92a50655ca80 x1873929633483136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.539128:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655ca80 with x1873929633483136 ext(393216->413695) 00002000:00010000:1.0:1787119496.539131:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50655ca80 00000100:00100000:1.0:1787119496.539182:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50655c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633483008:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18405us (18945us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119496.539187:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10350 00002000:00100000:1.0:1787119496.539190:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (9756672->9822207) req@ffff92a50655c700 x1873929633483008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.539196:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50655c700 with x1873929633483008 ext(9756672->9822207) 00002000:00010000:1.0:1787119496.539199:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50655c700 00002000:00010000:3.0:1787119496.540085:0:18579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 63981300 -> 3317751 00002000:00010000:3.0:1787119496.540092:0:18579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:3.0:1787119496.540094:0:18579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119496.540097:0:18579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:3.0:1787119496.540100:0:18579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:3.0:1787119496.540541:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633483648:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 2577us (4269us total) trans 4294969179 rc 0/0 00000100:00100000:3.0:1787119496.540551:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10353 00002000:00010000:3.0:1787119496.540556:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (3317751->18446744073709551615) 00002000:00100000:3.0:1787119496.540559:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19180 with x1873929633483648 ext(3317751->18446744073709551615) 00002000:00010000:3.0:1787119496.540568:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19180. 00000100:00100000:1.0:1787119496.542282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.542435:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633483776 00000100:00100000:1.0:1787119496.542468:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633483776 00000100:00100000:1.0:1787119496.542519:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19701 00000100:00100000:1.0:1787119496.542529:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+184:32728:x1873929633483776:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119496.542552:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119496.542572:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3387 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715dc3 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.542671:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e338e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.542687:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e338e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.542700:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e338e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119496.542729:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 7104934 00000004:00200000:1.0:1787119496.542733:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119496.542758:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e338e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.542787:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dc3 expref: 186 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.542813:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e338e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dc3 expref: 185 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.542822:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119496.542825:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119496.542829:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:1.0:1787119496.542885:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+185:32728:x1873929633483776:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 357us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.542892:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19701 00000100:00100000:0.0:1787119496.546262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.547237:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633484032 00000100:00100000:3.0:1787119496.547250:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633484032 00000100:00100000:3.0:1787119496.547481:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19702 00000100:00100000:3.0:1787119496.547496:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+185:32729:x1873929633484032:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119496.547556:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119496.547586:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e32fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d92 expref: 185 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.547607:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119496.547612:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119496.547841:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.547855:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.547864:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119496.547914:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976516 00000004:00010000:3.0:1787119496.547941:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000010e0f9a reply state 00000000de1283f3 transno 4294976517 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.547955:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119496.548045:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+187:32729:x1873929633484032:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 551us (1789us total) trans 4294976517 rc 0/0 00000100:00100000:3.0:1787119496.548055:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19702 00000020:00080000:3.0:1787119496.548061:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119496.551837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.551917:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633484160 00000100:00100000:1.0:1787119496.551927:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633484160 00002000:00100000:1.0:1787119496.551975:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (29409280->29413375) req@ffff92a519d18700 x1873929633484160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.551986:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18700 with x1873929633484160 ext(29409280->29413375) 00002000:00010000:1.0:1787119496.551992:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18700 00000100:00100000:1.0:1787119496.552025:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10354 00000100:00100000:1.0:1787119496.552034:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633484160:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.552260:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633484160:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 226us (430us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.552268:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10354 00002000:00100000:1.0:1787119496.552274:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (29409280->29413375) req@ffff92a519d18700 x1873929633484160/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.552283:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18700 with x1873929633484160 ext(29409280->29413375) 00002000:00010000:1.0:1787119496.552287:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18700 00010000:00010000:3.0:1787119496.553270:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.553284:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.553291:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.553298:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6069f5c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119496.553313:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.553321:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.553337:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119496.553340:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119496.553344:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.553420:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e3395 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.555514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.555600:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633484288 00000100:00100000:1.0:1787119496.555610:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633484288 00000100:00100000:1.0:1787119496.555666:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19703 00000100:00100000:1.0:1787119496.555676:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+186:32727:x1873929633484288:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119496.555702:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119496.555729:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e339c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715dca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.555832:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.555846:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.555856:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119496.555881:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 3317751 00000004:00200000:1.0:1787119496.555886:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119496.555903:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.555928:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e339c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dca expref: 188 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.555947:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dca expref: 187 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.555955:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119496.555959:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119496.555962:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430400, rc 0) 00000100:00100000:1.0:1787119496.556017:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+187:32727:x1873929633484288:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 342us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.556025:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19703 00000001:00080000:2.0:1787119496.557532:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968912 is committed 00000100:00100000:3.0:1787119496.557903:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633482112:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 69140us (69341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.557915:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5080 00000100:00100000:1.0:1787119496.558102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.558141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.558206:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633484416 00000100:00100000:2.0:1787119496.558215:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633484416 00002000:00010000:2.0:1787119496.558247:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (63981300->18446744073709551615) 00002000:00100000:2.0:1787119496.558252:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3d880 with x1873929633484416 ext(63981300->18446744073709551615) 00002000:00010000:2.0:1787119496.558263:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3d880. 00000100:00100000:2.0:1787119496.558289:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633484544 00000100:00100000:2.0:1787119496.558292:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633484544 00002000:00100000:2.0:1787119496.558320:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (29433856->29437951) req@ffff92a633e3c000 x1873929633484544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.558330:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3c000 with x1873929633484544 ext(29433856->29437951) 00002000:00010000:2.0:1787119496.558335:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3c000 00000100:00100000:2.0:1787119496.558364:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10355 00000100:00100000:2.0:1787119496.558373:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633484416:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119496.558672:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 60381765 -> 63981300 00002000:00010000:2.0:1787119496.558675:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119494 -> 1787119495 00002000:00010000:2.0:1787119496.558678:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119496.558680:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119494 -> 1787119495 00002000:00010000:2.0:1787119496.558682:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 2831 -> 2959 00000100:00100000:2.0:1787119496.558732:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633484416:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 359us (630us total) trans 4294969180 rc 0/0 00000100:00100000:2.0:1787119496.558741:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10355 00002000:00010000:2.0:1787119496.558746:0:6699:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (63981300->18446744073709551615) 00002000:00100000:2.0:1787119496.558749:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3d880 with x1873929633484416 ext(63981300->18446744073709551615) 00002000:00010000:2.0:1787119496.558754:0:6699:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a633e3d880. 00000100:00100000:2.0:1787119496.558774:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10356 00000100:00100000:2.0:1787119496.558782:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633484544:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.558993:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633484544:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 211us (850us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.559004:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10356 00002000:00100000:2.0:1787119496.559013:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (29433856->29437951) req@ffff92a633e3c000 x1873929633484544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.559022:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3c000 with x1873929633484544 ext(29433856->29437951) 00002000:00010000:2.0:1787119496.559027:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3c000 00000100:00100000:1.0:1787119496.565863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.566003:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633484800 00000100:00100000:2.0:1787119496.566014:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633484800 00000100:00100000:2.0:1787119496.566124:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19704 00000100:00100000:2.0:1787119496.566137:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+187:32727:x1873929633484800:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119496.566208:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119496.566242:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dca expref: 187 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.566264:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119496.566269:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119496.566720:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.566740:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.566752:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119496.566820:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976518 00000004:00010000:2.0:1787119496.566851:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a8ef165 reply state 000000000e351c8c transno 4294976519 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.566866:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119496.566984:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+189:32727:x1873929633484800:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 849us (1129us total) trans 4294976519 rc 0/0 00000100:00100000:2.0:1787119496.566992:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19704 00000020:00080000:2.0:1787119496.566998:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787119496.575837:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.575858:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.575865:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.575872:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119496.575877:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.575884:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.575903:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119496.575906:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119496.575911:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.575917:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e33aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.576913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.577226:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633485056 00000100:00100000:3.0:1787119496.577238:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633485056 00000100:00100000:3.0:1787119496.577315:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19705 00000100:00100000:3.0:1787119496.577327:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+188:32728:x1873929633485056:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119496.577387:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119496.577414:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e338e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dc3 expref: 188 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.577431:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119496.577435:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119496.577694:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.577709:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.577720:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119496.577770:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976520 00000004:00010000:3.0:1787119496.577794:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eccd24e0 reply state 0000000005abb507 transno 4294976521 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.577803:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119496.578120:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+190:32728:x1873929633485056:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 794us (1214us total) trans 4294976521 rc 0/0 00000100:00100000:3.0:1787119496.578127:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19705 00000020:00080000:3.0:1787119496.578132:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119496.580092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.580132:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.581606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119496.581651:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.581664:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.581671:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.581679:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6069f5c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119496.581683:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.581696:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.581713:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:2.0:1787119496.581716:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119496.581720:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.581726:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5c00/0xcaba3de8463e33b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.582182:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633485184 00000100:00100000:1.0:1787119496.582193:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633485184 00000100:00100000:0.0:1787119496.582202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.582241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:1.0:1787119496.582254:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (21741568->21745663) req@ffff92a506575c00 x1873929633485184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.582268:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575c00 with x1873929633485184 ext(21741568->21745663) 00002000:00010000:1.0:1787119496.582273:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506575c00 00000100:00100000:0.0:1787119496.582330:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633485312 00000100:00100000:0.0:1787119496.582334:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633485312 00000100:00100000:1.0:1787119496.582364:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633485440 00000100:00100000:1.0:1787119496.582368:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633485440 00002000:00010000:1.0:1787119496.582382:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (64600736->18446744073709551615) 00002000:00100000:1.0:1787119496.582385:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506574000 with x1873929633485440 ext(64600736->18446744073709551615) 00002000:00010000:1.0:1787119496.582395:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506574000. 00000100:00100000:1.0:1787119496.582409:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633485696 00000100:00100000:1.0:1787119496.582412:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633485696 00002000:00100000:1.0:1787119496.582427:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (10141696->10145791) req@ffff92a506577100 x1873929633485696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.582436:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577100 with x1873929633485696 ext(10141696->10145791) 00002000:00010000:1.0:1787119496.582464:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506577100 00000100:00100000:1.0:1787119496.582481:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10357 00002000:00010000:0.0:1787119496.582482:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (13267460->18446744073709551615) 00002000:00100000:0.0:1787119496.582485:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576680 with x1873929633485312 ext(13267460->18446744073709551615) 00000100:00100000:1.0:1787119496.582490:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633485184:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:0.0:1787119496.582491:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506576680. 00000100:00100000:0.0:1787119496.582507:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10358 00000100:00100000:0.0:1787119496.582514:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633485440:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:1.0:1787119496.582707:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633485184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 216us (2624us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.582714:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10357 00002000:00100000:1.0:1787119496.582721:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (21741568->21745663) req@ffff92a506575c00 x1873929633485184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.582729:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506575c00 with x1873929633485184 ext(21741568->21745663) 00002000:00010000:1.0:1787119496.582732:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506575c00 00000100:00100000:1.0:1787119496.582748:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10359 00000100:00100000:1.0:1787119496.582754:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633485696:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:0.0:1787119496.582763:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7104934 -> 64600736 00002000:00010000:0.0:1787119496.582766:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119496.582768:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119496.582770:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119496.582772:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:0.0:1787119496.582801:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633485440:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 287us (1203us total) trans 4294969181 rc 0/0 00000100:00100000:0.0:1787119496.582809:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10358 00002000:00010000:0.0:1787119496.582812:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (64600736->18446744073709551615) 00002000:00100000:0.0:1787119496.582814:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506574000 with x1873929633485440 ext(64600736->18446744073709551615) 00002000:00010000:0.0:1787119496.582819:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506574000. 00000100:00100000:0.0:1787119496.582832:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10360 00000100:00100000:0.0:1787119496.582838:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633485312:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119496.582927:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 3317751 -> 13267460 00002000:00010000:0.0:1787119496.582931:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119496.582933:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:0.0:1787119496.582935:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119496.582937:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:0.0:1787119496.583035:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633485312:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 196us (2901us total) trans 4294969182 rc 0/0 00000100:00100000:0.0:1787119496.583042:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10360 00002000:00010000:0.0:1787119496.583045:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (13267460->18446744073709551615) 00002000:00100000:0.0:1787119496.583048:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506576680 with x1873929633485312 ext(13267460->18446744073709551615) 00002000:00010000:0.0:1787119496.583053:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506576680. 00000100:00100000:1.0:1787119496.583095:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633485696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 339us (852us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.583101:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10359 00002000:00100000:1.0:1787119496.583108:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (10141696->10145791) req@ffff92a506577100 x1873929633485696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.583115:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506577100 with x1873929633485696 ext(10141696->10145791) 00002000:00010000:1.0:1787119496.583118:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a506577100 00000100:00100000:1.0:1787119496.583146:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633485568 00000100:00100000:1.0:1787119496.583150:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633485568 00000100:00100000:1.0:1787119496.583188:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19706 00000100:00100000:1.0:1787119496.583196:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+189:32729:x1873929633485568:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119496.583210:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119496.583227:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e33b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715dd1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.583301:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e33bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.583383:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e33bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.583395:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e33bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119496.583419:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 63981300 00000004:00200000:1.0:1787119496.583423:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119496.583517:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e33bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.583543:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e33b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dd1 expref: 191 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.583558:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e33bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dd1 expref: 190 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.583567:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119496.583569:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119496.583572:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430a00, rc 0) 00000100:00100000:1.0:1787119496.583596:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+190:32729:x1873929633485568:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 402us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.583602:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19706 00000100:00100000:0.0:1787119496.587720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.587960:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633485824 00000100:00100000:3.0:1787119496.587971:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633485824 00002000:00100000:3.0:1787119496.588022:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (10145792->10149887) req@ffff92a509871f80 x1873929633485824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787119496.588083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:3.0:1787119496.588167:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871f80 with x1873929633485824 ext(10145792->10149887) 00002000:00010000:3.0:1787119496.588172:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871f80 00000100:00100000:0.0:1787119496.588250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.588335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.588491:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633486080 00000100:00100000:2.0:1787119496.588496:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633486080 00000100:00100000:2.0:1787119496.588535:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19707 00000100:00100000:2.0:1787119496.588546:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+190:32727:x1873929633486080:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119496.588562:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119496.588582:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e33c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715dd8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.588666:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e33cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.588680:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e33cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.588690:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e33cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119496.588716:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 13267460 00000004:00200000:2.0:1787119496.588720:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119496.588738:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e33cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.588766:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e33c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dd8 expref: 192 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.588784:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e33cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dd8 expref: 191 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.588792:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119496.588795:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119496.588799:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119496.588925:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+191:32727:x1873929633486080:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 380us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119496.588937:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19707 00000100:00100000:1.0:1787119496.589203:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633485952 00000100:00100000:1.0:1787119496.589207:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633485952 00002000:00100000:1.0:1787119496.589233:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (21745664->21749759) req@ffff92a509870000 x1873929633485952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.589242:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870000 with x1873929633485952 ext(21745664->21749759) 00002000:00010000:1.0:1787119496.589247:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509870000 00000100:00100000:3.0:1787119496.589271:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633486208 00000100:00100000:0.0:1787119496.589271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.589274:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633486208 00002000:00100000:3.0:1787119496.589294:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (48726016->48730111) req@ffff92a509871500 x1873929633486208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.589313:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871500 with x1873929633486208 ext(48726016->48730111) 00002000:00010000:3.0:1787119496.589317:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871500 00000100:00100000:2.0:1787119496.591194:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633486336 00000100:00100000:2.0:1787119496.591206:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633486336 00002000:00100000:2.0:1787119496.591250:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (64561152->64565247) req@ffff92a509873100 x1873929633486336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.591261:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873100 with x1873929633486336 ext(64561152->64565247) 00002000:00010000:2.0:1787119496.591267:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509873100 00000100:00100000:2.0:1787119496.591515:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10361 00000100:00100000:2.0:1787119496.591526:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633485824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.591775:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633485824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 250us (4065us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.591782:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10361 00002000:00100000:2.0:1787119496.591789:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (10145792->10149887) req@ffff92a509871f80 x1873929633485824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.591798:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871f80 with x1873929633485824 ext(10145792->10149887) 00002000:00010000:2.0:1787119496.591802:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871f80 00000100:00100000:2.0:1787119496.591898:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10362 00000100:00100000:2.0:1787119496.591907:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633485952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.592020:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633485952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 114us (3937us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.592027:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10362 00002000:00100000:2.0:1787119496.592032:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (21745664->21749759) req@ffff92a509870000 x1873929633485952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.592040:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870000 with x1873929633485952 ext(21745664->21749759) 00002000:00010000:2.0:1787119496.592043:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509870000 00000100:00100000:2.0:1787119496.592058:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10363 00000100:00100000:2.0:1787119496.592065:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633486208:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.592150:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633486208:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 85us (3815us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.592156:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10363 00002000:00100000:2.0:1787119496.592161:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (48726016->48730111) req@ffff92a509871500 x1873929633486208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.592168:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871500 with x1873929633486208 ext(48726016->48730111) 00002000:00010000:2.0:1787119496.592172:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871500 00000100:00100000:2.0:1787119496.592189:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10364 00000100:00100000:2.0:1787119496.592198:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633486336:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.592471:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633486336:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 274us (3199us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.592477:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10364 00002000:00100000:2.0:1787119496.592482:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (64561152->64565247) req@ffff92a509873100 x1873929633486336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.592489:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509873100 with x1873929633486336 ext(64561152->64565247) 00002000:00010000:2.0:1787119496.592492:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509873100 00000100:00100000:0.0:1787119496.596790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.600064:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633486464 00000100:00100000:2.0:1787119496.600079:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633486464 00002000:00100000:2.0:1787119496.600154:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (10121216->10186751) req@ffff92a509870e00 x1873929633486464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.600165:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870e00 with x1873929633486464 ext(10121216->10186751) 00002000:00010000:2.0:1787119496.600170:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509870e00 00000100:00100000:2.0:1787119496.600207:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10365 00000100:00100000:2.0:1787119496.600215:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633486464:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.600379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.600422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.600477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.600615:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633486592 00000100:00100000:3.0:1787119496.600620:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633486592 00002000:00100000:3.0:1787119496.600642:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (21721088->21786623) req@ffff92a633e3ca80 x1873929633486592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.600651:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3ca80 with x1873929633486592 ext(21721088->21786623) 00002000:00010000:3.0:1787119496.600655:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3ca80 00000100:00100000:3.0:1787119496.600676:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633486720 00000100:00100000:3.0:1787119496.600680:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633486720 00002000:00100000:3.0:1787119496.600697:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (64565248->64569343) req@ffff92a511f55500 x1873929633486720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.600706:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55500 with x1873929633486720 ext(64565248->64569343) 00002000:00010000:3.0:1787119496.600709:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55500 00000100:00100000:3.0:1787119496.600723:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633486848 00000100:00100000:3.0:1787119496.600726:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633486848 00002000:00100000:3.0:1787119496.600740:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (48730112->48734207) req@ffff92a511f56300 x1873929633486848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.600752:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56300 with x1873929633486848 ext(48730112->48734207) 00002000:00010000:3.0:1787119496.600756:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f56300 00000100:00100000:3.0:1787119496.600771:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10366 00000100:00100000:3.0:1787119496.600778:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a633e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633486592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.601013:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10367 00000100:00100000:0.0:1787119496.601023:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10368 00000100:00100000:0.0:1787119496.601033:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2374:x1873929633486848:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.601167:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2374:x1873929633486848:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 136us (688us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.601176:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10368 00002000:00100000:0.0:1787119496.601182:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (48730112->48734207) req@ffff92a511f56300 x1873929633486848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.601196:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56300 with x1873929633486848 ext(48730112->48734207) 00002000:00010000:0.0:1787119496.601200:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f56300 00000100:00100000:3.0:1787119496.601286:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633486720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.601532:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633486720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 250us (1109us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.601539:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10367 00002000:00100000:3.0:1787119496.601545:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (64565248->64569343) req@ffff92a511f55500 x1873929633486720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.601552:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55500 with x1873929633486720 ext(64565248->64569343) 00002000:00010000:3.0:1787119496.601555:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55500 00000100:00100000:1.0:1787119496.607640:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a633e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633486592:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6848us (7247us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119496.607657:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10366 00002000:00100000:1.0:1787119496.607672:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (21721088->21786623) req@ffff92a633e3ca80 x1873929633486592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.607682:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a633e3ca80 with x1873929633486592 ext(21721088->21786623) 00002000:00010000:1.0:1787119496.607690:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a633e3ca80 00000100:00100000:2.0:1787119496.609109:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633486464:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8885us (12321us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119496.609121:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10365 00002000:00100000:2.0:1787119496.609131:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x23:0x0] (10121216->10186751) req@ffff92a509870e00 x1873929633486464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.609141:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870e00 with x1873929633486464 ext(10121216->10186751) 00002000:00010000:2.0:1787119496.609146:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509870e00 00000100:00100000:3.0:1787119496.613206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.613257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.613402:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633486976 00000100:00100000:1.0:1787119496.613413:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633486976 00002000:00100000:1.0:1787119496.613509:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (48705536->48771071) req@ffff92a519d1ad80 x1873929633486976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.613520:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1ad80 with x1873929633486976 ext(48705536->48771071) 00002000:00010000:1.0:1787119496.613525:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1ad80 00000100:00100000:1.0:1787119496.613555:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633487104 00000100:00100000:1.0:1787119496.613558:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633487104 00002000:00100000:1.0:1787119496.613573:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (64540672->64602111) req@ffff92a519d1bb80 x1873929633487104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.613581:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1bb80 with x1873929633487104 ext(64540672->64602111) 00002000:00010000:1.0:1787119496.613585:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1bb80 00000100:00100000:1.0:1787119496.613610:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10369 00000100:00100000:1.0:1787119496.613619:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633486976:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.613644:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10370 00000100:00100000:0.0:1787119496.613652:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2374:x1873929633487104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.620693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.620736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.620746:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633487232 00000100:00100000:3.0:1787119496.620756:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633487232 00002000:00100000:3.0:1787119496.620807:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (17801216->17817599) req@ffff92a51282f480 x1873929633487232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.620819:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f480 with x1873929633487232 ext(17801216->17817599) 00000100:00100000:2.0:1787119496.620821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00010000:3.0:1787119496.620825:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282f480 00000100:00100000:3.0:1787119496.620850:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633487616 00000100:00100000:3.0:1787119496.620854:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633487616 00002000:00100000:3.0:1787119496.620869:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (59912192->59924479) req@ffff92a51282d180 x1873929633487616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.620876:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d180 with x1873929633487616 ext(59912192->59924479) 00002000:00010000:3.0:1787119496.620880:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282d180 00000100:00100000:3.0:1787119496.620897:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10371 00000100:00100000:3.0:1787119496.620905:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633487232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.621024:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633486976:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7404us (7826us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119496.621032:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10369 00002000:00100000:2.0:1787119496.621038:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (48705536->48771071) req@ffff92a519d1ad80 x1873929633486976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.621045:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1ad80 with x1873929633486976 ext(48705536->48771071) 00002000:00010000:2.0:1787119496.621049:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1ad80 00000100:00100000:2.0:1787119496.621066:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10372 00000100:00100000:2.0:1787119496.621073:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633487616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.621115:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633487232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 210us (433us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119496.621123:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10371 00002000:00100000:3.0:1787119496.621130:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (17801216->17817599) req@ffff92a51282f480 x1873929633487232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/16824 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.621138:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f480 with x1873929633487232 ext(17801216->17817599) 00002000:00010000:3.0:1787119496.621141:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282f480 00000100:00100000:2.0:1787119496.621185:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633487616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 111us (362us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119496.621191:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10372 00002000:00100000:2.0:1787119496.621196:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (59912192->59924479) req@ffff92a51282d180 x1873929633487616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/12728 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.621204:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d180 with x1873929633487616 ext(59912192->59924479) 00002000:00010000:2.0:1787119496.621207:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282d180 00000100:00100000:0.0:1787119496.622310:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633487104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8653us (9046us total) trans 0 rc 53248/53248 00000100:00100000:0.0:1787119496.622321:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10370 00002000:00100000:0.0:1787119496.622329:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (64540672->64602111) req@ffff92a519d1bb80 x1873929633487104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.622339:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1bb80 with x1873929633487104 ext(64540672->64602111) 00002000:00010000:0.0:1787119496.622343:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1bb80 00000100:00100000:1.0:1787119496.622547:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633487488 00000100:00100000:1.0:1787119496.622554:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633487488 00000100:00100000:1.0:1787119496.622639:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19708 00000100:00100000:1.0:1787119496.622648:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+191:32727:x1873929633487488:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119496.622695:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119496.622735:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e33cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dd8 expref: 191 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.622752:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119496.622757:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119496.622972:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.622995:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.623004:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119496.623056:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976522 00000004:00010000:1.0:1787119496.623080:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000881ae92a reply state 0000000044d8a16b transno 4294976523 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.623089:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119496.623147:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+193:32727:x1873929633487488:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 499us (2410us total) trans 4294976523 rc 0/0 00000100:00100000:1.0:1787119496.623156:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19708 00000020:00080000:1.0:1787119496.623160:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119496.624313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.624433:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633487744 00000100:00100000:1.0:1787119496.624468:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633487744 00002000:00100000:1.0:1787119496.624507:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (48771072->48807935) req@ffff92a519d19c00 x1873929633487744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.624518:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19c00 with x1873929633487744 ext(48771072->48807935) 00002000:00010000:1.0:1787119496.624523:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19c00 00000100:00100000:1.0:1787119496.624546:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10373 00000100:00100000:1.0:1787119496.624554:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633487744:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.629916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.629948:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633488000 00000100:00100000:0.0:1787119496.629958:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633488000 00002000:00100000:0.0:1787119496.630008:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (43814912->43819007) req@ffff92a509872a00 x1873929633488000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.630019:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872a00 with x1873929633488000 ext(43814912->43819007) 00002000:00010000:0.0:1787119496.630025:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509872a00 00000100:00100000:0.0:1787119496.630060:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10374 00000100:00100000:0.0:1787119496.630071:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633488000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.630334:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633488000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 264us (425us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.630345:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10374 00002000:00100000:0.0:1787119496.630362:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (43814912->43819007) req@ffff92a509872a00 x1873929633488000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.630370:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872a00 with x1873929633488000 ext(43814912->43819007) 00002000:00010000:0.0:1787119496.630374:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509872a00 00000100:00100000:0.0:1787119496.630412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119496.630482:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.630492:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.630499:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.630506:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119496.630510:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.630516:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.630531:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119496.630533:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119496.630537:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.630542:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e33d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.630591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.631127:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633487872 00000100:00100000:3.0:1787119496.631133:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633487872 00002000:00100000:3.0:1787119496.631158:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (41320448->41332735) req@ffff92a509871880 x1873929633487872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.631168:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871880 with x1873929633487872 ext(41320448->41332735) 00002000:00010000:3.0:1787119496.631173:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871880 00000100:00100000:3.0:1787119496.631195:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633488128 00000100:00100000:3.0:1787119496.631198:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633488128 00002000:00010000:3.0:1787119496.631212:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (7104934->18446744073709551615) 00002000:00100000:3.0:1787119496.631215:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872300 with x1873929633488128 ext(7104934->18446744073709551615) 00002000:00010000:3.0:1787119496.631224:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872300. 00000100:00100000:3.0:1787119496.631240:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10375 00000100:00100000:3.0:1787119496.631249:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633487872:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.631420:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633487872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 172us (1007us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1787119496.631427:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10375 00002000:00100000:3.0:1787119496.631432:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (41320448->41332735) req@ffff92a509871880 x1873929633487872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/12728 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.631472:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871880 with x1873929633487872 ext(41320448->41332735) 00002000:00010000:3.0:1787119496.631476:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509871880 00000100:00100000:3.0:1787119496.631490:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10376 00000100:00100000:3.0:1787119496.631497:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633488128:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119496.631750:0:18547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 13267460 -> 7104934 00002000:00010000:3.0:1787119496.631755:0:18547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:3.0:1787119496.631757:0:18547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119496.631759:0:18547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:3.0:1787119496.631761:0:18547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:3.0:1787119496.631789:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2376:x1873929633488128:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 293us (1198us total) trans 4294969183 rc 0/0 00000100:00100000:3.0:1787119496.631795:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10376 00002000:00010000:3.0:1787119496.631798:0:18547:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (7104934->18446744073709551615) 00002000:00100000:3.0:1787119496.631801:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509872300 with x1873929633488128 ext(7104934->18446744073709551615) 00002000:00010000:3.0:1787119496.631805:0:18547:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509872300. 00000100:00100000:0.0:1787119496.633194:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.633257:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633488256 00000100:00100000:1.0:1787119496.633265:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633488256 00002000:00100000:1.0:1787119496.633304:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (64561152->64600735) req@ffff92a509870380 x1873929633488256/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.633314:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870380 with x1873929633488256 ext(64561152->64600735) 00002000:00010000:1.0:1787119496.633319:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870380 00000100:00100000:1.0:1787119496.633342:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10377 00000100:00100000:1.0:1787119496.633419:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2374:x1873929633488256:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119496.634597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.634663:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633488384 00000100:00100000:3.0:1787119496.634669:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633488384 00000100:00100000:3.0:1787119496.634706:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19709 00000100:00100000:3.0:1787119496.634714:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+192:32727:x1873929633488384:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119496.634733:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119496.634750:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e33db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ddf expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.634841:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e33e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.634854:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e33e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.634864:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e33e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119496.634890:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 7104934 00000004:00200000:3.0:1787119496.634894:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119496.634911:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e33e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.634936:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f4a00/0xcaba3de8463e33db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ddf expref: 194 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.634950:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e33e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ddf expref: 193 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.634956:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119496.634958:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119496.634961:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6069f5a00, rc 0) 00000100:00100000:3.0:1787119496.635045:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+193:32727:x1873929633488384:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 331us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.635052:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19709 00000100:00100000:1.0:1787119496.644029:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2374:x1873929633488256:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 10660us (10824us total) trans 4294969184 rc 0/0 00000100:00100000:1.0:1787119496.644047:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10377 00002000:00100000:1.0:1787119496.644063:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (64561152->64600735) req@ffff92a509870380 x1873929633488256/t4294969184(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.644083:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509870380 with x1873929633488256 ext(64561152->64600735) 00002000:00010000:1.0:1787119496.644091:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509870380 00000100:00100000:0.0:1787119496.654712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.654991:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633488640 00000100:00100000:1.0:1787119496.655004:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633488640 00000100:00100000:1.0:1787119496.655068:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19710 00000100:00100000:1.0:1787119496.655079:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+193:32727:x1873929633488640:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119496.655145:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119496.655176:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6069f5a00/0xcaba3de8463e33e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ddf expref: 193 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.655199:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119496.655206:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119496.656764:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.656781:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.656788:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.657967:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.658391:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633488768 00000100:00100000:0.0:1787119496.658403:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633488768 00000100:00100000:0.0:1787119496.658488:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5081 00000100:00100000:0.0:1787119496.658498:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633488768:12345-192.168.201.59@tcp:16:fsx.0 00000001:00080000:1.0:1787119496.658567:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976524 00000004:00010000:1.0:1787119496.658624:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b9ea5fd reply state 000000008bd7baa9 transno 4294976525 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.658642:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119496.658735:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+195:32727:x1873929633488640:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 3658us (4039us total) trans 4294976525 rc 0/0 00000100:00100000:1.0:1787119496.658746:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19710 00000020:00080000:1.0:1787119496.658751:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119496.660257:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633487744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 35694us (35950us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119496.660270:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10373 00002000:00100000:2.0:1787119496.660281:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (48771072->48807935) req@ffff92a519d19c00 x1873929633487744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.660290:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19c00 with x1873929633487744 ext(48771072->48807935) 00002000:00010000:2.0:1787119496.660296:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19c00 00000100:00100000:3.0:1787119496.666120:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119496.667588:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.667606:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.667614:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.667621:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513431200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119496.667627:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.667636:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.667653:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119496.667656:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119496.667660:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.667667:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e33e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.669527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.671137:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.671554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.671574:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633489408 00000100:00100000:0.0:1787119496.671582:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633489408 00000100:00100000:1.0:1787119496.671612:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633489024 00000100:00100000:1.0:1787119496.671617:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633489024 00000100:00100000:0.0:1787119496.671633:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19711 00000100:00100000:0.0:1787119496.671643:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+194:32729:x1873929633489408:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119496.671697:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1787119496.671712:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (60612608->60616703) req@ffff92a519d19f80 x1873929633489024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.671721:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19f80 with x1873929633489024 ext(60612608->60616703) 00010000:00010000:0.0:1787119496.671722:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e33bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dd1 expref: 194 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119496.671726:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d19f80 00010000:00010000:0.0:1787119496.671739:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119496.671748:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119496.671956:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633489152 00000100:00100000:1.0:1787119496.671961:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633489152 00000100:00100000:2.0:1787119496.671980:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633488896 00000100:00100000:2.0:1787119496.671984:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633488896 00002000:00010000:1.0:1787119496.671986:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (64600736->18446744073709551615) 00002000:00100000:1.0:1787119496.671989:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871180 with x1873929633489152 ext(64600736->18446744073709551615) 00002000:00010000:1.0:1787119496.671998:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871180. 00002000:00100000:2.0:1787119496.672002:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (43819008->43823103) req@ffff92a6068bd500 x1873929633488896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.672011:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd500 with x1873929633488896 ext(43819008->43823103) 00002000:00010000:2.0:1787119496.672014:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd500 00010000:00010000:0.0:1787119496.672038:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.672051:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.672064:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119496.672132:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976526 00000004:00010000:0.0:1787119496.672152:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f4643b reply state 000000008fa1388a transno 4294976527 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.672161:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119496.672234:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+196:32729:x1873929633489408:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 593us (681us total) trans 4294976527 rc 0/0 00000100:00100000:0.0:1787119496.672241:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19711 00000020:00080000:0.0:1787119496.672245:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119496.672643:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10378 00000100:00100000:3.0:1787119496.672654:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633489024:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.672840:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633489024:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 189us (6729us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.672847:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10378 00002000:00100000:3.0:1787119496.672854:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (60612608->60616703) req@ffff92a519d19f80 x1873929633489024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.672862:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19f80 with x1873929633489024 ext(60612608->60616703) 00002000:00010000:3.0:1787119496.672865:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d19f80 00000100:00100000:3.0:1787119496.672880:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10379 00000100:00100000:3.0:1787119496.672887:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2376:x1873929633489152:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119496.673079:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 7104934 -> 64600736 00002000:00010000:3.0:1787119496.673083:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:3.0:1787119496.673085:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:3.0:1787119496.673087:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:3.0:1787119496.673089:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 2959 -> 909 00000100:00100000:3.0:1787119496.673119:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2376:x1873929633489152:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 231us (3600us total) trans 4294969185 rc 0/0 00000100:00100000:3.0:1787119496.673126:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10379 00002000:00010000:3.0:1787119496.673130:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (64600736->18446744073709551615) 00002000:00100000:3.0:1787119496.673133:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509871180 with x1873929633489152 ext(64600736->18446744073709551615) 00002000:00010000:3.0:1787119496.673138:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509871180. 00000100:00100000:3.0:1787119496.673150:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10380 00000100:00100000:3.0:1787119496.673239:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633488896:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.673471:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633488896:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 233us (2344us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.673477:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10380 00002000:00100000:3.0:1787119496.673484:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (43819008->43823103) req@ffff92a6068bd500 x1873929633488896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.673492:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd500 with x1873929633488896 ext(43819008->43823103) 00002000:00010000:3.0:1787119496.673495:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd500 00010000:00010000:1.0:1787119496.676857:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.676875:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.676882:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.676889:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fa800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119496.676894:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.676903:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.676925:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119496.676928:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119496.676932:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.676939:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e33f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.678728:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.678770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.678796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.678857:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633489664 00000100:00100000:1.0:1787119496.678867:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633489664 00002000:00100000:1.0:1787119496.678916:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (60616704->60620799) req@ffff92a6068bea00 x1873929633489664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.678927:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bea00 with x1873929633489664 ext(60616704->60620799) 00002000:00010000:1.0:1787119496.678933:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bea00 00000100:00100000:1.0:1787119496.678962:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633489536 00000100:00100000:1.0:1787119496.678966:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633489536 00002000:00100000:1.0:1787119496.678982:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (64561152->64565247) req@ffff92a6068bdf80 x1873929633489536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.678989:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bdf80 with x1873929633489536 ext(64561152->64565247) 00002000:00010000:1.0:1787119496.678992:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bdf80 00000100:00100000:1.0:1787119496.679003:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633489792 00000100:00100000:1.0:1787119496.679005:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633489792 00002000:00010000:1.0:1787119496.679016:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (3317751->18446744073709551615) 00002000:00100000:1.0:1787119496.679019:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd880 with x1873929633489792 ext(3317751->18446744073709551615) 00002000:00010000:1.0:1787119496.679031:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bd880. 00000100:00100000:1.0:1787119496.679048:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10381 00000100:00100000:1.0:1787119496.679055:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633489664:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.679288:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633489664:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 232us (569us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.679297:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10381 00002000:00100000:1.0:1787119496.679420:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (60616704->60620799) req@ffff92a6068bea00 x1873929633489664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.679428:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bea00 with x1873929633489664 ext(60616704->60620799) 00002000:00010000:1.0:1787119496.679431:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bea00 00000100:00100000:1.0:1787119496.679483:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10382 00000100:00100000:1.0:1787119496.679490:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633489536:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.679587:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633489536:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 97us (816us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.679594:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10382 00002000:00100000:1.0:1787119496.679600:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (64561152->64565247) req@ffff92a6068bdf80 x1873929633489536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.679608:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bdf80 with x1873929633489536 ext(64561152->64565247) 00002000:00010000:1.0:1787119496.679611:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bdf80 00000100:00100000:1.0:1787119496.679624:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10383 00000100:00100000:1.0:1787119496.679717:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2374:x1873929633489792:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119496.680022:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 63981300 -> 3317751 00002000:00010000:1.0:1787119496.680026:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:1.0:1787119496.680029:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119496.680031:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:1.0:1787119496.680033:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:1.0:1787119496.680068:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2374:x1873929633489792:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 437us (1270us total) trans 4294969186 rc 0/0 00000100:00100000:1.0:1787119496.680075:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10383 00002000:00010000:1.0:1787119496.680078:0:18555:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (3317751->18446744073709551615) 00002000:00100000:1.0:1787119496.680081:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd880 with x1873929633489792 ext(3317751->18446744073709551615) 00002000:00010000:1.0:1787119496.680085:0:18555:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bd880. 00000100:00100000:0.0:1787119496.684357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.684462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.684687:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633489920 00000100:00100000:1.0:1787119496.684698:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633489920 00002000:00100000:1.0:1787119496.684743:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (43794432->43859967) req@ffff92a6068bf800 x1873929633489920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.684755:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf800 with x1873929633489920 ext(43794432->43859967) 00002000:00010000:1.0:1787119496.684761:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bf800 00000100:00100000:1.0:1787119496.684783:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10384 00000100:00100000:1.0:1787119496.684793:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633489920:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.685014:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633490048 00000100:00100000:1.0:1787119496.685018:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633490048 00000100:00100000:1.0:1787119496.685049:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19712 00000100:00100000:1.0:1787119496.685056:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+195:32729:x1873929633490048:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119496.685070:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119496.685090:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e33f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715de6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.685167:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e33fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.685181:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e33fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.685193:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e33fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119496.685217:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 3317751 00000004:00200000:1.0:1787119496.685222:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119496.685239:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e33fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.685263:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e33f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715de6 expref: 197 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.685279:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e33fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715de6 expref: 196 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.685289:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119496.685291:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119496.685294:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431800, rc 0) 00000100:00100000:1.0:1787119496.685603:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+196:32729:x1873929633490048:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 545us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.685610:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19712 00000100:00100000:0.0:1787119496.690552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.690597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.690758:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633490176 00000100:00100000:3.0:1787119496.690770:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633490176 00002000:00100000:3.0:1787119496.690821:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (64565248->64569343) req@ffff92a6068bc380 x1873929633490176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.690833:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc380 with x1873929633490176 ext(64565248->64569343) 00002000:00010000:3.0:1787119496.690839:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bc380 00000100:00100000:3.0:1787119496.690896:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633490304 00000100:00100000:3.0:1787119496.690900:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633490304 00002000:00100000:3.0:1787119496.690916:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (60592128->60657663) req@ffff92a6068bf100 x1873929633490304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.690924:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf100 with x1873929633490304 ext(60592128->60657663) 00002000:00010000:3.0:1787119496.690928:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bf100 00000100:00100000:3.0:1787119496.690949:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10385 00000100:00100000:3.0:1787119496.690958:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633490176:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.691198:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633490176:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 240us (657us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.691207:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10385 00002000:00100000:3.0:1787119496.691216:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (64565248->64569343) req@ffff92a6068bc380 x1873929633490176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.691225:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc380 with x1873929633490176 ext(64565248->64569343) 00002000:00010000:3.0:1787119496.691229:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bc380 00000100:00100000:3.0:1787119496.691249:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10386 00000100:00100000:3.0:1787119496.691257:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633490304:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.697418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.698287:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633490304:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7024us (7682us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119496.698313:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10386 00002000:00100000:2.0:1787119496.698331:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (60592128->60657663) req@ffff92a6068bf100 x1873929633490304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.698342:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf100 with x1873929633490304 ext(60592128->60657663) 00002000:00010000:2.0:1787119496.698349:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bf100 00000100:00100000:2.0:1787119496.698380:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633490432 00000100:00100000:2.0:1787119496.698390:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633490432 00002000:00100000:2.0:1787119496.698425:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (64540672->64602111) req@ffff92a6068bc000 x1873929633490432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.698435:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633490432 ext(64540672->64602111) 00002000:00010000:2.0:1787119496.698464:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bc000 00000100:00100000:2.0:1787119496.698483:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10387 00000100:00100000:2.0:1787119496.698491:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2373:x1873929633490432:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.699532:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633489920:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14734us (15177us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119496.699542:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10384 00002000:00100000:1.0:1787119496.699551:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (43794432->43859967) req@ffff92a6068bf800 x1873929633489920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.699561:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf800 with x1873929633489920 ext(43794432->43859967) 00002000:00010000:1.0:1787119496.699567:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bf800 00000100:00100000:1.0:1787119496.699628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.699838:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633490688 00000100:00100000:3.0:1787119496.699953:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633490688 00000100:00100000:3.0:1787119496.700169:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19713 00000100:00100000:3.0:1787119496.700180:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+196:32729:x1873929633490688:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119496.700229:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119496.700259:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431800/0xcaba3de8463e33fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715de6 expref: 196 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.700327:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119496.700333:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119496.700560:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.700573:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.700582:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119496.700631:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976528 00000004:00010000:3.0:1787119496.700657:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ceca1eea reply state 00000000497ab01f transno 4294976529 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.700666:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119496.700740:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+198:32729:x1873929633490688:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 562us (1111us total) trans 4294976529 rc 0/0 00000100:00100000:3.0:1787119496.700748:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19713 00000020:00080000:3.0:1787119496.700751:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119496.706343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.706382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.706562:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633490816 00000100:00100000:1.0:1787119496.706572:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633490816 00002000:00100000:1.0:1787119496.706621:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (43814912->43839487) req@ffff92a6068bc700 x1873929633490816/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.706633:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc700 with x1873929633490816 ext(43814912->43839487) 00002000:00010000:1.0:1787119496.706640:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc700 00000100:00100000:1.0:1787119496.706663:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633490944 00000100:00100000:1.0:1787119496.706666:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633490944 00002000:00100000:1.0:1787119496.706680:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x22:0x0] (29409280->60633087) req@ffff92a6068bfb80 x1873929633490944/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.706687:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bfb80 with x1873929633490944 ext(29409280->60633087) 00002000:00010000:1.0:1787119496.706691:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bfb80 00000100:00100000:1.0:1787119496.706709:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10388 00000100:00100000:1.0:1787119496.706718:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633490816:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119496.706845:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10389 00000100:00100000:1.0:1787119496.706853:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633490944:12345-192.168.201.59@tcp:4:fsx.0 00010000:00010000:2.0:1787119496.707145:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.707156:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.707164:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.707172:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119496.707177:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.707185:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.707202:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119496.707205:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119496.707209:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.707215:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3405 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.707409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.707897:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633491072 00000100:00100000:1.0:1787119496.707904:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633491072 00002000:00010000:1.0:1787119496.707926:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (13267460->18446744073709551615) 00002000:00100000:1.0:1787119496.707931:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d500 with x1873929633491072 ext(13267460->18446744073709551615) 00002000:00010000:1.0:1787119496.707942:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282d500. 00000100:00100000:1.0:1787119496.707970:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10390 00000100:00100000:1.0:1787119496.707978:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633491072:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119496.708177:0:19246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 3317751 -> 13267460 00002000:00010000:1.0:1787119496.708180:0:19246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:1.0:1787119496.708183:0:19246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119496.708185:0:19246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:1.0:1787119496.708187:0:19246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:1.0:1787119496.708623:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2376:x1873929633491072:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 643us (1212us total) trans 4294969187 rc 0/0 00000100:00100000:1.0:1787119496.708631:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10390 00002000:00010000:1.0:1787119496.708635:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (13267460->18446744073709551615) 00002000:00100000:1.0:1787119496.708638:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d500 with x1873929633491072 ext(13267460->18446744073709551615) 00002000:00010000:1.0:1787119496.708644:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282d500. 00000001:00080000:1.0:1787119496.709385:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969182 is committed 00000001:00080000:1.0:1787119496.709403:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969184 is committed 00000100:00100000:1.0:1787119496.709992:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633488768:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 51491us (52027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.710003:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5081 00000100:00100000:2.0:1787119496.714429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.714552:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633491200 00000100:00100000:0.0:1787119496.714563:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633491200 00000100:00100000:1.0:1787119496.715211:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633490816:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 8489us (8875us total) trans 4294968913 rc 0/0 00000100:00100000:1.0:1787119496.715223:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10388 00002000:00100000:1.0:1787119496.715235:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (43814912->43839487) req@ffff92a6068bc700 x1873929633490816/t4294968913(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.715245:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc700 with x1873929633490816 ext(43814912->43839487) 00002000:00010000:1.0:1787119496.715251:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc700 00000100:00100000:0.0:1787119496.715487:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19714 00000100:00100000:0.0:1787119496.715499:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+197:32728:x1873929633491200:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119496.715519:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119496.715542:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e340c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ded expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.715621:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e3413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.715636:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e3413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.715647:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e3413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119496.715670:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 64600736 00000004:00200000:0.0:1787119496.715674:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119496.715691:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e3413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.715716:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e340c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ded expref: 199 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.715735:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e3413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ded expref: 198 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.715744:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119496.715747:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119496.715750:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa800, rc 0) 00000100:00100000:0.0:1787119496.715775:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+198:32728:x1873929633491200:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 280us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.715782:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19714 00000100:00100000:3.0:1787119496.716336:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633490432:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17841us (18924us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1787119496.716345:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10387 00002000:00100000:3.0:1787119496.716353:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (64540672->64602111) req@ffff92a6068bc000 x1873929633490432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.716362:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633490432 ext(64540672->64602111) 00002000:00010000:3.0:1787119496.716367:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bc000 00000100:00100000:1.0:1787119496.716583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.717148:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633491328 00000100:00100000:2.0:1787119496.717156:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633491328 00000100:00100000:3.0:1787119496.717298:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19715 00000100:00100000:3.0:1787119496.717414:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+198:32729:x1873929633491328:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119496.717430:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119496.717473:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e341a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715df4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.717540:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3421 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.717552:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.717562:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119496.717583:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 13267460 00000004:00200000:3.0:1787119496.717587:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119496.717602:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.717624:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e341a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715df4 expref: 200 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.717640:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715df4 expref: 199 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.717648:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119496.717652:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119496.717655:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0800, rc 0) 00000100:00100000:3.0:1787119496.717702:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+199:32729:x1873929633491328:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 292us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.717709:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19715 00000100:00100000:1.0:1787119496.722053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.722618:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633491456 00000100:00100000:3.0:1787119496.722640:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633491456 00000100:00100000:3.0:1787119496.722709:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5082 00000100:00100000:3.0:1787119496.722719:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633491456:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119496.729773:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633490944:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 22907us (23376us total) trans 4294968914 rc 0/0 00000100:00100000:1.0:1787119496.729791:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10389 00002000:00100000:1.0:1787119496.729806:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (29409280->60633087) req@ffff92a6068bfb80 x1873929633490944/t4294968914(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.729817:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bfb80 with x1873929633490944 ext(29409280->60633087) 00002000:00010000:1.0:1787119496.729824:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bfb80 00000100:00100000:2.0:1787119496.732153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.732191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.732263:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633491584 00000100:00100000:1.0:1787119496.732273:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633491584 00002000:00100000:1.0:1787119496.732384:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (64561152->64600735) req@ffff92a51282f100 x1873929633491584/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.732396:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f100 with x1873929633491584 ext(64561152->64600735) 00002000:00010000:1.0:1787119496.732401:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282f100 00000100:00100000:1.0:1787119496.732431:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633491712 00000100:00100000:1.0:1787119496.732435:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633491712 00002000:00100000:1.0:1787119496.732480:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (4575232->4579327) req@ffff92a51282e680 x1873929633491712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.732490:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e680 with x1873929633491712 ext(4575232->4579327) 00002000:00010000:1.0:1787119496.732493:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282e680 00000100:00100000:1.0:1787119496.732512:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10391 00000100:00100000:1.0:1787119496.732520:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633491584:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119496.732710:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10392 00000100:00100000:1.0:1787119496.732719:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633491712:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.732923:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633491712:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 204us (730us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.732931:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10392 00002000:00100000:1.0:1787119496.732938:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (4575232->4579327) req@ffff92a51282e680 x1873929633491712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.732946:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e680 with x1873929633491712 ext(4575232->4579327) 00002000:00010000:1.0:1787119496.732949:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282e680 00000100:00100000:3.0:1787119496.737792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.738003:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633491840 00000100:00100000:0.0:1787119496.738018:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633491840 00002000:00100000:0.0:1787119496.738085:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (4579328->4583423) req@ffff92a519d19880 x1873929633491840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.738098:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19880 with x1873929633491840 ext(4579328->4583423) 00002000:00010000:0.0:1787119496.738104:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19880 00000100:00100000:0.0:1787119496.738151:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10393 00000100:00100000:0.0:1787119496.738163:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633491840:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.738429:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633491840:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 268us (650us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.738471:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10393 00002000:00100000:0.0:1787119496.738480:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (4579328->4583423) req@ffff92a519d19880 x1873929633491840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.738487:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19880 with x1873929633491840 ext(4579328->4583423) 00002000:00010000:0.0:1787119496.738490:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19880 00000100:00100000:1.0:1787119496.744637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.748778:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633491968 00000100:00100000:3.0:1787119496.748796:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633491968 00000100:00100000:3.0:1787119496.748864:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5083 00000100:00100000:3.0:1787119496.748875:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633491968:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119496.754684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.754727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.754760:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633492352 00000100:00100000:1.0:1787119496.754771:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633492352 00000100:00100000:3.0:1787119496.755320:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633492224 00000100:00100000:3.0:1787119496.755327:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633492224 00000100:00100000:3.0:1787119496.755385:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19716 00000100:00100000:3.0:1787119496.755395:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+199:32729:x1873929633492224:12345-192.168.201.59@tcp:36:fsx.0 00002000:00100000:1.0:1787119496.755475:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (4554752->4620287) req@ffff92a511f57b80 x1873929633492352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787119496.755484:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1787119496.755486:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57b80 with x1873929633492352 ext(4554752->4620287) 00002000:00010000:1.0:1787119496.755491:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57b80 00000100:00100000:1.0:1787119496.755508:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10394 00010000:00010000:3.0:1787119496.755515:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3421 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715df4 expref: 199 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.755515:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633492352:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119496.755534:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119496.755540:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119496.755776:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.755791:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119496.755801:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119496.755947:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976530 00000004:00010000:3.0:1787119496.755975:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa234481 reply state 00000000e209a3ce transno 4294976531 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119496.755985:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119496.756067:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+201:32729:x1873929633492224:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 672us (1392us total) trans 4294976531 rc 0/0 00000100:00100000:3.0:1787119496.756076:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19716 00000020:00080000:3.0:1787119496.756082:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119496.757162:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633491584:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 24635us (25016us total) trans 4294969188 rc 0/0 00000100:00100000:1.0:1787119496.757172:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10391 00002000:00100000:1.0:1787119496.757183:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (64561152->64600735) req@ffff92a51282f100 x1873929633491584/t4294969188(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.757192:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f100 with x1873929633491584 ext(64561152->64600735) 00002000:00010000:1.0:1787119496.757198:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282f100 00010000:00010000:1.0:1787119496.760578:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.760609:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.760616:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.760623:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119496.760628:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.760636:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.760653:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119496.760657:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119496.760661:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.760668:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e3428 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.760837:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633492352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5314us (6100us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119496.760860:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10394 00002000:00100000:1.0:1787119496.760875:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (4554752->4620287) req@ffff92a511f57b80 x1873929633492352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.760885:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57b80 with x1873929633492352 ext(4554752->4620287) 00002000:00010000:1.0:1787119496.760891:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57b80 00000100:00100000:2.0:1787119496.762679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000001:00080000:1.0:1787119496.763142:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968913 is committed 00000100:00100000:3.0:1787119496.765930:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633491456:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 43200us (43875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119496.765945:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5082 00000100:00100000:3.0:1787119496.765973:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633492608 00000100:00100000:3.0:1787119496.765980:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633492608 00000100:00100000:1.0:1787119496.766009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.766064:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5084 00000100:00100000:0.0:1787119496.766089:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633492608:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119496.766135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.766157:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633492480 00000100:00100000:1.0:1787119496.766161:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633492480 00002000:00010000:1.0:1787119496.766179:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (7104934->18446744073709551615) 00002000:00100000:1.0:1787119496.766183:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57100 with x1873929633492480 ext(7104934->18446744073709551615) 00002000:00010000:1.0:1787119496.766194:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57100. 00000100:00100000:1.0:1787119496.766218:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633492736 00000100:00100000:1.0:1787119496.766222:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633492736 00002000:00100000:1.0:1787119496.766242:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (4575232->4587519) req@ffff92a511f55880 x1873929633492736/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 12776/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.766253:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55880 with x1873929633492736 ext(4575232->4587519) 00002000:00010000:1.0:1787119496.766257:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55880 00000100:00100000:1.0:1787119496.766274:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10395 00000100:00100000:1.0:1787119496.766281:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633492480:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:0.0:1787119496.766333:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10396 00000100:00100000:0.0:1787119496.766341:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633492736:12345-192.168.201.59@tcp:4:fsx.0 00002000:00010000:1.0:1787119496.766657:0:20838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 13267460 -> 7104934 00002000:00010000:1.0:1787119496.766661:0:20838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:1.0:1787119496.766664:0:20838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:1.0:1787119496.766666:0:20838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:1.0:1787119496.766668:0:20838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 2959 -> 2959 00000100:00100000:1.0:1787119496.766703:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633492480:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 421us (694us total) trans 4294969189 rc 0/0 00000100:00100000:1.0:1787119496.766710:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10395 00002000:00010000:1.0:1787119496.766713:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (7104934->18446744073709551615) 00002000:00100000:1.0:1787119496.766716:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57100 with x1873929633492480 ext(7104934->18446744073709551615) 00002000:00010000:1.0:1787119496.766720:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57100. 00000100:00100000:3.0:1787119496.771857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.772016:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633492864 00000100:00100000:1.0:1787119496.772026:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633492864 00002000:00100000:1.0:1787119496.772071:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (6209536->6213631) req@ffff92a519d1b800 x1873929633492864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.772083:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b800 with x1873929633492864 ext(6209536->6213631) 00002000:00010000:1.0:1787119496.772089:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1b800 00000100:00100000:1.0:1787119496.772129:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10397 00000100:00100000:1.0:1787119496.772140:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633492864:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.772458:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633492864:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 300us (593us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.772467:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10397 00002000:00100000:1.0:1787119496.772474:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (6209536->6213631) req@ffff92a519d1b800 x1873929633492864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.772481:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b800 with x1873929633492864 ext(6209536->6213631) 00002000:00010000:1.0:1787119496.772485:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1b800 00000100:00100000:0.0:1787119496.780282:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633492736:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 13929us (14134us total) trans 4294969190 rc 0/0 00000100:00100000:0.0:1787119496.780298:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10396 00002000:00100000:0.0:1787119496.780313:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (4575232->4587519) req@ffff92a511f55880 x1873929633492736/t4294969190(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 12776/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.780328:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55880 with x1873929633492736 ext(4575232->4587519) 00002000:00010000:0.0:1787119496.780335:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55880 00000100:00100000:1.0:1787119496.780733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.782132:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633492992 00000100:00100000:0.0:1787119496.782145:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633492992 00000100:00100000:0.0:1787119496.782194:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19717 00000100:00100000:0.0:1787119496.782204:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+200:32729:x1873929633492992:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119496.782228:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119496.782247:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e342f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715dfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.782329:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e3436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.782354:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e3436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.782364:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e3436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119496.782389:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 7104934 00000004:00200000:0.0:1787119496.782393:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119496.782411:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e3436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.782436:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e342f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dfb expref: 202 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.783222:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e3436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dfb expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.783231:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:0.0:1787119496.783234:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119496.783238:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb600, rc 0) 00000100:00100000:0.0:1787119496.783713:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+201:32729:x1873929633492992:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1507us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.783722:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19717 00000100:00100000:1.0:1787119496.785110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.785227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.785530:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633493120 00000100:00100000:0.0:1787119496.785539:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633493120 00000100:00100000:2.0:1787119496.785558:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633493248 00000100:00100000:2.0:1787119496.785562:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633493248 00002000:00100000:0.0:1787119496.785583:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (393216->413695) req@ffff92a511f54000 x1873929633493120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787119496.785593:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5085 00002000:00100000:0.0:1787119496.785594:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633493120 ext(393216->413695) 00002000:00010000:0.0:1787119496.785600:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54000 00000100:00100000:2.0:1787119496.785601:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e92a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633493248:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119496.785662:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10398 00000100:00100000:0.0:1787119496.785669:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633493120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.785702:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e92a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633493248:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 100us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119496.785709:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5085 00000100:00100000:0.0:1787119496.794739:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633493120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 9059us (9623us total) trans 0 rc 20480/20480 00000100:00100000:0.0:1787119496.794752:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10398 00002000:00100000:0.0:1787119496.794765:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (393216->413695) req@ffff92a511f54000 x1873929633493120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.794775:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633493120 ext(393216->413695) 00002000:00010000:0.0:1787119496.794781:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54000 00000100:00100000:3.0:1787119496.797160:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.797271:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633493376 00000100:00100000:2.0:1787119496.797281:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633493376 00002000:00100000:2.0:1787119496.797329:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (10141696->10145791) req@ffff92a519d1b480 x1873929633493376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.797340:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b480 with x1873929633493376 ext(10141696->10145791) 00002000:00010000:2.0:1787119496.797354:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b480 00000100:00100000:2.0:1787119496.797385:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10399 00000100:00100000:2.0:1787119496.797394:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633493376:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.799831:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633493376:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2423us (2666us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.799846:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10399 00002000:00100000:2.0:1787119496.799857:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (10141696->10145791) req@ffff92a519d1b480 x1873929633493376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.799874:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b480 with x1873929633493376 ext(10141696->10145791) 00002000:00010000:2.0:1787119496.799879:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b480 00000100:00100000:3.0:1787119496.800250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.800973:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633493504 00000100:00100000:2.0:1787119496.800984:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633493504 00002000:00100000:2.0:1787119496.801035:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (29409280->29413375) req@ffff92a519d18a80 x1873929633493504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.801046:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18a80 with x1873929633493504 ext(29409280->29413375) 00002000:00010000:2.0:1787119496.801051:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18a80 00000100:00100000:2.0:1787119496.801083:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10400 00000100:00100000:2.0:1787119496.801094:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633493504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.801540:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633493504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 445us (1287us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.801549:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10400 00002000:00100000:2.0:1787119496.801558:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (29409280->29413375) req@ffff92a519d18a80 x1873929633493504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.801568:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18a80 with x1873929633493504 ext(29409280->29413375) 00002000:00010000:2.0:1787119496.801572:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18a80 00000100:00100000:3.0:1787119496.817546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.819795:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633493632 00000100:00100000:1.0:1787119496.819821:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633493632 00002000:00100000:1.0:1787119496.819873:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (29433856->29437951) req@ffff92a519d18000 x1873929633493632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.819885:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18000 with x1873929633493632 ext(29433856->29437951) 00002000:00010000:1.0:1787119496.819891:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18000 00000100:00100000:1.0:1787119496.819919:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10401 00000100:00100000:1.0:1787119496.819929:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633493632:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.820158:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633493632:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 230us (2623us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.820166:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10401 00002000:00100000:1.0:1787119496.820173:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (29433856->29437951) req@ffff92a519d18000 x1873929633493632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.820182:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18000 with x1873929633493632 ext(29433856->29437951) 00002000:00010000:1.0:1787119496.820185:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18000 00000100:00100000:0.0:1787119496.826059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.829332:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633493760 00000100:00100000:1.0:1787119496.829357:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633493760 00002000:00100000:1.0:1787119496.829410:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (10145792->10149887) req@ffff92a6068bed80 x1873929633493760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.829422:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bed80 with x1873929633493760 ext(10145792->10149887) 00002000:00010000:1.0:1787119496.829428:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bed80 00000100:00100000:1.0:1787119496.829479:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10402 00000100:00100000:1.0:1787119496.829490:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633493760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.829716:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633493760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 227us (3668us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.829723:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10402 00002000:00100000:1.0:1787119496.829730:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (10145792->10149887) req@ffff92a6068bed80 x1873929633493760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.829744:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bed80 with x1873929633493760 ext(10145792->10149887) 00002000:00010000:1.0:1787119496.829747:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bed80 00000100:00100000:0.0:1787119496.834225:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633492608:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 68137us (71543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.834241:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5084 00000001:00080000:1.0:1787119496.834556:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969190 is committed 00000001:00080000:1.0:1787119496.835852:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968914 is committed 00000100:00100000:0.0:1787119496.836637:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633491968:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 87757us (92004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.836649:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5083 00000100:00100000:0.0:1787119496.842790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.843008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.844733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.845073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.845096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.845139:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633494272 00000100:00100000:2.0:1787119496.845148:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633494272 00000100:00100000:2.0:1787119496.845196:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633494400 00000100:00100000:2.0:1787119496.845199:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633494400 00000100:00100000:2.0:1787119496.845220:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19718 00000100:00100000:2.0:1787119496.845229:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+202:32729:x1873929633494272:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119496.845283:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119496.845311:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e3436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dfb expref: 202 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.845331:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119496.845336:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119496.845585:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.845598:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.845607:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119496.845658:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976532 00000004:00010000:2.0:1787119496.845681:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001faccfc9 reply state 000000007f883781 transno 4294976533 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119496.845706:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119496.845785:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+204:32729:x1873929633494272:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 557us (1061us total) trans 4294976533 rc 0/0 00000100:00100000:2.0:1787119496.845792:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19718 00000020:00080000:2.0:1787119496.845797:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787119496.845815:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19719 00000100:00100000:2.0:1787119496.845822:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+203:32727:x1873929633494400:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119496.845831:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119496.845856:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3444 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e02 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.845912:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e344b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.845920:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e344b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.845927:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e344b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119496.845942:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 64600736 00000004:00200000:2.0:1787119496.845946:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119496.845958:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e344b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.846271:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3444 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e02 expref: 205 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.846289:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e344b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e02 expref: 204 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.846297:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:2.0:1787119496.846299:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119496.846302:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93800, rc 0) 00000100:00100000:2.0:1787119496.846327:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+204:32727:x1873929633494400:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 505us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119496.846333:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19719 00000100:00100000:1.0:1787119496.846499:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633493888 00000100:00100000:1.0:1787119496.846506:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633493888 00002000:00100000:1.0:1787119496.846539:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (21741568->21745663) req@ffff92a6068be680 x1873929633493888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.846550:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be680 with x1873929633493888 ext(21741568->21745663) 00002000:00010000:1.0:1787119496.846554:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068be680 00000100:00100000:1.0:1787119496.846577:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633494016 00000100:00100000:1.0:1787119496.846580:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633494016 00002000:00100000:1.0:1787119496.846595:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (62857216->62881791) req@ffff92a6068be300 x1873929633494016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.846603:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be300 with x1873929633494016 ext(62857216->62881791) 00002000:00010000:1.0:1787119496.846606:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068be300 00000100:00100000:1.0:1787119496.846624:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10403 00000100:00100000:1.0:1787119496.846631:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633493888:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.846990:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10404 00000100:00100000:2.0:1787119496.846999:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633494016:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.847219:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633493888:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 587us (4441us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.847227:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10403 00002000:00100000:1.0:1787119496.847233:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x23:0x0] (21741568->21745663) req@ffff92a6068be680 x1873929633493888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.847248:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be680 with x1873929633493888 ext(21741568->21745663) 00002000:00010000:1.0:1787119496.847251:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068be680 00000100:00100000:1.0:1787119496.847740:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633494528 00000100:00100000:1.0:1787119496.847746:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633494528 00002000:00100000:1.0:1787119496.847770:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (10121216->10186751) req@ffff92a6068bf480 x1873929633494528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.847779:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633494528 ext(10121216->10186751) 00002000:00010000:1.0:1787119496.847783:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf480 00000100:00100000:1.0:1787119496.848022:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10405 00000100:00100000:1.0:1787119496.848031:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633494528:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:2.0:1787119496.851212:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.851230:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.851238:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.851244:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119496.851249:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.851257:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.851274:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119496.851277:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119496.851281:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.851288:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e343d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.851655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.851773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.852564:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633494016:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5563us (9553us total) trans 0 rc 24576/24576 00000100:00100000:1.0:1787119496.852576:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10404 00002000:00100000:1.0:1787119496.852588:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x22:0x0] (62857216->62881791) req@ffff92a6068be300 x1873929633494016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.852599:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be300 with x1873929633494016 ext(62857216->62881791) 00002000:00010000:1.0:1787119496.852604:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068be300 00000100:00100000:2.0:1787119496.853058:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633494656 00000100:00100000:2.0:1787119496.853068:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633494656 00002000:00010000:2.0:1787119496.853100:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (64600736->18446744073709551615) 00002000:00100000:2.0:1787119496.853104:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154000 with x1873929633494656 ext(64600736->18446744073709551615) 00002000:00010000:2.0:1787119496.853116:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606154000. 00000100:00100000:2.0:1787119496.853134:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633494784 00000100:00100000:2.0:1787119496.853138:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633494784 00002000:00100000:2.0:1787119496.853154:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (4575232->4579327) req@ffff92a606154700 x1873929633494784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.853164:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154700 with x1873929633494784 ext(4575232->4579327) 00002000:00010000:2.0:1787119496.853167:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606154700 00000100:00100000:2.0:1787119496.853184:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10406 00000100:00100000:2.0:1787119496.853191:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633494656:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:0.0:1787119496.853427:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10407 00000100:00100000:0.0:1787119496.853459:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633494784:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.853617:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633494784:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 181us (1844us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.853624:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10407 00002000:00100000:0.0:1787119496.853630:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (4575232->4579327) req@ffff92a606154700 x1873929633494784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.853638:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154700 with x1873929633494784 ext(4575232->4579327) 00002000:00010000:0.0:1787119496.853642:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606154700 00002000:00010000:2.0:1787119496.854280:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 7104934 -> 64600736 00002000:00010000:2.0:1787119496.854285:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:2.0:1787119496.854287:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119492 00002000:00010000:2.0:1787119496.854290:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:2.0:1787119496.854292:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 2959 -> 909 00000100:00100000:2.0:1787119496.854364:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633494656:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1172us (2713us total) trans 4294969191 rc 0/0 00000100:00100000:2.0:1787119496.854370:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10406 00002000:00010000:2.0:1787119496.854374:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (64600736->18446744073709551615) 00002000:00100000:2.0:1787119496.854385:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154000 with x1873929633494656 ext(64600736->18446744073709551615) 00002000:00010000:2.0:1787119496.854390:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606154000. 00000100:00100000:3.0:1787119496.854555:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633494528:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6524us (9457us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119496.854562:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10405 00002000:00100000:3.0:1787119496.854568:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (10121216->10186751) req@ffff92a6068bf480 x1873929633494528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.854577:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633494528 ext(10121216->10186751) 00002000:00010000:3.0:1787119496.854581:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf480 00000100:00100000:0.0:1787119496.858973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.859218:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633494912 00000100:00100000:2.0:1787119496.859227:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633494912 00002000:00100000:2.0:1787119496.859274:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (21745664->21749759) req@ffff92a606155180 x1873929633494912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.859286:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155180 with x1873929633494912 ext(21745664->21749759) 00002000:00010000:2.0:1787119496.859291:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155180 00000100:00100000:2.0:1787119496.859999:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10408 00000100:00100000:2.0:1787119496.860011:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633494912:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.860257:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633494912:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 248us (1295us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.860265:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10408 00002000:00100000:2.0:1787119496.860272:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (21745664->21749759) req@ffff92a606155180 x1873929633494912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.860282:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155180 with x1873929633494912 ext(21745664->21749759) 00002000:00010000:2.0:1787119496.860286:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155180 00000100:00100000:0.0:1787119496.861667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.861698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.861720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.861745:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633495168 00000100:00100000:0.0:1787119496.861754:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633495168 00000100:00100000:0.0:1787119496.861794:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19720 00000100:00100000:0.0:1787119496.861814:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+203:32724:x1873929633495168:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119496.862036:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119496.862065:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e32ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715d84 expref: 203 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.862083:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119496.862088:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119496.862282:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.862310:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.862320:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119496.862391:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976534 00000004:00010000:0.0:1787119496.862415:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038130092 reply state 000000003d147b39 transno 4294976535 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119496.862424:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119496.862529:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633495296 00000100:00100000:3.0:1787119496.862535:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633495296 00002000:00100000:3.0:1787119496.862565:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (64561152->64565247) req@ffff92a606156a00 x1873929633495296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.862575:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156a00 with x1873929633495296 ext(64561152->64565247) 00002000:00010000:3.0:1787119496.862579:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156a00 00000100:00100000:3.0:1787119496.862596:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633495424 00000100:00100000:3.0:1787119496.862599:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633495424 00002000:00100000:3.0:1787119496.862613:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (17801216->17817599) req@ffff92a606156300 x1873929633495424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.862620:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156300 with x1873929633495424 ext(17801216->17817599) 00002000:00010000:3.0:1787119496.862623:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156300 00000100:00100000:3.0:1787119496.862639:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10409 00000100:00100000:3.0:1787119496.862646:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633495296:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.862888:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633495296:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 240us (1188us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.862894:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10409 00002000:00100000:3.0:1787119496.862901:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (64561152->64565247) req@ffff92a606156a00 x1873929633495296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.862908:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156a00 with x1873929633495296 ext(64561152->64565247) 00002000:00010000:3.0:1787119496.862911:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156a00 00000100:00100000:3.0:1787119496.862925:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10410 00000100:00100000:3.0:1787119496.862931:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633495424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.863032:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633495424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 100us (1310us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119496.863039:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10410 00002000:00100000:3.0:1787119496.863044:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (17801216->17817599) req@ffff92a606156300 x1873929633495424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/16824 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.863052:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156300 with x1873929633495424 ext(17801216->17817599) 00002000:00010000:3.0:1787119496.863055:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156300 00000100:00100000:0.0:1787119496.863410:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+205:32724:x1873929633495168:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1606us (1750us total) trans 4294976535 rc 0/0 00000100:00100000:0.0:1787119496.863417:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19720 00000020:00080000:0.0:1787119496.863421:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119496.867685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.867833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119496.867893:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.867905:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.867913:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.867920:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fb800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119496.867924:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.867932:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.867947:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119496.867951:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119496.867955:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.867960:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb800/0xcaba3de8463e3452 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.868665:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633495552 00000100:00100000:1.0:1787119496.868678:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633495552 00002000:00100000:0.0:1787119496.868785:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (4579328->4583423) req@ffff92a606154e00 x1873929633495552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.868795:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154e00 with x1873929633495552 ext(4579328->4583423) 00002000:00010000:0.0:1787119496.868801:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606154e00 00000100:00100000:0.0:1787119496.868846:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633495680 00000100:00100000:0.0:1787119496.868850:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633495680 00002000:00100000:0.0:1787119496.868864:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (43814912->43819007) req@ffff92a606157800 x1873929633495680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.868871:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157800 with x1873929633495680 ext(43814912->43819007) 00002000:00010000:0.0:1787119496.868875:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157800 00000100:00100000:0.0:1787119496.868891:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10411 00000100:00100000:0.0:1787119496.868899:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633495552:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.869163:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633495552:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 264us (1486us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.869170:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10411 00002000:00100000:0.0:1787119496.869175:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (4579328->4583423) req@ffff92a606154e00 x1873929633495552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.869183:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154e00 with x1873929633495552 ext(4579328->4583423) 00002000:00010000:0.0:1787119496.869186:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606154e00 00000100:00100000:0.0:1787119496.869201:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10412 00000100:00100000:0.0:1787119496.869207:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633495680:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.869288:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633495680:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 80us (1453us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.869313:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10412 00002000:00100000:0.0:1787119496.869319:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (43814912->43819007) req@ffff92a606157800 x1873929633495680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.869326:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157800 with x1873929633495680 ext(43814912->43819007) 00002000:00010000:0.0:1787119496.869329:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157800 00000100:00100000:3.0:1787119496.871976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.872021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.872146:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633495808 00000100:00100000:2.0:1787119496.872156:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633495808 00002000:00010000:2.0:1787119496.872189:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (54126883->18446744073709551615) 00002000:00100000:2.0:1787119496.872193:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b100 with x1873929633495808 ext(54126883->18446744073709551615) 00002000:00010000:2.0:1787119496.872204:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1b100. 00000100:00100000:2.0:1787119496.872230:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633495936 00000100:00100000:2.0:1787119496.872234:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633495936 00002000:00100000:2.0:1787119496.872253:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (21721088->21786623) req@ffff92a519d18380 x1873929633495936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.872264:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633495936 ext(21721088->21786623) 00002000:00010000:2.0:1787119496.872268:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18380 00000100:00100000:2.0:1787119496.872478:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10413 00000100:00100000:2.0:1787119496.872489:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633495808:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:3.0:1787119496.872941:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10414 00000100:00100000:3.0:1787119496.872951:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633495936:12345-192.168.201.59@tcp:3:fsx.0 00002000:00010000:2.0:1787119496.873366:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 64600736 -> 54126883 00002000:00010000:2.0:1787119496.873370:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119494 -> 1787119495 00002000:00010000:2.0:1787119496.873372:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119491 -> 1787119495 00002000:00010000:2.0:1787119496.873374:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119494 -> 1787119495 00002000:00010000:2.0:1787119496.873377:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 909 -> 1807 00000100:00100000:2.0:1787119496.873419:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633495808:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 932us (1453us total) trans 4294968915 rc 0/0 00000100:00100000:2.0:1787119496.873427:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10413 00002000:00010000:2.0:1787119496.873431:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (54126883->18446744073709551615) 00002000:00100000:2.0:1787119496.873433:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b100 with x1873929633495808 ext(54126883->18446744073709551615) 00002000:00010000:2.0:1787119496.873466:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d1b100. 00000100:00100000:3.0:1787119496.877997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.878066:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633496064 00000100:00100000:1.0:1787119496.878078:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633496064 00002000:00100000:1.0:1787119496.878134:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (64565248->64569343) req@ffff92a519d1a300 x1873929633496064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.878146:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a300 with x1873929633496064 ext(64565248->64569343) 00002000:00010000:1.0:1787119496.878153:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1a300 00000100:00100000:1.0:1787119496.878190:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10415 00000100:00100000:1.0:1787119496.878200:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633496064:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.878605:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633496064:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 404us (1804us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.878881:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10415 00002000:00100000:1.0:1787119496.878891:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (64565248->64569343) req@ffff92a519d1a300 x1873929633496064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.878899:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a300 with x1873929633496064 ext(64565248->64569343) 00002000:00010000:1.0:1787119496.878903:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1a300 00000100:00100000:3.0:1787119496.879425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.879480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.879506:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633496192 00000100:00100000:3.0:1787119496.879512:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633496192 00002000:00100000:3.0:1787119496.879540:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (43819008->43823103) req@ffff92a519d1aa00 x1873929633496192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.879549:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1aa00 with x1873929633496192 ext(43819008->43823103) 00002000:00010000:3.0:1787119496.879553:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1aa00 00000100:00100000:3.0:1787119496.879574:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633496320 00000100:00100000:3.0:1787119496.879577:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633496320 00002000:00100000:3.0:1787119496.879591:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (4554752->4620287) req@ffff92a519d19500 x1873929633496320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.879599:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19500 with x1873929633496320 ext(4554752->4620287) 00002000:00010000:3.0:1787119496.879602:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19500 00000100:00100000:3.0:1787119496.879617:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10416 00000100:00100000:3.0:1787119496.879625:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633496192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.879738:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10417 00000100:00100000:0.0:1787119496.879751:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633496320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.879794:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633496192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 169us (370us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119496.879802:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10416 00002000:00100000:3.0:1787119496.881035:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (43819008->43823103) req@ffff92a519d1aa00 x1873929633496192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.881048:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1aa00 with x1873929633496192 ext(43819008->43823103) 00002000:00010000:3.0:1787119496.881053:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1aa00 00000100:00100000:3.0:1787119496.881118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.881201:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633496448 00000100:00100000:1.0:1787119496.881203:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633495936:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8252us (9179us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119496.881208:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633496448 00000100:00100000:1.0:1787119496.881215:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10414 00002000:00100000:1.0:1787119496.881223:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (21721088->21786623) req@ffff92a519d18380 x1873929633495936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.881232:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633495936 ext(21721088->21786623) 00002000:00010000:1.0:1787119496.881236:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18380 00000100:00100000:0.0:1787119496.881253:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19721 00000100:00100000:0.0:1787119496.881263:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+204:32724:x1873929633496448:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119496.881281:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119496.881315:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e3459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e09 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.881408:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.881422:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.881434:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119496.881490:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 54126883 00000004:00200000:0.0:1787119496.881495:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119496.881517:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.881543:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fba00/0xcaba3de8463e3459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e09 expref: 206 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.881561:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e09 expref: 205 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.881581:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119496.881584:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119496.881587:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb000, rc 0) 00000100:00100000:0.0:1787119496.881625:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+205:32724:x1873929633496448:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 363us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.881631:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19721 00000100:00100000:2.0:1787119496.883911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.884094:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633496576 00000100:00100000:3.0:1787119496.884102:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633496576 00000100:00100000:0.0:1787119496.884110:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633496320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4352us (4619us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119496.884121:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10417 00002000:00100000:0.0:1787119496.884131:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (4554752->4620287) req@ffff92a519d19500 x1873929633496320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.884134:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (43794432->43859967) req@ffff92a51282e300 x1873929633496576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.884141:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19500 with x1873929633496320 ext(4554752->4620287) 00002000:00100000:3.0:1787119496.884143:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e300 with x1873929633496576 ext(43794432->43859967) 00002000:00010000:3.0:1787119496.884146:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282e300 00002000:00010000:0.0:1787119496.884146:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19500 00000100:00100000:0.0:1787119496.884167:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10418 00000100:00100000:0.0:1787119496.884177:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633496576:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.892186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.892258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.892336:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633496704 00000100:00100000:0.0:1787119496.892346:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633496704 00002000:00100000:0.0:1787119496.892391:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (64540672->64602111) req@ffff92a51282c000 x1873929633496704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.892402:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c000 with x1873929633496704 ext(64540672->64602111) 00002000:00010000:0.0:1787119496.892408:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c000 00000100:00100000:1.0:1787119496.892415:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633496576:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8240us (8513us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119496.892424:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10418 00000100:00100000:0.0:1787119496.892427:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633496960 00002000:00100000:1.0:1787119496.892430:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (43794432->43859967) req@ffff92a51282e300 x1873929633496576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787119496.892430:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633496960 00002000:00100000:1.0:1787119496.892473:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e300 with x1873929633496576 ext(43794432->43859967) 00002000:00010000:1.0:1787119496.892478:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282e300 00002000:00100000:0.0:1787119496.892478:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (3407872->3411967) req@ffff92a51282ce00 x1873929633496960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.892485:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ce00 with x1873929633496960 ext(3407872->3411967) 00002000:00010000:0.0:1787119496.892488:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282ce00 00000100:00100000:1.0:1787119496.892498:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10419 00000100:00100000:0.0:1787119496.892503:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10420 00000100:00100000:1.0:1787119496.892506:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633496704:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.892508:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633496960:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.892696:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633496960:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 187us (438us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.892702:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10420 00002000:00100000:0.0:1787119496.892708:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (3407872->3411967) req@ffff92a51282ce00 x1873929633496960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.892715:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ce00 with x1873929633496960 ext(3407872->3411967) 00002000:00010000:0.0:1787119496.892718:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282ce00 00000100:00100000:2.0:1787119496.894539:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.894620:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633496832 00000100:00100000:0.0:1787119496.894629:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633496832 00002000:00100000:0.0:1787119496.894672:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (59912192->59924479) req@ffff92a51282ed80 x1873929633496832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.894682:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ed80 with x1873929633496832 ext(59912192->59924479) 00002000:00010000:0.0:1787119496.894688:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282ed80 00000100:00100000:0.0:1787119496.894723:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10421 00000100:00100000:0.0:1787119496.894732:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633496832:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.894986:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633496832:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 254us (456us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1787119496.894994:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10421 00002000:00100000:0.0:1787119496.895001:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (59912192->59924479) req@ffff92a51282ed80 x1873929633496832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/12728 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.895009:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ed80 with x1873929633496832 ext(59912192->59924479) 00002000:00010000:0.0:1787119496.895013:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282ed80 00000100:00100000:1.0:1787119496.897637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.897678:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633497088 00000100:00100000:3.0:1787119496.897687:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633497088 00002000:00100000:3.0:1787119496.897731:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (4575232->4587519) req@ffff92a511f57800 x1873929633497088/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 12776/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.897748:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633497088 ext(4575232->4587519) 00002000:00010000:3.0:1787119496.897753:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57800 00000100:00100000:3.0:1787119496.897784:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10422 00000100:00100000:3.0:1787119496.897793:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633497088:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119496.898203:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633497088:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 410us (575us total) trans 4294969192 rc 0/0 00000100:00100000:3.0:1787119496.898211:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10422 00002000:00100000:3.0:1787119496.898218:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (4575232->4587519) req@ffff92a511f57800 x1873929633497088/t4294969192(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 12776/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.898226:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633497088 ext(4575232->4587519) 00002000:00010000:3.0:1787119496.898230:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57800 00000100:00100000:0.0:1787119496.902478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.902511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.902532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.902572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.902616:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633497216 00000100:00100000:3.0:1787119496.902625:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633497216 00002000:00100000:3.0:1787119496.902676:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (43814912->43839487) req@ffff92a606156d80 x1873929633497216/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.902688:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156d80 with x1873929633497216 ext(43814912->43839487) 00002000:00010000:3.0:1787119496.902694:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156d80 00000100:00100000:3.0:1787119496.902715:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633497472 00000100:00100000:3.0:1787119496.902718:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633497472 00002000:00100000:3.0:1787119496.902734:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (3411968->3416063) req@ffff92a606155500 x1873929633497472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.902742:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155500 with x1873929633497472 ext(3411968->3416063) 00002000:00010000:3.0:1787119496.902745:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155500 00000100:00100000:3.0:1787119496.902759:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633497600 00000100:00100000:3.0:1787119496.902762:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633497600 00002000:00100000:3.0:1787119496.902774:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (41320448->41332735) req@ffff92a606154a80 x1873929633497600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.902781:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154a80 with x1873929633497600 ext(41320448->41332735) 00002000:00010000:3.0:1787119496.902783:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606154a80 00000100:00100000:3.0:1787119496.902799:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10423 00000100:00100000:3.0:1787119496.902818:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633497216:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119496.902834:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10424 00000100:00100000:0.0:1787119496.902842:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633497472:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119496.902959:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633497344 00000100:00100000:3.0:1787119496.902963:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633497344 00000100:00100000:3.0:1787119496.902987:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5086 00000100:00100000:3.0:1787119496.902992:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633497344:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119496.903036:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10425 00000100:00100000:3.0:1787119496.903042:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633497600:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.903053:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633497472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 212us (520us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.903060:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10424 00002000:00100000:0.0:1787119496.903066:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (3411968->3416063) req@ffff92a606155500 x1873929633497472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.903073:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155500 with x1873929633497472 ext(3411968->3416063) 00002000:00010000:0.0:1787119496.903077:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155500 00000100:00100000:3.0:1787119496.903159:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633497600:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 116us (586us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1787119496.903166:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10425 00002000:00100000:3.0:1787119496.903171:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (41320448->41332735) req@ffff92a606154a80 x1873929633497600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/12728 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.903179:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154a80 with x1873929633497600 ext(41320448->41332735) 00002000:00010000:3.0:1787119496.903182:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606154a80 00000100:00100000:1.0:1787119496.903533:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633496704:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11027us (11357us total) trans 0 rc 53248/53248 00000100:00100000:1.0:1787119496.903541:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10419 00002000:00100000:1.0:1787119496.903547:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (64540672->64602111) req@ffff92a51282c000 x1873929633496704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.903554:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c000 with x1873929633496704 ext(64540672->64602111) 00002000:00010000:1.0:1787119496.903558:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c000 00000100:00100000:0.0:1787119496.910635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.910759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.910780:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633497728 00000100:00100000:0.0:1787119496.910789:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633497728 00002000:00100000:0.0:1787119496.910848:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (3387392->3452927) req@ffff92a606155880 x1873929633497728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.910859:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155880 with x1873929633497728 ext(3387392->3452927) 00002000:00010000:0.0:1787119496.910865:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155880 00000100:00100000:0.0:1787119496.910883:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633497856 00000100:00100000:0.0:1787119496.910885:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633497856 00002000:00100000:0.0:1787119496.910898:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (64561152->64600735) req@ffff92a606157100 x1873929633497856/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.910906:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157100 with x1873929633497856 ext(64561152->64600735) 00002000:00010000:0.0:1787119496.910908:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157100 00000100:00100000:0.0:1787119496.910922:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10426 00000100:00100000:0.0:1787119496.910930:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633497728:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.911137:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10427 00000100:00100000:0.0:1787119496.911144:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633497856:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119496.911400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.911466:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633497984 00000100:00100000:0.0:1787119496.911470:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633497984 00002000:00100000:0.0:1787119496.911487:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (60612608->60616703) req@ffff92a606157b80 x1873929633497984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.911493:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157b80 with x1873929633497984 ext(60612608->60616703) 00002000:00010000:0.0:1787119496.911496:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606157b80 00000100:00100000:0.0:1787119496.911509:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10428 00000100:00100000:0.0:1787119496.911514:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633497984:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.911646:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633497984:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 129us (244us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.911653:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10428 00002000:00100000:0.0:1787119496.911658:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (60612608->60616703) req@ffff92a606157b80 x1873929633497984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.911666:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157b80 with x1873929633497984 ext(60612608->60616703) 00002000:00010000:0.0:1787119496.911669:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606157b80 00000100:00100000:3.0:1787119496.913050:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633497216:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 10225us (10609us total) trans 4294969193 rc 0/0 00000100:00100000:3.0:1787119496.913063:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10423 00002000:00100000:3.0:1787119496.913073:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (43814912->43839487) req@ffff92a606156d80 x1873929633497216/t4294969193(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.913083:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156d80 with x1873929633497216 ext(43814912->43839487) 00002000:00010000:3.0:1787119496.913088:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156d80 00000100:00100000:0.0:1787119496.916388:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633497856:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 5234us (5619us total) trans 4294969194 rc 0/0 00000100:00100000:0.0:1787119496.916402:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10427 00002000:00100000:0.0:1787119496.916413:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (64561152->64600735) req@ffff92a606157100 x1873929633497856/t4294969194(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.916423:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157100 with x1873929633497856 ext(64561152->64600735) 00002000:00010000:0.0:1787119496.916429:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157100 00000100:00100000:0.0:1787119496.916550:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633497728:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5620us (5926us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119496.916558:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10426 00002000:00100000:0.0:1787119496.916564:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (3387392->3452927) req@ffff92a606155880 x1873929633497728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.916572:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155880 with x1873929633497728 ext(3387392->3452927) 00002000:00010000:0.0:1787119496.916576:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155880 00000100:00100000:3.0:1787119496.918066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.918138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.918167:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633498240 00000100:00100000:3.0:1787119496.918176:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633498240 00000100:00100000:1.0:1787119496.919470:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633498112 00000100:00100000:1.0:1787119496.919480:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633498112 00002000:00100000:1.0:1787119496.919524:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (60616704->60620799) req@ffff92a519d18e00 x1873929633498112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.919538:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18e00 with x1873929633498112 ext(60616704->60620799) 00002000:00010000:1.0:1787119496.919544:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18e00 00000100:00100000:1.0:1787119496.919604:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10429 00000100:00100000:1.0:1787119496.919615:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633498112:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.920069:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633498112:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 455us (2006us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.920079:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10429 00002000:00100000:1.0:1787119496.920087:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x23:0x0] (60616704->60620799) req@ffff92a519d18e00 x1873929633498112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.920103:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18e00 with x1873929633498112 ext(60616704->60620799) 00002000:00010000:1.0:1787119496.920108:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d18e00 00000100:00100000:3.0:1787119496.921466:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5087 00000100:00100000:3.0:1787119496.921482:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633498240:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119496.921570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.921599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.921729:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633498368 00000100:00100000:1.0:1787119496.921736:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633498368 00000100:00100000:1.0:1787119496.921764:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5088 00000100:00100000:1.0:1787119496.921771:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633498368:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119496.922408:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633498496 00000100:00100000:0.0:1787119496.922414:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633498496 00002000:00100000:0.0:1787119496.922478:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (3407872->3440639) req@ffff92a50512c700 x1873929633498496/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.922489:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c700 with x1873929633498496 ext(3407872->3440639) 00002000:00010000:0.0:1787119496.922494:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512c700 00000100:00100000:0.0:1787119496.922513:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10430 00000100:00100000:0.0:1787119496.922520:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633498496:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119496.923731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.924103:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633498624 00000100:00100000:2.0:1787119496.924111:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633498624 00002000:00100000:2.0:1787119496.924147:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (60592128->60657663) req@ffff92a511f54380 x1873929633498624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.924157:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54380 with x1873929633498624 ext(60592128->60657663) 00002000:00010000:2.0:1787119496.924162:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54380 00000100:00100000:2.0:1787119496.924189:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10431 00000100:00100000:2.0:1787119496.924197:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633498624:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.927610:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633498496:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 5080us (6001us total) trans 4294968916 rc 0/0 00000100:00100000:1.0:1787119496.927624:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10430 00002000:00100000:1.0:1787119496.927636:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (3407872->3440639) req@ffff92a50512c700 x1873929633498496/t4294968916(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.927647:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c700 with x1873929633498496 ext(3407872->3440639) 00002000:00010000:1.0:1787119496.927653:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512c700 00000100:00100000:3.0:1787119496.931314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.931510:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633498752 00000100:00100000:0.0:1787119496.931521:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633498752 00000100:00100000:0.0:1787119496.931575:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5089 00000100:00100000:0.0:1787119496.931585:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633498752:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119496.932355:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633498624:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8155us (8626us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119496.932362:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10431 00002000:00100000:0.0:1787119496.932370:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x23:0x0] (60592128->60657663) req@ffff92a511f54380 x1873929633498624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.932378:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54380 with x1873929633498624 ext(60592128->60657663) 00002000:00010000:0.0:1787119496.932382:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f54380 00000100:00100000:0.0:1787119496.940550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.940721:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633498880 00000100:00100000:1.0:1787119496.940731:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633498880 00002000:00100000:1.0:1787119496.940775:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (29409280->60633087) req@ffff92a606155c00 x1873929633498880/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.940786:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155c00 with x1873929633498880 ext(29409280->60633087) 00002000:00010000:1.0:1787119496.940792:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155c00 00000100:00100000:1.0:1787119496.940818:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10432 00000100:00100000:1.0:1787119496.940826:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633498880:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119496.946406:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633498880:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 5568us (5854us total) trans 4294968917 rc 0/0 00000100:00100000:0.0:1787119496.946421:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10432 00002000:00100000:0.0:1787119496.946461:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x23:0x0] (29409280->60633087) req@ffff92a606155c00 x1873929633498880/t4294968917(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/448 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.946477:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155c00 with x1873929633498880 ext(29409280->60633087) 00002000:00010000:0.0:1787119496.946483:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a606155c00 00000100:00100000:1.0:1787119496.948512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.948595:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633499008 00000100:00100000:2.0:1787119496.948605:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633499008 00000100:00100000:2.0:1787119496.948653:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5090 00000100:00100000:2.0:1787119496.948661:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633499008:12345-192.168.201.59@tcp:16:fsx.0 00000001:00080000:1.0:1787119496.951290:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969191 is committed 00000001:00080000:1.0:1787119496.951307:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969192 is committed 00000100:00100000:0.0:1787119496.951342:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633497344:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 48343us (48824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.951353:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5086 00000100:00100000:1.0:1787119496.956578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119496.956661:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633499136 00000100:00100000:2.0:1787119496.956672:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633499136 00002000:00100000:2.0:1787119496.956721:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (10141696->10145791) req@ffff92a511f55180 x1873929633499136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.956733:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55180 with x1873929633499136 ext(10141696->10145791) 00002000:00010000:2.0:1787119496.956738:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55180 00000100:00100000:2.0:1787119496.956773:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10433 00000100:00100000:2.0:1787119496.956782:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633499136:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119496.957009:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633499136:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 226us (438us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119496.957017:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10433 00002000:00100000:2.0:1787119496.957024:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (10141696->10145791) req@ffff92a511f55180 x1873929633499136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119496.957031:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55180 with x1873929633499136 ext(10141696->10145791) 00002000:00010000:2.0:1787119496.957034:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f55180 00000100:00100000:3.0:1787119496.962132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.962332:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633499264 00000100:00100000:0.0:1787119496.962344:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633499264 00002000:00100000:0.0:1787119496.962392:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (10145792->10149887) req@ffff92a50512df80 x1873929633499264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.962404:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512df80 with x1873929633499264 ext(10145792->10149887) 00002000:00010000:0.0:1787119496.962409:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512df80 00000100:00100000:0.0:1787119496.962465:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10434 00000100:00100000:0.0:1787119496.962475:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633499264:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.962699:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633499264:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 225us (575us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119496.962707:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10434 00002000:00100000:0.0:1787119496.962714:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (10145792->10149887) req@ffff92a50512df80 x1873929633499264/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.962723:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512df80 with x1873929633499264 ext(10145792->10149887) 00002000:00010000:0.0:1787119496.962727:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512df80 00000100:00100000:2.0:1787119496.965725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119496.965828:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633499392 00000100:00100000:3.0:1787119496.965838:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633499392 00002000:00100000:3.0:1787119496.965885:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (10121216->10186751) req@ffff92a51282f800 x1873929633499392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.965896:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f800 with x1873929633499392 ext(10121216->10186751) 00002000:00010000:3.0:1787119496.965902:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282f800 00000100:00100000:3.0:1787119496.965934:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10435 00000100:00100000:3.0:1787119496.965944:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633499392:12345-192.168.201.59@tcp:3:fsx.0 00000001:00080000:1.0:1787119496.969732:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968916 is committed 00000100:00100000:3.0:1787119496.972160:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633499392:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6205us (6432us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119496.972174:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10435 00002000:00100000:3.0:1787119496.972187:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (10121216->10186751) req@ffff92a51282f800 x1873929633499392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 504/440 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119496.972199:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f800 with x1873929633499392 ext(10121216->10186751) 00002000:00010000:3.0:1787119496.972206:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282f800 00000100:00100000:0.0:1787119496.975797:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633498752:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 44200us (44481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.976121:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5089 00000100:00100000:1.0:1787119496.981976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.982006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.982034:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633499776 00000100:00100000:1.0:1787119496.982042:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633499776 00000100:00100000:1.0:1787119496.982080:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19722 00000100:00100000:1.0:1787119496.982086:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+205:32724:x1873929633499776:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119496.982130:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119496.982152:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb000/0xcaba3de8463e3460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e09 expref: 205 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.982166:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:1.0:1787119496.982170:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119496.982347:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.982360:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119496.982370:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119496.982418:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976536 00000004:00010000:1.0:1787119496.982486:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007187e436 reply state 0000000054bf3842 transno 4294976537 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.982495:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119496.982579:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+207:32724:x1873929633499776:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 491us (570us total) trans 4294976537 rc 0/0 00000100:00100000:1.0:1787119496.982587:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19722 00000020:00080000:1.0:1787119496.982592:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119496.983708:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633499520 00000100:00100000:0.0:1787119496.983719:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633499520 00002000:00100000:0.0:1787119496.983760:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (17801216->17817599) req@ffff92a511f57480 x1873929633499520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.983771:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633499520 ext(17801216->17817599) 00002000:00010000:0.0:1787119496.983776:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57480 00000100:00100000:0.0:1787119496.983814:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10436 00000100:00100000:0.0:1787119496.983822:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633499520:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119496.984169:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633499520:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 346us (2200us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1787119496.984176:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10436 00002000:00100000:0.0:1787119496.984182:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (17801216->17817599) req@ffff92a511f57480 x1873929633499520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/16824 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119496.984191:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633499520 ext(17801216->17817599) 00002000:00010000:0.0:1787119496.984194:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57480 00010000:00010000:2.0:1787119496.987945:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.987964:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.987972:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.987979:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119496.987984:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.987992:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.988010:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:2.0:1787119496.988013:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119496.988018:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119496.988024:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e3467 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119496.988727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.989769:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633499904 00000100:00100000:0.0:1787119496.989781:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633499904 00002000:00010000:0.0:1787119496.989829:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (25582583->18446744073709551615) 00002000:00100000:0.0:1787119496.989835:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56680 with x1873929633499904 ext(25582583->18446744073709551615) 00002000:00010000:0.0:1787119496.990145:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f56680. 00000100:00100000:0.0:1787119496.990178:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10437 00000100:00100000:0.0:1787119496.990189:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633499904:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119496.990533:0:19245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 54126883 -> 25582583 00002000:00010000:0.0:1787119496.990537:0:19245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119496.990540:0:19245:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119496.990542:0:19245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119496.990544:0:19245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1807 -> 1549 00000100:00100000:0.0:1787119496.990604:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633499904:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 416us (1882us total) trans 4294968918 rc 0/0 00000100:00100000:0.0:1787119496.990612:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10437 00002000:00010000:0.0:1787119496.990616:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (25582583->18446744073709551615) 00002000:00100000:0.0:1787119496.990619:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56680 with x1873929633499904 ext(25582583->18446744073709551615) 00002000:00010000:0.0:1787119496.990623:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f56680. 00000100:00100000:0.0:1787119496.992676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119496.994729:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633500032 00000100:00100000:1.0:1787119496.994745:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633500032 00002000:00100000:1.0:1787119496.994795:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (43814912->43819007) req@ffff92a606157480 x1873929633500032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/0 e 0 to 0 dl 1787119507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.994818:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157480 with x1873929633500032 ext(43814912->43819007) 00002000:00010000:1.0:1787119496.994825:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157480 00000100:00100000:1.0:1787119496.994861:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10438 00000100:00100000:1.0:1787119496.994871:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633500032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119496.995096:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633500032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 225us (2428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119496.995104:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10438 00002000:00100000:1.0:1787119496.995111:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (43814912->43819007) req@ffff92a606157480 x1873929633500032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787119507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119496.995119:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157480 with x1873929633500032 ext(43814912->43819007) 00002000:00010000:1.0:1787119496.995122:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606157480 00000100:00100000:0.0:1787119496.997595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119496.997684:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633500160 00000100:00100000:0.0:1787119496.997692:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633500160 00000100:00100000:0.0:1787119496.997742:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19723 00000100:00100000:0.0:1787119496.997751:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+206:32724:x1873929633500160:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119496.997773:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119496.997794:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e346e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e10 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.997900:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e3475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.997911:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e3475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.997919:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e3475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119496.997942:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 25582583 00000004:00200000:0.0:1787119496.997946:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119496.997960:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e3475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.997984:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e346e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e10 expref: 208 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.998003:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fae00/0xcaba3de8463e3475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e10 expref: 207 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119496.998012:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff92a603c5e500) 00010000:00010000:0.0:1787119496.998015:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119496.998019:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fae00, rc 0) 00000100:00100000:0.0:1787119496.998067:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+207:32724:x1873929633500160:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 317us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119496.998072:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19723 00000001:00080000:0.0:1787119496.999417:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969194 is committed 00000100:00100000:1.0:1787119496.999595:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633498368:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 77820us (78022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119496.999606:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5088 00000100:00100000:3.0:1787119497.000309:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633498240:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 78829us (82166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.000319:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5087 00000100:00100000:1.0:1787119497.010956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.010999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.011029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.011060:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633500416 00000100:00100000:1.0:1787119497.011069:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633500416 00002000:00100000:1.0:1787119497.011129:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (8941568->8945663) req@ffff92a63dfbb100 x1873929633500416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.011140:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb100 with x1873929633500416 ext(8941568->8945663) 00002000:00010000:1.0:1787119497.011146:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbb100 00000100:00100000:1.0:1787119497.011168:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633500288 00000100:00100000:1.0:1787119497.011171:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633500288 00002000:00100000:1.0:1787119497.011187:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (43819008->43823103) req@ffff92a63dfb8000 x1873929633500288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.011195:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8000 with x1873929633500288 ext(43819008->43823103) 00002000:00010000:1.0:1787119497.011197:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb8000 00000100:00100000:1.0:1787119497.011215:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10439 00000100:00100000:1.0:1787119497.011224:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633500416:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.011392:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10440 00000100:00100000:0.0:1787119497.011402:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633500288:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.011665:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633500288:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 264us (664us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.011673:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10440 00002000:00100000:0.0:1787119497.011679:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (43819008->43823103) req@ffff92a63dfb8000 x1873929633500288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.011694:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8000 with x1873929633500288 ext(43819008->43823103) 00002000:00010000:0.0:1787119497.011698:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb8000 00000100:00100000:1.0:1787119497.012090:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633500416:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 866us (1256us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119497.012097:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10439 00002000:00100000:1.0:1787119497.012103:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x22:0x0] (8941568->8945663) req@ffff92a63dfbb100 x1873929633500416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.012111:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb100 with x1873929633500416 ext(8941568->8945663) 00002000:00010000:1.0:1787119497.012114:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbb100 00000100:00100000:1.0:1787119497.012137:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633500544 00000100:00100000:1.0:1787119497.012141:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633500544 00000100:00100000:1.0:1787119497.012171:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19724 00000100:00100000:1.0:1787119497.012179:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+207:32729:x1873929633500544:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119497.012191:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119497.012214:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e347c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e17 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.012305:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.012318:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.012328:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119497.012354:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 64600736 00000004:00200000:1.0:1787119497.012359:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119497.012373:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.012397:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430600/0xcaba3de8463e347c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e17 expref: 209 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787119497.012833:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787119497.012952:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119497.012955:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787119497.013079:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e17 expref: 208 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.013089:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119497.013092:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119497.013096:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430400, rc 0) 00000100:00100000:1.0:1787119497.013182:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+208:32729:x1873929633500544:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 1003us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119497.013192:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19724 00000100:00100000:2.0:1787119497.019161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.019193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.019340:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633500672 00000100:00100000:1.0:1787119497.019350:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633500672 00002000:00100000:1.0:1787119497.019395:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (6209536->6213631) req@ffff92a51282c700 x1873929633500672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.019416:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c700 with x1873929633500672 ext(6209536->6213631) 00002000:00010000:1.0:1787119497.019422:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c700 00000100:00100000:1.0:1787119497.019473:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633500800 00000100:00100000:1.0:1787119497.019476:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633500800 00002000:00100000:1.0:1787119497.019493:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (43794432->43859967) req@ffff92a51282dc00 x1873929633500800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.019501:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282dc00 with x1873929633500800 ext(43794432->43859967) 00002000:00010000:1.0:1787119497.019505:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282dc00 00000100:00100000:1.0:1787119497.019523:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10441 00000100:00100000:1.0:1787119497.019532:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633500672:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.019753:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633500672:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 221us (601us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119497.019761:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10441 00002000:00100000:1.0:1787119497.019767:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (6209536->6213631) req@ffff92a51282c700 x1873929633500672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.019775:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c700 with x1873929633500672 ext(6209536->6213631) 00002000:00010000:1.0:1787119497.019778:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c700 00000100:00100000:1.0:1787119497.019795:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10442 00000100:00100000:1.0:1787119497.019812:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633500800:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.027237:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633499008:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 78561us (78719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119497.027251:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5090 00000001:00080000:3.0:1787119497.028335:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968917 is committed 00000100:00100000:1.0:1787119497.028630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.028765:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633500928 00000100:00100000:3.0:1787119497.028775:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633500928 00002000:00100000:2.0:1787119497.029008:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (4575232->4579327) req@ffff92a63dfb9880 x1873929633500928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.029021:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9880 with x1873929633500928 ext(4575232->4579327) 00002000:00010000:2.0:1787119497.029027:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9880 00000100:00100000:2.0:1787119497.029093:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10443 00000100:00100000:2.0:1787119497.029103:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633500928:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.029355:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633500928:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 253us (729us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119497.029362:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10443 00002000:00100000:2.0:1787119497.029368:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (4575232->4579327) req@ffff92a63dfb9880 x1873929633500928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.029376:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9880 with x1873929633500928 ext(4575232->4579327) 00002000:00010000:2.0:1787119497.029379:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9880 00000100:00100000:1.0:1787119497.036059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.036092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.036139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.036212:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633501056 00000100:00100000:0.0:1787119497.036220:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633501056 00002000:00100000:0.0:1787119497.036262:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (8945664->8949759) req@ffff92a63dfb8a80 x1873929633501056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.036273:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8a80 with x1873929633501056 ext(8945664->8949759) 00002000:00010000:0.0:1787119497.036278:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb8a80 00000100:00100000:0.0:1787119497.036302:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633501184 00000100:00100000:0.0:1787119497.036305:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633501184 00002000:00100000:0.0:1787119497.036318:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (393216->413695) req@ffff92a63dfb9180 x1873929633501184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.036326:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9180 with x1873929633501184 ext(393216->413695) 00002000:00010000:0.0:1787119497.036329:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9180 00000100:00100000:0.0:1787119497.036338:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633501312 00000100:00100000:0.0:1787119497.036340:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633501312 00002000:00100000:0.0:1787119497.036349:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (4579328->4583423) req@ffff92a63dfb9c00 x1873929633501312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.036357:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9c00 with x1873929633501312 ext(4579328->4583423) 00002000:00010000:0.0:1787119497.036360:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9c00 00000100:00100000:0.0:1787119497.036375:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10444 00000100:00100000:0.0:1787119497.036382:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633501056:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.036628:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633501056:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 245us (579us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.036636:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10444 00002000:00100000:0.0:1787119497.036642:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x22:0x0] (8945664->8949759) req@ffff92a63dfb8a80 x1873929633501056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.036651:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8a80 with x1873929633501056 ext(8945664->8949759) 00002000:00010000:0.0:1787119497.036654:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfb8a80 00000100:00100000:0.0:1787119497.036668:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10445 00000100:00100000:0.0:1787119497.036674:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633501184:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.036763:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10446 00000100:00100000:0.0:1787119497.036769:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633501312:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.037143:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633501312:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 372us (1001us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.037150:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10446 00002000:00100000:0.0:1787119497.037156:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (4579328->4583423) req@ffff92a63dfb9c00 x1873929633501312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.037164:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9c00 with x1873929633501312 ext(4579328->4583423) 00002000:00010000:0.0:1787119497.037168:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9c00 00000100:00100000:3.0:1787119497.037780:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633500800:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17975us (18582us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119497.037789:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10442 00002000:00100000:3.0:1787119497.037796:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (43794432->43859967) req@ffff92a51282dc00 x1873929633500800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.037815:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282dc00 with x1873929633500800 ext(43794432->43859967) 00002000:00010000:3.0:1787119497.037820:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282dc00 00000100:00100000:2.0:1787119497.044144:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633501184:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7459us (8040us total) trans 0 rc 20480/20480 00000100:00100000:2.0:1787119497.044160:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10445 00002000:00100000:2.0:1787119497.044176:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (393216->413695) req@ffff92a63dfb9180 x1873929633501184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.044195:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9180 with x1873929633501184 ext(393216->413695) 00002000:00010000:2.0:1787119497.044201:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9180 00000100:00100000:0.0:1787119497.047362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.047656:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633501440 00000100:00100000:1.0:1787119497.047667:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633501440 00002000:00100000:1.0:1787119497.047720:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (43814912->43839487) req@ffff92a6072f9880 x1873929633501440/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.047732:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9880 with x1873929633501440 ext(43814912->43839487) 00002000:00010000:1.0:1787119497.047738:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9880 00000100:00100000:1.0:1787119497.047795:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10447 00000100:00100000:1.0:1787119497.047811:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633501440:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119497.055039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.055877:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633501568 00000100:00100000:1.0:1787119497.055889:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633501568 00002000:00100000:1.0:1787119497.055942:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (4554752->4620287) req@ffff92a51282ea00 x1873929633501568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.055952:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ea00 with x1873929633501568 ext(4554752->4620287) 00002000:00010000:1.0:1787119497.055958:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ea00 00000100:00100000:1.0:1787119497.055982:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10448 00000100:00100000:1.0:1787119497.055991:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633501568:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.057217:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633501440:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9409us (9859us total) trans 4294969195 rc 0/0 00000100:00100000:1.0:1787119497.057232:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10447 00002000:00100000:1.0:1787119497.057243:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (43814912->43839487) req@ffff92a6072f9880 x1873929633501440/t4294969195(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.057253:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9880 with x1873929633501440 ext(43814912->43839487) 00002000:00010000:1.0:1787119497.057261:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9880 00000100:00100000:2.0:1787119497.060598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.060670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.061023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.061078:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633501696 00000100:00100000:1.0:1787119497.061087:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633501696 00002000:00100000:1.0:1787119497.061134:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (8921088->8986623) req@ffff92a51282c380 x1873929633501696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.061146:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c380 with x1873929633501696 ext(8921088->8986623) 00002000:00010000:1.0:1787119497.061152:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282c380 00000100:00100000:1.0:1787119497.061178:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633501824 00000100:00100000:1.0:1787119497.061182:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633501824 00002000:00100000:1.0:1787119497.061198:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (62857216->62881791) req@ffff92a51282ca80 x1873929633501824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.061205:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ca80 with x1873929633501824 ext(62857216->62881791) 00002000:00010000:1.0:1787119497.061209:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282ca80 00000100:00100000:1.0:1787119497.061229:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10449 00000100:00100000:1.0:1787119497.061349:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633501696:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.062085:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633501952 00000100:00100000:3.0:1787119497.062093:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633501952 00002000:00100000:3.0:1787119497.062119:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (29409280->29413375) req@ffff92a5066ddf80 x1873929633501952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.062129:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddf80 with x1873929633501952 ext(29409280->29413375) 00002000:00010000:3.0:1787119497.062134:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ddf80 00000100:00100000:2.0:1787119497.062312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.062525:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10450 00000100:00100000:0.0:1787119497.062538:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633501824:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.063271:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633501568:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7277us (8241us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119497.063280:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10448 00002000:00100000:1.0:1787119497.063288:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (4554752->4620287) req@ffff92a51282ea00 x1873929633501568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.063298:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ea00 with x1873929633501568 ext(4554752->4620287) 00002000:00010000:1.0:1787119497.063303:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ea00 00000100:00100000:3.0:1787119497.063643:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10451 00000100:00100000:3.0:1787119497.063654:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633501952:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.064183:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633502080 00000100:00100000:0.0:1787119497.064190:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633502080 00000100:00100000:0.0:1787119497.064225:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5091 00000100:00100000:0.0:1787119497.064232:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633502080:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119497.068049:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633501952:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4385us (7015us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.068064:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10451 00002000:00100000:3.0:1787119497.068079:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (29409280->29413375) req@ffff92a5066ddf80 x1873929633501952/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.068089:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddf80 with x1873929633501952 ext(29409280->29413375) 00002000:00010000:3.0:1787119497.068095:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ddf80 00000100:00100000:0.0:1787119497.068534:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633501696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7186us (7945us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119497.068543:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10449 00002000:00100000:0.0:1787119497.068549:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (8921088->8986623) req@ffff92a51282c380 x1873929633501696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.068558:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c380 with x1873929633501696 ext(8921088->8986623) 00002000:00010000:0.0:1787119497.068562:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282c380 00000100:00100000:0.0:1787119497.068845:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633501824:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6310us (8173us total) trans 0 rc 24576/24576 00000100:00100000:0.0:1787119497.068853:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10450 00002000:00100000:0.0:1787119497.068859:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (62857216->62881791) req@ffff92a51282ca80 x1873929633501824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.068868:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ca80 with x1873929633501824 ext(62857216->62881791) 00002000:00010000:0.0:1787119497.068872:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a51282ca80 00000100:00100000:2.0:1787119497.071920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.072003:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633502208 00000100:00100000:3.0:1787119497.072013:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633502208 00002000:00100000:3.0:1787119497.072060:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (4575232->4587519) req@ffff92a5066df800 x1873929633502208/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 12776/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.072073:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df800 with x1873929633502208 ext(4575232->4587519) 00002000:00010000:3.0:1787119497.072079:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df800 00000100:00100000:3.0:1787119497.072111:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10452 00000100:00100000:3.0:1787119497.072121:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633502208:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119497.074970:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633502208:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 2837us (3045us total) trans 4294969196 rc 0/0 00000100:00100000:2.0:1787119497.074985:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10452 00002000:00100000:2.0:1787119497.074997:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (4575232->4587519) req@ffff92a5066df800 x1873929633502208/t4294969196(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 12776/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.075008:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df800 with x1873929633502208 ext(4575232->4587519) 00002000:00010000:2.0:1787119497.075013:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df800 00000100:00100000:3.0:1787119497.082059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.082100:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.082124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.082193:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633502336 00000100:00100000:2.0:1787119497.082203:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633502336 00002000:00100000:2.0:1787119497.082249:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (29433856->29437951) req@ffff92a50512e680 x1873929633502336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.082260:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512e680 with x1873929633502336 ext(29433856->29437951) 00002000:00010000:2.0:1787119497.082266:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512e680 00000100:00100000:2.0:1787119497.082294:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633502464 00000100:00100000:2.0:1787119497.082298:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633502464 00002000:00100000:2.0:1787119497.082324:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (7327744->7376895) req@ffff92a50512d180 x1873929633502464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.082339:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d180 with x1873929633502464 ext(7327744->7376895) 00002000:00010000:2.0:1787119497.082343:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512d180 00000100:00100000:2.0:1787119497.082363:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10453 00000100:00100000:2.0:1787119497.082373:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633502336:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.082811:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633502336:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 438us (762us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119497.082820:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10453 00002000:00100000:2.0:1787119497.086622:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (29433856->29437951) req@ffff92a50512e680 x1873929633502336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.086639:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512e680 with x1873929633502336 ext(29433856->29437951) 00002000:00010000:2.0:1787119497.086647:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512e680 00000100:00100000:2.0:1787119497.086697:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10454 00000100:00100000:2.0:1787119497.086713:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633502464:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.087818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.088050:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633502720 00000100:00100000:3.0:1787119497.088059:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633502720 00000100:00100000:3.0:1787119497.088112:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19725 00000100:00100000:3.0:1787119497.088121:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+208:32720:x1873929633502720:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119497.088166:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119497.088194:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e3348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715dae expref: 208 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.088213:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119497.088218:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119497.088420:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.088475:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.088487:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119497.088544:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976538 00000004:00010000:3.0:1787119497.088571:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e73bc7b0 reply state 00000000fccea80e transno 4294976539 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119497.088580:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119497.088662:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+210:32720:x1873929633502720:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 542us (847us total) trans 4294976539 rc 0/0 00000100:00100000:3.0:1787119497.088670:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19725 00000020:00080000:3.0:1787119497.088675:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119497.089362:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633502848 00000100:00100000:0.0:1787119497.089370:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633502848 00000100:00100000:0.0:1787119497.089412:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5092 00000100:00100000:0.0:1787119497.089420:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633502848:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119497.093949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.094046:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633502976 00000100:00100000:1.0:1787119497.094056:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633502976 00002000:00010000:1.0:1787119497.094093:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (54126883->18446744073709551615) 00002000:00100000:1.0:1787119497.094098:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbaa00 with x1873929633502976 ext(54126883->18446744073709551615) 00002000:00010000:1.0:1787119497.094108:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbaa00. 00000100:00100000:1.0:1787119497.094133:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10455 00000100:00100000:1.0:1787119497.094142:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633502976:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119497.094506:0:20838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 64600736 -> 54126883 00002000:00010000:1.0:1787119497.094511:0:20838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119494 -> 1787119495 00002000:00010000:1.0:1787119497.094513:0:20838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119495 00002000:00010000:1.0:1787119497.094515:0:20838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119494 -> 1787119495 00002000:00010000:1.0:1787119497.094517:0:20838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 909 -> 1807 00000100:00100000:1.0:1787119497.094581:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633502976:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 439us (642us total) trans 4294968919 rc 0/0 00000100:00100000:1.0:1787119497.094590:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10455 00002000:00010000:1.0:1787119497.094594:0:20838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (54126883->18446744073709551615) 00002000:00100000:1.0:1787119497.094597:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbaa00 with x1873929633502976 ext(54126883->18446744073709551615) 00002000:00010000:1.0:1787119497.094601:0:20838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dfbaa00. 00010000:00010000:3.0:1787119497.097992:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.098015:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.098022:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.098029:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119497.098034:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.098041:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.098061:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:3.0:1787119497.098064:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119497.098069:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.098080:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e348a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119497.098413:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633502464:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11700us (16306us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1787119497.098424:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10454 00002000:00100000:2.0:1787119497.098463:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x22:0x0] (7327744->7376895) req@ffff92a50512d180 x1873929633502464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.098474:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d180 with x1873929633502464 ext(7327744->7376895) 00002000:00010000:2.0:1787119497.098478:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512d180 00000100:00100000:2.0:1787119497.109391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.109494:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633503104 00000100:00100000:1.0:1787119497.109505:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633503104 00002000:00100000:1.0:1787119497.109563:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (995328->999423) req@ffff92a5066dc000 x1873929633503104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.109574:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633503104 ext(995328->999423) 00002000:00010000:1.0:1787119497.109581:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dc000 00000100:00100000:1.0:1787119497.109605:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10456 00000100:00100000:1.0:1787119497.109615:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633503104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.109866:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633503104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 251us (494us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119497.109873:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10456 00002000:00100000:1.0:1787119497.109880:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x22:0x0] (995328->999423) req@ffff92a5066dc000 x1873929633503104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.109890:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633503104 ext(995328->999423) 00002000:00010000:1.0:1787119497.109893:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dc000 00000100:00100000:1.0:1787119497.114282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.114391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.114495:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633503232 00000100:00100000:3.0:1787119497.114505:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633503232 00002000:00100000:3.0:1787119497.114560:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (21741568->21745663) req@ffff92a63dfb8380 x1873929633503232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.114573:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8380 with x1873929633503232 ext(21741568->21745663) 00002000:00010000:3.0:1787119497.114579:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb8380 00000100:00100000:3.0:1787119497.114605:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10457 00000100:00100000:3.0:1787119497.114616:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633503232:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.114851:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633503232:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 235us (577us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.114858:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10457 00002000:00100000:3.0:1787119497.114865:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (21741568->21745663) req@ffff92a63dfb8380 x1873929633503232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.114873:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8380 with x1873929633503232 ext(21741568->21745663) 00002000:00010000:3.0:1787119497.114876:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb8380 00000100:00100000:0.0:1787119497.115417:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633503360 00000100:00100000:0.0:1787119497.115423:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633503360 00000100:00100000:0.0:1787119497.115498:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19726 00000100:00100000:0.0:1787119497.115505:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+209:32720:x1873929633503360:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119497.115521:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119497.115667:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e3491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e1e expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.115749:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e3498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.115762:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e3498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.115773:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e3498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119497.115796:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 54126883 00000004:00200000:0.0:1787119497.115812:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119497.115830:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e3498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.115855:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb600/0xcaba3de8463e3491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e1e expref: 211 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.115871:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e3498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e1e expref: 210 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.115880:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119497.115883:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119497.115886:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb400, rc 0) 00000100:00100000:0.0:1787119497.115930:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+210:32720:x1873929633503360:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 425us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119497.115941:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19726 00000100:00100000:1.0:1787119497.118157:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.118225:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633503488 00000100:00100000:3.0:1787119497.118235:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633503488 00002000:00100000:3.0:1787119497.118281:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (999424->1003519) req@ffff92a509134a80 x1873929633503488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.118292:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134a80 with x1873929633503488 ext(999424->1003519) 00002000:00010000:3.0:1787119497.118303:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509134a80 00000100:00100000:3.0:1787119497.118335:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10458 00000100:00100000:3.0:1787119497.118344:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633503488:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.118625:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633503488:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 281us (479us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.118633:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10458 00002000:00100000:3.0:1787119497.118640:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x22:0x0] (999424->1003519) req@ffff92a509134a80 x1873929633503488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.118648:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134a80 with x1873929633503488 ext(999424->1003519) 00002000:00010000:3.0:1787119497.118652:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509134a80 00000100:00100000:3.0:1787119497.123714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.124595:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633503616 00000100:00100000:0.0:1787119497.124606:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633503616 00002000:00100000:0.0:1787119497.124657:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (3407872->3411967) req@ffff92a50512fb80 x1873929633503616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.124669:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512fb80 with x1873929633503616 ext(3407872->3411967) 00002000:00010000:0.0:1787119497.124676:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512fb80 00000100:00100000:0.0:1787119497.124717:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10459 00000100:00100000:0.0:1787119497.124727:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633503616:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.124997:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633503616:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 271us (1294us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.125005:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10459 00002000:00100000:0.0:1787119497.125012:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (3407872->3411967) req@ffff92a50512fb80 x1873929633503616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.125020:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512fb80 with x1873929633503616 ext(3407872->3411967) 00002000:00010000:0.0:1787119497.125023:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512fb80 00000001:00080000:1.0:1787119497.127397:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969195 is committed 00000100:00100000:3.0:1787119497.128064:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633502080:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 63824us (65746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.128075:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5091 00000100:00100000:0.0:1787119497.133773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.133925:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633503744 00000100:00100000:1.0:1787119497.133935:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633503744 00002000:00100000:1.0:1787119497.133995:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (974848->1040383) req@ffff92a6072f8a80 x1873929633503744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.134007:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8a80 with x1873929633503744 ext(974848->1040383) 00002000:00010000:1.0:1787119497.134014:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072f8a80 00000100:00100000:1.0:1787119497.134053:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10460 00000100:00100000:1.0:1787119497.134062:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633503744:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.139617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.139659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.139683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.139726:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633503872 00000100:00100000:0.0:1787119497.139736:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633503872 00000100:00100000:3.0:1787119497.139743:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633504000 00000100:00100000:3.0:1787119497.139746:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633504000 00002000:00100000:3.0:1787119497.139778:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (21745664->21749759) req@ffff92a6072fad80 x1873929633504000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.139778:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (3411968->3416063) req@ffff92a6072fa680 x1873929633503872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.139790:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fad80 with x1873929633504000 ext(21745664->21749759) 00002000:00010000:3.0:1787119497.139796:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fad80 00002000:00100000:0.0:1787119497.139796:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fa680 with x1873929633503872 ext(3411968->3416063) 00000100:00100000:3.0:1787119497.139813:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633504128 00000100:00100000:3.0:1787119497.139816:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633504128 00002000:00100000:3.0:1787119497.139829:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (6209536->6213631) req@ffff92a6072f8000 x1873929633504128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.139909:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8000 with x1873929633504128 ext(6209536->6213631) 00002000:00010000:3.0:1787119497.139914:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8000 00002000:00010000:0.0:1787119497.139919:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072fa680 00000100:00100000:3.0:1787119497.139932:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10461 00000100:00100000:3.0:1787119497.139942:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633504000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.140222:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633504000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 281us (562us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.142028:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10462 00000100:00100000:0.0:1787119497.142050:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633504128:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.142264:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633504128:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 226us (2580us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.142272:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10462 00002000:00100000:0.0:1787119497.142278:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (6209536->6213631) req@ffff92a6072f8000 x1873929633504128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.142285:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8000 with x1873929633504128 ext(6209536->6213631) 00002000:00010000:0.0:1787119497.142290:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8000 00000100:00100000:0.0:1787119497.142315:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10463 00000100:00100000:0.0:1787119497.142323:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633503872:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.142673:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633503872:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 350us (3067us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.142680:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10463 00002000:00100000:0.0:1787119497.142687:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x23:0x0] (3411968->3416063) req@ffff92a6072fa680 x1873929633503872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.142701:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fa680 with x1873929633503872 ext(3411968->3416063) 00002000:00010000:0.0:1787119497.142705:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072fa680 00000100:00100000:3.0:1787119497.145550:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10461 00002000:00100000:3.0:1787119497.145571:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (21745664->21749759) req@ffff92a6072fad80 x1873929633504000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.145584:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fad80 with x1873929633504000 ext(21745664->21749759) 00002000:00010000:3.0:1787119497.145590:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fad80 00000100:00100000:1.0:1787119497.145746:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633503744:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11683us (11982us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119497.145755:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10460 00002000:00100000:1.0:1787119497.145761:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x22:0x0] (974848->1040383) req@ffff92a6072f8a80 x1873929633503744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.145770:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8a80 with x1873929633503744 ext(974848->1040383) 00002000:00010000:1.0:1787119497.145774:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072f8a80 00000100:00100000:0.0:1787119497.157071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.157111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.157145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.157209:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633504256 00000100:00100000:1.0:1787119497.157218:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633504256 00002000:00100000:1.0:1787119497.157263:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (21721088->21786623) req@ffff92a6072fb100 x1873929633504256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.157274:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb100 with x1873929633504256 ext(21721088->21786623) 00002000:00010000:1.0:1787119497.157280:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb100 00000100:00100000:1.0:1787119497.157304:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633504384 00000100:00100000:1.0:1787119497.157307:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633504384 00002000:00100000:1.0:1787119497.157322:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (393216->413695) req@ffff92a6072f9f80 x1873929633504384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119497.157325:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633504512 00000100:00100000:3.0:1787119497.157328:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633504512 00002000:00100000:1.0:1787119497.157330:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9f80 with x1873929633504384 ext(393216->413695) 00002000:00010000:1.0:1787119497.157334:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9f80 00002000:00100000:3.0:1787119497.157348:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x23:0x0] (3387392->3452927) req@ffff92a6072f9c00 x1873929633504512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.157357:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9c00 with x1873929633504512 ext(3387392->3452927) 00000100:00100000:1.0:1787119497.157357:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10464 00002000:00010000:3.0:1787119497.157360:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072f9c00 00000100:00100000:1.0:1787119497.157365:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633504256:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.157373:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10465 00000100:00100000:3.0:1787119497.157378:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633504384:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.157687:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10466 00000100:00100000:1.0:1787119497.157696:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2373:x1873929633504512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.158762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.159486:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633504640 00000100:00100000:0.0:1787119497.159496:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633504640 00002000:00100000:0.0:1787119497.159538:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (995328->1023999) req@ffff92a50512c380 x1873929633504640/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.159559:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c380 with x1873929633504640 ext(995328->1023999) 00002000:00010000:0.0:1787119497.159565:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512c380 00000100:00100000:0.0:1787119497.159602:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10467 00000100:00100000:0.0:1787119497.159611:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633504640:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119497.162790:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633504256:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5416us (5721us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119497.162815:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10464 00002000:00100000:0.0:1787119497.162827:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (21721088->21786623) req@ffff92a6072fb100 x1873929633504256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.162838:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb100 with x1873929633504256 ext(21721088->21786623) 00002000:00010000:0.0:1787119497.162844:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb100 00000100:00100000:0.0:1787119497.165158:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633504640:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 5538us (6391us total) trans 4294968920 rc 0/0 00000100:00100000:0.0:1787119497.165173:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10467 00002000:00100000:0.0:1787119497.165185:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (995328->1023999) req@ffff92a50512c380 x1873929633504640/t4294968920(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.165195:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c380 with x1873929633504640 ext(995328->1023999) 00002000:00010000:0.0:1787119497.165201:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a50512c380 00000100:00100000:0.0:1787119497.168181:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633504384:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 10792us (11058us total) trans 0 rc 20480/20480 00000100:00100000:0.0:1787119497.168195:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10465 00002000:00100000:0.0:1787119497.168208:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x21:0x0] (393216->413695) req@ffff92a6072f9f80 x1873929633504384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.168218:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9f80 with x1873929633504384 ext(393216->413695) 00002000:00010000:0.0:1787119497.168224:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9f80 00000100:00100000:1.0:1787119497.184840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.184876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.184906:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633504768 00000100:00100000:1.0:1787119497.184917:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633504768 00000100:00100000:1.0:1787119497.184966:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5093 00000100:00100000:1.0:1787119497.184976:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633504768:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119497.185179:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633504512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 27484us (28032us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119497.185188:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10466 00002000:00100000:3.0:1787119497.185199:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (3387392->3452927) req@ffff92a6072f9c00 x1873929633504512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.185209:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9c00 with x1873929633504512 ext(3387392->3452927) 00002000:00010000:3.0:1787119497.185215:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6072f9c00 00000100:00100000:3.0:1787119497.185231:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633504896 00000100:00100000:3.0:1787119497.185234:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633504896 00002000:00100000:3.0:1787119497.185254:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (59912192->59924479) req@ffff92a509135500 x1873929633504896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.185264:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135500 with x1873929633504896 ext(59912192->59924479) 00002000:00010000:3.0:1787119497.185267:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135500 00000100:00100000:3.0:1787119497.185291:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10468 00000100:00100000:3.0:1787119497.185306:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633504896:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.185712:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633504896:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 413us (833us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1787119497.185719:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10468 00002000:00100000:3.0:1787119497.185726:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (59912192->59924479) req@ffff92a509135500 x1873929633504896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/12728 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.185734:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135500 with x1873929633504896 ext(59912192->59924479) 00002000:00010000:3.0:1787119497.185737:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135500 00010000:00010000:0.0:1787119497.186575:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119497.197666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.197696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.197716:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.199781:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633505024 00000100:00100000:2.0:1787119497.199795:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633505024 00000100:00100000:3.0:1787119497.199801:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633505280 00000100:00100000:3.0:1787119497.199805:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633505280 00002000:00100000:3.0:1787119497.199852:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (3407872->3440639) req@ffff92a509135880 x1873929633505280/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.199864:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135880 with x1873929633505280 ext(3407872->3440639) 00002000:00010000:3.0:1787119497.199870:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509135880 00000100:00100000:3.0:1787119497.199891:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633505152 00000100:00100000:3.0:1787119497.199894:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633505152 00002000:00100000:3.0:1787119497.199912:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x22:0x0] (41320448->41332735) req@ffff92a509137b80 x1873929633505152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.199920:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509137b80 with x1873929633505152 ext(41320448->41332735) 00002000:00010000:3.0:1787119497.199923:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509137b80 00000100:00100000:3.0:1787119497.199942:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10469 00000100:00100000:3.0:1787119497.199950:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633505280:12345-192.168.201.59@tcp:4:fsx.0 00002000:00100000:2.0:1787119497.199953:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x21:0x0] (29409280->29413375) req@ffff92a509135f80 x1873929633505024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.199960:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135f80 with x1873929633505024 ext(29409280->29413375) 00002000:00010000:2.0:1787119497.199963:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135f80 00000100:00100000:2.0:1787119497.199980:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10470 00000100:00100000:2.0:1787119497.199986:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633505152:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.200106:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10471 00000100:00100000:3.0:1787119497.200114:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633505024:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.200167:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633505152:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 179us (2448us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119497.200174:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10470 00002000:00100000:2.0:1787119497.200180:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (41320448->41332735) req@ffff92a509137b80 x1873929633505152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/12728 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.200188:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509137b80 with x1873929633505152 ext(41320448->41332735) 00002000:00010000:2.0:1787119497.200192:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509137b80 00000100:00100000:3.0:1787119497.200218:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633505024:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 103us (2561us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.200225:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10471 00002000:00100000:3.0:1787119497.200230:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (29409280->29413375) req@ffff92a509135f80 x1873929633505024/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.200237:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135f80 with x1873929633505024 ext(29409280->29413375) 00002000:00010000:3.0:1787119497.200240:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135f80 00000100:00100000:0.0:1787119497.208715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.209482:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633505280:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 9528us (11780us total) trans 4294968921 rc 0/0 00000100:00100000:3.0:1787119497.209493:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10469 00002000:00100000:3.0:1787119497.209507:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x23:0x0] (3407872->3440639) req@ffff92a509135880 x1873929633505280/t4294968921(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.209517:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135880 with x1873929633505280 ext(3407872->3440639) 00002000:00010000:3.0:1787119497.209523:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a509135880 00000100:00100000:3.0:1787119497.209548:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633505408 00000100:00100000:3.0:1787119497.209554:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633505408 00002000:00100000:3.0:1787119497.209584:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (29433856->29437951) req@ffff92a6072faa00 x1873929633505408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.209593:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072faa00 with x1873929633505408 ext(29433856->29437951) 00002000:00010000:3.0:1787119497.209597:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072faa00 00000100:00100000:3.0:1787119497.209616:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10472 00000100:00100000:3.0:1787119497.209624:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633505408:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.209767:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633505408:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 143us (1062us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.209775:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10472 00002000:00100000:3.0:1787119497.209781:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (29433856->29437951) req@ffff92a6072faa00 x1873929633505408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.209789:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072faa00 with x1873929633505408 ext(29433856->29437951) 00002000:00010000:3.0:1787119497.209792:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072faa00 00000100:00100000:0.0:1787119497.216390:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.216422:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633505536 00000100:00100000:0.0:1787119497.216465:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633505536 00002000:00100000:0.0:1787119497.216512:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (60612608->60616703) req@ffff92a6072fb480 x1873929633505536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.216524:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb480 with x1873929633505536 ext(60612608->60616703) 00002000:00010000:0.0:1787119497.216530:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb480 00000100:00100000:0.0:1787119497.216567:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10473 00000100:00100000:0.0:1787119497.216577:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633505536:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.216811:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633505536:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 234us (430us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.216819:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10473 00002000:00100000:0.0:1787119497.216826:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (60612608->60616703) req@ffff92a6072fb480 x1873929633505536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.216835:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb480 with x1873929633505536 ext(60612608->60616703) 00002000:00010000:0.0:1787119497.216838:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb480 00000100:00100000:2.0:1787119497.221386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.222351:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633505664 00000100:00100000:3.0:1787119497.222364:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633505664 00000100:00100000:3.0:1787119497.222417:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5094 00000100:00100000:3.0:1787119497.222427:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633505664:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:0.0:1787119497.226144:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633502848:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 136715us (144009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119497.226158:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5092 00000001:00080000:2.0:1787119497.226596:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969196 is committed 00000100:00100000:0.0:1787119497.227350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.227673:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633505792 00000100:00100000:1.0:1787119497.227684:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633505792 00002000:00100000:1.0:1787119497.227730:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (21741568->21745663) req@ffff92a6072f9500 x1873929633505792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.227740:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9500 with x1873929633505792 ext(21741568->21745663) 00002000:00010000:1.0:1787119497.227745:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9500 00000100:00100000:1.0:1787119497.227775:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10474 00000100:00100000:1.0:1787119497.227784:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633505792:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.227973:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633505792:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 189us (626us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119497.227981:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10474 00002000:00100000:1.0:1787119497.227987:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (21741568->21745663) req@ffff92a6072f9500 x1873929633505792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.227995:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9500 with x1873929633505792 ext(21741568->21745663) 00002000:00010000:1.0:1787119497.227998:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f9500 00000100:00100000:1.0:1787119497.234590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.234624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.235048:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633505920 00000100:00100000:2.0:1787119497.235058:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633505920 00002000:00100000:2.0:1787119497.235104:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (60616704->60620799) req@ffff92a506155500 x1873929633505920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.235114:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155500 with x1873929633505920 ext(60616704->60620799) 00002000:00010000:2.0:1787119497.235120:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155500 00000100:00100000:2.0:1787119497.235143:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633506048 00000100:00100000:2.0:1787119497.235146:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633506048 00002000:00100000:2.0:1787119497.235158:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (21745664->21749759) req@ffff92a506155880 x1873929633506048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.235166:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155880 with x1873929633506048 ext(21745664->21749759) 00002000:00010000:2.0:1787119497.235170:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155880 00000100:00100000:2.0:1787119497.235184:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10475 00000100:00100000:2.0:1787119497.235192:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633505920:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.235486:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633505920:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 293us (903us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119497.235495:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10475 00002000:00100000:2.0:1787119497.235502:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (60616704->60620799) req@ffff92a506155500 x1873929633505920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.235509:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155500 with x1873929633505920 ext(60616704->60620799) 00002000:00010000:2.0:1787119497.235513:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155500 00000100:00100000:2.0:1787119497.235530:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10476 00000100:00100000:2.0:1787119497.235537:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633506048:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.235625:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633506048:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 87us (999us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119497.235632:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10476 00002000:00100000:2.0:1787119497.235637:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (21745664->21749759) req@ffff92a506155880 x1873929633506048/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.235645:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155880 with x1873929633506048 ext(21745664->21749759) 00002000:00010000:2.0:1787119497.235648:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506155880 00000100:00100000:3.0:1787119497.238727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.243076:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633506176 00000100:00100000:3.0:1787119497.243091:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633506176 00002000:00100000:3.0:1787119497.243146:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (10141696->10145791) req@ffff92a50512ea00 x1873929633506176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.243158:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ea00 with x1873929633506176 ext(10141696->10145791) 00002000:00010000:3.0:1787119497.243164:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ea00 00000100:00100000:3.0:1787119497.243193:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10477 00000100:00100000:3.0:1787119497.243203:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633506176:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.244920:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633506176:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1708us (6193us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.244933:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10477 00002000:00100000:3.0:1787119497.244946:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (10141696->10145791) req@ffff92a50512ea00 x1873929633506176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.244957:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ea00 with x1873929633506176 ext(10141696->10145791) 00002000:00010000:3.0:1787119497.244963:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ea00 00000100:00100000:0.0:1787119497.245135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.245461:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633506304 00000100:00100000:3.0:1787119497.245470:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633506304 00002000:00100000:3.0:1787119497.245504:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (60592128->60657663) req@ffff92a6072f8700 x1873929633506304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.245512:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8700 with x1873929633506304 ext(60592128->60657663) 00002000:00010000:3.0:1787119497.245516:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8700 00000100:00100000:3.0:1787119497.245549:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10478 00000100:00100000:3.0:1787119497.245558:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633506304:12345-192.168.201.59@tcp:3:fsx.0 00000001:00080000:3.0:1787119497.249137:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968920 is committed 00000100:00100000:0.0:1787119497.249518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.252151:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633506432 00000100:00100000:3.0:1787119497.252167:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633506432 00002000:00100000:3.0:1787119497.252220:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (21721088->21786623) req@ffff92a6072f8e00 x1873929633506432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.252232:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8e00 with x1873929633506432 ext(21721088->21786623) 00002000:00010000:3.0:1787119497.252238:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8e00 00000100:00100000:3.0:1787119497.252272:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10479 00000100:00100000:3.0:1787119497.252282:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633506432:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.253406:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633504768:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 68425us (68570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119497.253418:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5093 00000100:00100000:0.0:1787119497.265414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.265481:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633506560 00000100:00100000:0.0:1787119497.265492:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633506560 00002000:00100000:0.0:1787119497.265542:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (10145792->10149887) req@ffff92a511630700 x1873929633506560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.265554:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630700 with x1873929633506560 ext(10145792->10149887) 00002000:00010000:0.0:1787119497.265560:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511630700 00000100:00100000:0.0:1787119497.265587:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10480 00000100:00100000:0.0:1787119497.265596:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633506560:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.265840:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633506560:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 244us (435us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.265848:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10480 00002000:00100000:0.0:1787119497.265855:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (10145792->10149887) req@ffff92a511630700 x1873929633506560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.265862:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630700 with x1873929633506560 ext(10145792->10149887) 00002000:00010000:0.0:1787119497.265866:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511630700 00000100:00100000:2.0:1787119497.266275:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633506304:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20716us (21139us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119497.266283:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10478 00002000:00100000:2.0:1787119497.266289:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x22:0x0] (60592128->60657663) req@ffff92a6072f8700 x1873929633506304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.266310:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8700 with x1873929633506304 ext(60592128->60657663) 00002000:00010000:2.0:1787119497.266314:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8700 00000100:00100000:1.0:1787119497.270002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.271456:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633506816 00000100:00100000:1.0:1787119497.271470:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633506816 00000100:00100000:1.0:1787119497.271519:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 204 00000100:00100000:1.0:1787119497.271528:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6080bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+210:32724:x1873929633506816:12345-192.168.201.59@tcp:35:fsx.0 00000100:00100000:1.0:1787119497.272186:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6080bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+211:32724:x1873929633506816:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 655us (2192us total) trans 4294976540 rc 0/0 00000100:00100000:1.0:1787119497.272197:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 204 00000100:00100000:1.0:1787119497.272902:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633506432:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 20619us (23385us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119497.272912:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10479 00002000:00100000:1.0:1787119497.272924:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (21721088->21786623) req@ffff92a6072f8e00 x1873929633506432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.272934:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8e00 with x1873929633506432 ext(21721088->21786623) 00002000:00010000:1.0:1787119497.272940:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8e00 00000100:00100000:0.0:1787119497.273329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.276735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.277250:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633506944 00000100:00100000:0.0:1787119497.277260:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633506944 00002000:00100000:0.0:1787119497.277368:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (10121216->10186751) req@ffff92a511631c00 x1873929633506944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.277380:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631c00 with x1873929633506944 ext(10121216->10186751) 00002000:00010000:0.0:1787119497.277387:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511631c00 00000100:00100000:0.0:1787119497.277613:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633507072 00000100:00100000:0.0:1787119497.277627:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633507072 00002000:00100000:0.0:1787119497.277646:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (29409280->60633087) req@ffff92a50512d500 x1873929633507072/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.277655:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633507072 ext(29409280->60633087) 00002000:00010000:0.0:1787119497.277660:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d500 00000100:00100000:3.0:1787119497.280907:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10481 00000100:00100000:3.0:1787119497.280931:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633506944:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.288092:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10482 00000100:00100000:2.0:1787119497.288123:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633507072:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119497.288489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.288571:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633507200 00000100:00100000:2.0:1787119497.288579:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633507200 00002000:00100000:2.0:1787119497.288616:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (59912192->59924479) req@ffff92a5066df100 x1873929633507200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.288628:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df100 with x1873929633507200 ext(59912192->59924479) 00002000:00010000:2.0:1787119497.288634:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df100 00000100:00100000:2.0:1787119497.288655:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10483 00000100:00100000:2.0:1787119497.288662:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633507200:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.288884:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633507200:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 221us (395us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119497.288893:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10483 00002000:00100000:2.0:1787119497.288900:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (59912192->59924479) req@ffff92a5066df100 x1873929633507200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/12728 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.288908:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df100 with x1873929633507200 ext(59912192->59924479) 00002000:00010000:2.0:1787119497.288912:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df100 00000100:00100000:0.0:1787119497.294772:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633506944:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13840us (21432us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119497.294788:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10481 00002000:00100000:0.0:1787119497.294800:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (10121216->10186751) req@ffff92a511631c00 x1873929633506944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.294810:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631c00 with x1873929633506944 ext(10121216->10186751) 00002000:00010000:0.0:1787119497.294815:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511631c00 00000100:00100000:2.0:1787119497.296116:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633507072:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 8001us (19383us total) trans 4294969197 rc 0/0 00000100:00100000:2.0:1787119497.296129:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10482 00002000:00100000:2.0:1787119497.296139:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (29409280->60633087) req@ffff92a50512d500 x1873929633507072/t4294969197(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.296151:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633507072 ext(29409280->60633087) 00002000:00010000:2.0:1787119497.296157:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d500 00000100:00100000:1.0:1787119497.299228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.299270:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633507328 00000100:00100000:1.0:1787119497.299281:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633507328 00002000:00100000:1.0:1787119497.299334:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (41320448->41332735) req@ffff92a506157100 x1873929633507328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.299346:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157100 with x1873929633507328 ext(41320448->41332735) 00002000:00010000:1.0:1787119497.299351:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506157100 00000100:00100000:1.0:1787119497.299392:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10484 00000100:00100000:1.0:1787119497.299403:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633507328:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.299779:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633507328:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 376us (565us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119497.299788:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10484 00002000:00100000:1.0:1787119497.299794:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (41320448->41332735) req@ffff92a506157100 x1873929633507328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/12728 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.299803:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506157100 with x1873929633507328 ext(41320448->41332735) 00002000:00010000:1.0:1787119497.299806:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506157100 00000001:00080000:1.0:1787119497.308607:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968921 is committed 00000100:00100000:3.0:1787119497.310421:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633505664:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 87986us (89036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.310480:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5094 00000100:00100000:3.0:1787119497.314628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.314747:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633507456 00000100:00100000:2.0:1787119497.314759:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633507456 00002000:00100000:2.0:1787119497.314811:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (60612608->60616703) req@ffff92a63dc07800 x1873929633507456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.314822:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07800 with x1873929633507456 ext(60612608->60616703) 00002000:00010000:2.0:1787119497.314827:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07800 00000100:00100000:2.0:1787119497.314866:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10485 00000100:00100000:2.0:1787119497.314874:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633507456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.315154:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633507456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 279us (536us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119497.315161:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10485 00002000:00100000:2.0:1787119497.315168:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (60612608->60616703) req@ffff92a63dc07800 x1873929633507456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.315176:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07800 with x1873929633507456 ext(60612608->60616703) 00002000:00010000:2.0:1787119497.315180:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07800 00000100:00100000:1.0:1787119497.318767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.319758:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633507584 00000100:00100000:2.0:1787119497.319772:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633507584 00002000:00100000:2.0:1787119497.319825:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (17801216->17817599) req@ffff92a506156d80 x1873929633507584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.319837:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156d80 with x1873929633507584 ext(17801216->17817599) 00002000:00010000:2.0:1787119497.319843:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156d80 00000100:00100000:2.0:1787119497.319884:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10486 00000100:00100000:2.0:1787119497.319894:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633507584:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.320217:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633507584:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 322us (1459us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787119497.320226:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10486 00002000:00100000:2.0:1787119497.320233:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (17801216->17817599) req@ffff92a506156d80 x1873929633507584/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/16824 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.320241:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156d80 with x1873929633507584 ext(17801216->17817599) 00002000:00010000:2.0:1787119497.320245:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156d80 00000100:00100000:3.0:1787119497.324152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.324268:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633507840 00000100:00100000:0.0:1787119497.324278:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633507840 00000100:00100000:0.0:1787119497.324342:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19727 00000100:00100000:0.0:1787119497.324353:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+211:32720:x1873929633507840:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119497.324413:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119497.324488:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fb400/0xcaba3de8463e3498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e1e expref: 211 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.324512:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:0.0:1787119497.324517:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119497.324741:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.324756:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.324767:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119497.324818:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976541 00000004:00010000:0.0:1787119497.324842:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aac833dd reply state 0000000013e75c9d transno 4294976542 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119497.324851:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119497.324950:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+213:32720:x1873929633507840:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 599us (812us total) trans 4294976542 rc 0/0 00000100:00100000:0.0:1787119497.324957:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19727 00000020:00080000:0.0:1787119497.324963:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119497.327368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.327966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.328103:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633507968 00000100:00100000:2.0:1787119497.328110:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633508096 00000100:00100000:2.0:1787119497.328115:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633508096 00000100:00100000:0.0:1787119497.328115:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633507968 00000100:00100000:2.0:1787119497.328170:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5095 00000100:00100000:2.0:1787119497.328180:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:32724:x1873929633508096:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119497.328198:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119497.328202:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.328216:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe247cf3/0xcaba3de8463e34a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e25 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.328222:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.328228:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.328234:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6038fa600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119497.328238:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.328245:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.328247:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015a72833/0xcaba3de8463df345 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204714837 expref: 10 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.328261:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=41s v=(0 0) 00010000:00010000:1.0:1787119497.328262:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:1.0:1787119497.328264:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119497.328265:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119497.328269:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.328270:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe247cf3/0xcaba3de8463e34a6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e25 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.328276:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa600/0xcaba3de8463e349f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.328304:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015a72833/0xcaba3de8463df345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204714837 expref: 10 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.328330:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015a72833/0xcaba3de8463df345 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714837 expref: 10 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119497.328345:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1873929653567232:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119497.328474:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61819d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119497.328970:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5096 00000100:00100000:0.0:1787119497.328982:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633507968:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119497.331467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.333177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.333301:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633508224 00000100:00100000:0.0:1787119497.333312:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633508224 00002000:00010000:0.0:1787119497.333354:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (25582583->18446744073709551615) 00002000:00100000:0.0:1787119497.333359:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07100 with x1873929633508224 ext(25582583->18446744073709551615) 00002000:00010000:0.0:1787119497.333374:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc07100. 00000100:00100000:2.0:1787119497.333400:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1873929653567232:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119497.333454:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe247cf3/0xcaba3de8463e34a6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e25 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.333476:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:3.0:1787119497.333493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.333539:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:32724:x1873929633508096:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 5360us (5574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119497.333548:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5095 00000100:00100000:3.0:1787119497.333810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.333915:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633508352 00000100:00100000:3.0:1787119497.333919:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633508352 00002000:00100000:3.0:1787119497.333945:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x23:0x0] (43814912->43819007) req@ffff92a63dc04e00 x1873929633508352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.333955:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04e00 with x1873929633508352 ext(43814912->43819007) 00002000:00010000:3.0:1787119497.333960:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04e00 00000100:00100000:1.0:1787119497.333965:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633508480 00000100:00100000:1.0:1787119497.333969:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633508480 00000100:00100000:3.0:1787119497.333985:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10487 00000100:00100000:3.0:1787119497.333996:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633508352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.334116:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633508608 00000100:00100000:2.0:1787119497.334120:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633508608 00000100:00100000:0.0:1787119497.334135:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10488 00010000:00010000:2.0:1787119497.334139:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015a72833/0xcaba3de8463df345 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714837 expref: 11 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119497.334142:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633508224:12345-192.168.201.59@tcp:10:fsx.0 00000100:00100000:2.0:1787119497.334164:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5200 00000100:00100000:2.0:1787119497.334169:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633508608:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119497.334179:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119497.334195:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015a72833/0xcaba3de8463df345 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714837 expref: 11 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.334221:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015a72833/0xcaba3de8463df345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714837 expref: 11 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.334246:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015a72833/0xcaba3de8463df345 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714837 expref: 11 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.334259:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119497.334263:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119497.334271:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe247cf3/0xcaba3de8463e34a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e25 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.334283:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe247cf3/0xcaba3de8463e34a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e25 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.334318:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fe247cf3/0xcaba3de8463e34a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e25 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119497.334332:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:20609:1873929653567360:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119497.334394:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61819d6c0 going to sleep for 11 seconds 00002000:00010000:0.0:1787119497.334530:0:20836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 54126883 -> 25582583 00002000:00010000:0.0:1787119497.334534:0:20836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119497.334548:0:20836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119495 -> 1787119495 00002000:00100000:1.0:1787119497.334550:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (60616704->60620799) req@ffff92a63dc04380 x1873929633508480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00010000:0.0:1787119497.334551:0:20836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119495 -> 1787119495 00002000:00010000:0.0:1787119497.334553:0:20836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1807 -> 1549 00002000:00100000:1.0:1787119497.334558:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04380 with x1873929633508480 ext(60616704->60620799) 00002000:00010000:1.0:1787119497.334562:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04380 00000100:00100000:0.0:1787119497.334578:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633508224:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 436us (3154us total) trans 4294968922 rc 0/0 00000100:00100000:0.0:1787119497.334585:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10488 00002000:00010000:0.0:1787119497.334589:0:20836:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/35 (25582583->18446744073709551615) 00002000:00100000:0.0:1787119497.334591:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07100 with x1873929633508224 ext(25582583->18446744073709551615) 00002000:00010000:0.0:1787119497.334596:0:20836:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc07100. 00000100:00100000:1.0:1787119497.334616:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10489 00000100:00100000:1.0:1787119497.334623:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633508480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.334794:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633508480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 171us (1300us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119497.334802:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10489 00002000:00100000:1.0:1787119497.334808:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (60616704->60620799) req@ffff92a63dc04380 x1873929633508480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.334816:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04380 with x1873929633508480 ext(60616704->60620799) 00002000:00010000:1.0:1787119497.334819:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04380 00000100:00100000:3.0:1787119497.335259:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633508352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1263us (2239us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.335268:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10487 00002000:00100000:3.0:1787119497.335274:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (43814912->43819007) req@ffff92a63dc04e00 x1873929633508352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.335283:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04e00 with x1873929633508352 ext(43814912->43819007) 00002000:00010000:3.0:1787119497.335287:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04e00 00000100:00100000:2.0:1787119497.338165:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:20609:1873929653567360:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119497.338192:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119497.338238:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633508608:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4067us (4427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119497.338249:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5200 00000100:00100000:1.0:1787119497.344332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.344366:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633508864 00000100:00100000:1.0:1787119497.344375:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633508864 00000100:00100000:1.0:1787119497.344422:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 205 00000100:00100000:1.0:1787119497.344466:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+212:32724:x1873929633508864:12345-192.168.201.59@tcp:35:fsx.0 00000001:00080000:1.0:1787119497.344765:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976543 00000100:00100000:1.0:1787119497.344868:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+214:32724:x1873929633508864:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 436us (542us total) trans 4294976544 rc 0/0 00000100:00100000:1.0:1787119497.344880:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 205 00000020:00080000:1.0:1787119497.344884:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119497.345901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.345932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.345965:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633509120 00000100:00100000:0.0:1787119497.345973:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633509120 00002000:00100000:0.0:1787119497.346012:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (60592128->60657663) req@ffff92a63414b480 x1873929633509120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.346235:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414b480 with x1873929633509120 ext(60592128->60657663) 00002000:00010000:0.0:1787119497.346243:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414b480 00000100:00100000:0.0:1787119497.346322:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10490 00000100:00100000:0.0:1787119497.346332:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633509120:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.346578:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633508992 00000100:00100000:2.0:1787119497.346582:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633508992 00000100:00100000:2.0:1787119497.346622:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19728 00000100:00100000:2.0:1787119497.346631:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+214:32720:x1873929633508992:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:2.0:1787119497.346643:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119497.346665:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e34ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e2c expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.346734:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e34b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.346749:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e34b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.346759:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e34b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119497.346785:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 25582583 00000004:00200000:2.0:1787119497.346790:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119497.346807:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e34b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.346832:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e34ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e2c expref: 216 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.346851:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93600/0xcaba3de8463e34b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e2c expref: 215 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.346860:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff92a60ccca200) 00010000:00010000:2.0:1787119497.346863:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119497.346867:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93600, rc 0) 00000100:00100000:2.0:1787119497.347118:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+215:32720:x1873929633508992:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 487us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119497.347125:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19728 00000100:00100000:0.0:1787119497.350494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.351872:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633509376 00000100:00100000:1.0:1787119497.351884:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633509376 00000100:00100000:1.0:1787119497.351935:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 206 00000100:00100000:1.0:1787119497.351944:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+215:32724:x1873929633509376:12345-192.168.201.59@tcp:35:fsx.0 00000100:00100000:2.0:1787119497.352251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.352310:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+216:32724:x1873929633509376:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 366us (1825us total) trans 4294976545 rc 0/0 00000100:00100000:3.0:1787119497.352316:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633509504 00000100:00100000:1.0:1787119497.352318:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 206 00000100:00100000:3.0:1787119497.352321:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633509504 00002000:00100000:3.0:1787119497.352350:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (43819008->43823103) req@ffff92a5066dfb80 x1873929633509504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.352360:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dfb80 with x1873929633509504 ext(43819008->43823103) 00002000:00010000:3.0:1787119497.352366:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dfb80 00000100:00100000:3.0:1787119497.352390:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10491 00000100:00100000:3.0:1787119497.352397:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633509504:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.357870:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633509120:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11529us (11925us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119497.357885:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10490 00002000:00100000:0.0:1787119497.357898:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x21:0x0] (60592128->60657663) req@ffff92a63414b480 x1873929633509120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.357909:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414b480 with x1873929633509120 ext(60592128->60657663) 00002000:00010000:0.0:1787119497.357915:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414b480 00000100:00100000:3.0:1787119497.360885:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633509504:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 8476us (8623us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.360899:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10491 00002000:00100000:3.0:1787119497.360910:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (43819008->43823103) req@ffff92a5066dfb80 x1873929633509504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.360920:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dfb80 with x1873929633509504 ext(43819008->43823103) 00002000:00010000:3.0:1787119497.360926:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dfb80 00000100:00100000:2.0:1787119497.361105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.363389:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633509632 00000100:00100000:3.0:1787119497.363405:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633509632 00002000:00100000:3.0:1787119497.363772:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (8941568->8945663) req@ffff92a5066ded80 x1873929633509632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.363785:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633509632 ext(8941568->8945663) 00002000:00010000:3.0:1787119497.363791:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066ded80 00000100:00100000:3.0:1787119497.363823:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10492 00000100:00100000:3.0:1787119497.363833:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633509632:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.365683:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633509632:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1843us (4569us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.365697:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10492 00002000:00100000:3.0:1787119497.365707:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (8941568->8945663) req@ffff92a5066ded80 x1873929633509632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.365717:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633509632 ext(8941568->8945663) 00002000:00010000:3.0:1787119497.365723:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066ded80 00000100:00100000:0.0:1787119497.365832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.365865:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.365887:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633509760 00000100:00100000:0.0:1787119497.365895:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633509760 00002000:00100000:0.0:1787119497.365927:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (43794432->43859967) req@ffff92a511632680 x1873929633509760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.365936:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632680 with x1873929633509760 ext(43794432->43859967) 00002000:00010000:0.0:1787119497.365940:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511632680 00000100:00100000:0.0:1787119497.365963:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633509888 00000100:00100000:0.0:1787119497.365966:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633509888 00002000:00100000:0.0:1787119497.365983:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (29409280->60633087) req@ffff92a511633800 x1873929633509888/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.365991:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633800 with x1873929633509888 ext(29409280->60633087) 00002000:00010000:0.0:1787119497.365994:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511633800 00000100:00100000:2.0:1787119497.366002:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10493 00000100:00100000:0.0:1787119497.366009:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10494 00000100:00100000:2.0:1787119497.366011:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633509760:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.366015:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633509888:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119497.368727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.369779:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633510016 00000100:00100000:1.0:1787119497.369792:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633510016 00002000:00100000:1.0:1787119497.369847:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (8945664->8949759) req@ffff92a511631f80 x1873929633510016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.369859:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631f80 with x1873929633510016 ext(8945664->8949759) 00002000:00010000:1.0:1787119497.369865:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511631f80 00000100:00100000:1.0:1787119497.369890:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10495 00000100:00100000:1.0:1787119497.369900:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633510016:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.370230:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633510016:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 330us (1514us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119497.370238:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10495 00002000:00100000:1.0:1787119497.370245:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (8945664->8949759) req@ffff92a511631f80 x1873929633510016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.370260:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631f80 with x1873929633510016 ext(8945664->8949759) 00002000:00010000:1.0:1787119497.370263:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511631f80 00000100:00100000:3.0:1787119497.371258:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633509760:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5238us (5417us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119497.371269:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10493 00002000:00100000:3.0:1787119497.371278:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (43794432->43859967) req@ffff92a511632680 x1873929633509760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.371286:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632680 with x1873929633509760 ext(43794432->43859967) 00002000:00010000:3.0:1787119497.371291:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511632680 00000100:00100000:0.0:1787119497.371664:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633509888:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 5646us (5795us total) trans 4294969198 rc 0/0 00000100:00100000:0.0:1787119497.371677:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10494 00002000:00100000:0.0:1787119497.371684:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (29409280->60633087) req@ffff92a511633800 x1873929633509888/t4294969198(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.371693:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633800 with x1873929633509888 ext(29409280->60633087) 00002000:00010000:0.0:1787119497.371697:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511633800 00000100:00100000:0.0:1787119497.372842:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633507968:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 43858us (45479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119497.372854:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5096 00000001:00080000:3.0:1787119497.373262:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969197 is committed 00000100:00100000:0.0:1787119497.374823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.374948:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633510144 00000100:00100000:3.0:1787119497.374958:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633510144 00002000:00100000:3.0:1787119497.375012:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (8921088->8986623) req@ffff92a511631500 x1873929633510144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.375030:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633510144 ext(8921088->8986623) 00002000:00010000:3.0:1787119497.375036:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511631500 00000100:00100000:3.0:1787119497.375103:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10496 00000100:00100000:3.0:1787119497.375113:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633510144:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.379170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.379239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.379255:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633510272 00000100:00100000:0.0:1787119497.379264:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633510272 00002000:00100000:0.0:1787119497.379309:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (62857216->62881791) req@ffff92a63dc05880 x1873929633510272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.379320:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05880 with x1873929633510272 ext(62857216->62881791) 00002000:00010000:0.0:1787119497.379326:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05880 00000100:00100000:0.0:1787119497.379362:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10497 00000100:00100000:0.0:1787119497.379370:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633510272:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.379727:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633510400 00000100:00100000:0.0:1787119497.379732:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633510400 00000100:00100000:0.0:1787119497.379762:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5097 00000100:00100000:0.0:1787119497.379769:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633510400:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119497.381711:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633510144:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6591us (6889us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119497.381724:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10496 00002000:00100000:3.0:1787119497.381736:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x23:0x0] (8921088->8986623) req@ffff92a511631500 x1873929633510144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.381746:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633510144 ext(8921088->8986623) 00002000:00010000:3.0:1787119497.381752:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511631500 00000100:00100000:3.0:1787119497.381872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.381919:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633510528 00000100:00100000:0.0:1787119497.381927:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633510528 00002000:00100000:0.0:1787119497.381960:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (43814912->43839487) req@ffff92a63dc04000 x1873929633510528/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.381968:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633510528 ext(43814912->43839487) 00002000:00010000:0.0:1787119497.381972:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04000 00000100:00100000:0.0:1787119497.382155:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10498 00000100:00100000:0.0:1787119497.382164:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633510528:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119497.386265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.386496:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633510656 00000100:00100000:3.0:1787119497.386508:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633510656 00002000:00100000:3.0:1787119497.386557:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (7327744->7376895) req@ffff92a63dc05f80 x1873929633510656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.386568:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633510656 ext(7327744->7376895) 00002000:00010000:3.0:1787119497.386573:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05f80 00000100:00100000:3.0:1787119497.386601:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10499 00000100:00100000:3.0:1787119497.386610:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633510656:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.386802:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633510272:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7431us (7640us total) trans 0 rc 24576/24576 00000100:00100000:0.0:1787119497.386811:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10497 00002000:00100000:0.0:1787119497.386817:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x22:0x0] (62857216->62881791) req@ffff92a63dc05880 x1873929633510272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.386826:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05880 with x1873929633510272 ext(62857216->62881791) 00002000:00010000:0.0:1787119497.386829:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05880 00000100:00100000:0.0:1787119497.390083:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633510528:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 7911us (8200us total) trans 4294969199 rc 0/0 00000100:00100000:0.0:1787119497.390098:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10498 00002000:00100000:0.0:1787119497.390112:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (43814912->43839487) req@ffff92a63dc04000 x1873929633510528/t4294969199(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.390123:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633510528 ext(43814912->43839487) 00002000:00010000:0.0:1787119497.390129:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04000 00000100:00100000:3.0:1787119497.390698:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633510656:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4087us (4440us total) trans 0 rc 49152/49152 00000100:00100000:3.0:1787119497.390708:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10499 00002000:00100000:3.0:1787119497.390715:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x23:0x0] (7327744->7376895) req@ffff92a63dc05f80 x1873929633510656/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.390724:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633510656 ext(7327744->7376895) 00002000:00010000:3.0:1787119497.390729:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc05f80 00000100:00100000:0.0:1787119497.394113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.394320:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633510912 00000100:00100000:3.0:1787119497.394332:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633510912 00000100:00100000:3.0:1787119497.394395:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5098 00000100:00100000:3.0:1787119497.394405:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633510912:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119497.396203:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.397380:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633511040 00000100:00100000:1.0:1787119497.397392:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633511040 00000100:00100000:1.0:1787119497.397725:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19729 00000100:00100000:1.0:1787119497.397736:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+216:32728:x1873929633511040:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:1.0:1787119497.397793:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119497.397822:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6038fa800/0xcaba3de8463e3413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ded expref: 216 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.397843:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:1.0:1787119497.397849:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119497.398908:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.398926:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.398937:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119497.398996:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976546 00000004:00010000:1.0:1787119497.399023:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009941f60f reply state 00000000293d04a4 transno 4294976547 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119497.399032:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119497.399133:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+218:32728:x1873929633511040:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1397us (2936us total) trans 4294976547 rc 0/0 00000100:00100000:1.0:1787119497.399145:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19729 00000020:00080000:1.0:1787119497.399151:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119497.404416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.404494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.406708:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633511168 00000100:00100000:0.0:1787119497.406723:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633511168 00002000:00100000:0.0:1787119497.406774:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (995328->999423) req@ffff92a511632300 x1873929633511168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.406787:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632300 with x1873929633511168 ext(995328->999423) 00002000:00010000:0.0:1787119497.406793:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511632300 00000100:00100000:0.0:1787119497.406852:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633511296 00000100:00100000:0.0:1787119497.406856:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633511296 00002000:00010000:0.0:1787119497.406868:0:18579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (54126883->18446744073709551615) 00002000:00100000:0.0:1787119497.406872:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633480 with x1873929633511296 ext(54126883->18446744073709551615) 00002000:00010000:0.0:1787119497.406881:0:18579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511633480. 00010000:00010000:3.0:1787119497.406969:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.406979:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.406986:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.406993:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119497.406998:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.407005:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.407022:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119497.407025:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119497.407029:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.407034:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e34bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119497.407080:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10500 00000100:00100000:2.0:1787119497.407090:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633511168:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.407343:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633511168:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 254us (2937us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119497.407352:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10500 00002000:00100000:2.0:1787119497.407359:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x23:0x0] (995328->999423) req@ffff92a511632300 x1873929633511168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.407367:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632300 with x1873929633511168 ext(995328->999423) 00002000:00010000:2.0:1787119497.407370:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511632300 00000100:00100000:2.0:1787119497.407388:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10501 00000100:00100000:2.0:1787119497.407395:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633511296:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:2.0:1787119497.407696:0:19242:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 64600736 -> 54126883 00002000:00010000:2.0:1787119497.407701:0:19242:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119495 -> 1787119496 00002000:00010000:2.0:1787119497.407703:0:19242:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119492 -> 1787119495 00002000:00010000:2.0:1787119497.407705:0:19242:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119495 -> 1787119496 00002000:00010000:2.0:1787119497.407707:0:19242:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2959 -> 1807 00000100:00100000:2.0:1787119497.407737:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633511296:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 341us (3243us total) trans 4294969200 rc 0/0 00000100:00100000:2.0:1787119497.407744:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10501 00002000:00010000:2.0:1787119497.407748:0:19242:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (54126883->18446744073709551615) 00002000:00100000:2.0:1787119497.407751:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633480 with x1873929633511296 ext(54126883->18446744073709551615) 00002000:00010000:2.0:1787119497.407756:0:19242:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511633480. 00000001:00080000:1.0:1787119497.412290:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976542 is committed 00000001:00080000:1.0:1787119497.413158:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976545 is committed 00000100:00100000:0.0:1787119497.415531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.415600:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633511424 00000100:00100000:1.0:1787119497.415610:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633511424 00002000:00100000:1.0:1787119497.416110:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (999424->1003519) req@ffff92a511633b80 x1873929633511424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.416121:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633b80 with x1873929633511424 ext(999424->1003519) 00002000:00010000:1.0:1787119497.416137:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633b80 00000100:00100000:1.0:1787119497.416169:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10502 00000100:00100000:1.0:1787119497.416178:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633511424:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.416612:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633511424:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 434us (1089us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119497.416627:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10502 00002000:00100000:1.0:1787119497.416635:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x23:0x0] (999424->1003519) req@ffff92a511633b80 x1873929633511424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.416643:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633b80 with x1873929633511424 ext(999424->1003519) 00002000:00010000:1.0:1787119497.416647:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633b80 00000100:00100000:2.0:1787119497.417697:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.417816:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633511552 00000100:00100000:3.0:1787119497.417824:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633511552 00000100:00100000:3.0:1787119497.417869:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19730 00000100:00100000:3.0:1787119497.417878:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:32728:x1873929633511552:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119497.417895:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119497.417915:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e34c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.418297:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e34c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.418311:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e34c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.418323:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e34c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119497.418347:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 54126883 00000004:00200000:3.0:1787119497.418351:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119497.418368:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e34c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.418400:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e34c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e33 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.418415:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e34c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e33 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.418424:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119497.418463:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119497.418467:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119497.418519:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:32728:x1873929633511552:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 642us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.418525:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19730 00000001:00080000:3.0:1787119497.425310:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969198 is committed 00000100:00100000:1.0:1787119497.427464:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633510400:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 47654us (48183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119497.427478:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5097 00000100:00100000:2.0:1787119497.439711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.439843:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633511680 00000100:00100000:0.0:1787119497.439853:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633511680 00002000:00100000:0.0:1787119497.439898:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (974848->1040383) req@ffff92a5066dd180 x1873929633511680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.439910:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633511680 ext(974848->1040383) 00002000:00010000:0.0:1787119497.439916:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:0.0:1787119497.439943:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10503 00000100:00100000:0.0:1787119497.439954:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633511680:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.445657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.445735:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633511808 00000100:00100000:3.0:1787119497.445746:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633511808 00002000:00100000:3.0:1787119497.445794:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (3407872->3411967) req@ffff92a634148a80 x1873929633511808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.445805:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148a80 with x1873929633511808 ext(3407872->3411967) 00002000:00010000:3.0:1787119497.445811:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148a80 00000100:00100000:3.0:1787119497.445848:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10504 00000100:00100000:3.0:1787119497.445858:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633511808:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.446073:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633511808:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 216us (429us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.446082:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10504 00002000:00100000:3.0:1787119497.446089:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x22:0x0] (3407872->3411967) req@ffff92a634148a80 x1873929633511808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.446097:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148a80 with x1873929633511808 ext(3407872->3411967) 00002000:00010000:3.0:1787119497.446100:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148a80 00000100:00100000:2.0:1787119497.447487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.447557:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633511936 00000100:00100000:1.0:1787119497.447565:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633511936 00002000:00100000:1.0:1787119497.447596:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (62857216->62881791) req@ffff92a5066de680 x1873929633511936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.447605:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de680 with x1873929633511936 ext(62857216->62881791) 00002000:00010000:1.0:1787119497.447610:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de680 00000100:00100000:1.0:1787119497.447636:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10505 00000100:00100000:1.0:1787119497.447645:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633511936:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.448550:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633510912:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 54142us (54441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.448562:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5098 00000001:00080000:3.0:1787119497.448589:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969199 is committed 00000001:00080000:3.0:1787119497.448602:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969200 is committed 00000100:00100000:2.0:1787119497.455972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.456052:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633512064 00000100:00100000:0.0:1787119497.456064:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633512064 00002000:00100000:0.0:1787119497.456120:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (6209536->6213631) req@ffff92a5066dd500 x1873929633512064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.456132:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633512064 ext(6209536->6213631) 00002000:00010000:0.0:1787119497.456138:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd500 00000100:00100000:0.0:1787119497.456171:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10506 00000100:00100000:0.0:1787119497.456182:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633512064:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.457516:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633512064:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1327us (1545us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.457527:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10506 00002000:00100000:0.0:1787119497.457537:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (6209536->6213631) req@ffff92a5066dd500 x1873929633512064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.457545:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633512064 ext(6209536->6213631) 00002000:00010000:0.0:1787119497.457550:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd500 00000100:00100000:0.0:1787119497.458884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.459002:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633512192 00000100:00100000:3.0:1787119497.459012:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633512192 00002000:00100000:3.0:1787119497.459052:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (3411968->3416063) req@ffff92a511633100 x1873929633512192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.459062:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633100 with x1873929633512192 ext(3411968->3416063) 00002000:00010000:3.0:1787119497.459067:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511633100 00000100:00100000:3.0:1787119497.459132:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10507 00000100:00100000:3.0:1787119497.459141:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633512192:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.459360:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633512192:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 219us (482us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.459367:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10507 00002000:00100000:3.0:1787119497.459373:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (3411968->3416063) req@ffff92a511633100 x1873929633512192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.459381:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633100 with x1873929633512192 ext(3411968->3416063) 00002000:00010000:3.0:1787119497.459384:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511633100 00000100:00100000:2.0:1787119497.459812:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633511680:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 19857us (20108us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119497.459820:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10503 00002000:00100000:2.0:1787119497.459826:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x23:0x0] (974848->1040383) req@ffff92a5066dd180 x1873929633511680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.459834:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633511680 ext(974848->1040383) 00002000:00010000:2.0:1787119497.459838:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:3.0:1787119497.460303:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633511936:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 12658us (12820us total) trans 0 rc 24576/24576 00000100:00100000:3.0:1787119497.460311:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10505 00002000:00100000:3.0:1787119497.460318:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (62857216->62881791) req@ffff92a5066de680 x1873929633511936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.460326:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de680 with x1873929633511936 ext(62857216->62881791) 00002000:00010000:3.0:1787119497.460330:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de680 00000100:00100000:1.0:1787119497.463049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.463146:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633512320 00000100:00100000:0.0:1787119497.463156:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633512320 00002000:00100000:0.0:1787119497.463200:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (3387392->3452927) req@ffff92a634148e00 x1873929633512320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.463211:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148e00 with x1873929633512320 ext(3387392->3452927) 00002000:00010000:0.0:1787119497.463216:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148e00 00000100:00100000:0.0:1787119497.463292:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10508 00000100:00100000:0.0:1787119497.463310:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633512320:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.467926:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.467950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.467979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.468085:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633512832 00000100:00100000:0.0:1787119497.468094:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633512832 00000100:00100000:0.0:1787119497.468146:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19731 00000100:00100000:0.0:1787119497.468156:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:32727:x1873929633512832:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119497.468206:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119497.468233:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93800/0xcaba3de8463e344b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e02 expref: 36 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.468253:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:0.0:1787119497.468257:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119497.468482:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.468492:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.468499:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119497.468539:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976548 00000004:00010000:0.0:1787119497.468562:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfbe5f97 reply state 000000008fa1388a transno 4294976549 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119497.468571:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119497.468652:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:32727:x1873929633512832:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 498us (677us total) trans 4294976549 rc 0/0 00000100:00100000:0.0:1787119497.468657:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19731 00000020:00080000:0.0:1787119497.468661:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787119497.468733:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633512320:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5427us (5701us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119497.468739:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10508 00002000:00100000:0.0:1787119497.468746:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (3387392->3452927) req@ffff92a634148e00 x1873929633512320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.468753:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148e00 with x1873929633512320 ext(3387392->3452927) 00002000:00010000:0.0:1787119497.468757:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148e00 00000100:00100000:0.0:1787119497.468765:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633512448 00000100:00100000:0.0:1787119497.468767:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633512448 00002000:00100000:0.0:1787119497.468781:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (995328->1023999) req@ffff92a63414a680 x1873929633512448/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.468787:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414a680 with x1873929633512448 ext(995328->1023999) 00002000:00010000:0.0:1787119497.468789:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414a680 00000100:00100000:0.0:1787119497.468801:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633512576 00000100:00100000:0.0:1787119497.468804:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633512576 00002000:00100000:0.0:1787119497.468816:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (393216->413695) req@ffff92a63414b800 x1873929633512576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.468823:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414b800 with x1873929633512576 ext(393216->413695) 00002000:00010000:0.0:1787119497.468825:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414b800 00000100:00100000:0.0:1787119497.468840:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10509 00000100:00100000:0.0:1787119497.468846:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2373:x1873929633512448:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119497.468929:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10510 00000100:00100000:0.0:1787119497.468934:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633512576:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.472255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119497.472693:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.472706:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.472712:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.472718:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d81200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119497.472723:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.472731:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.472748:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:1.0:1787119497.472752:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119497.472756:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.472762:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e34d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119497.473307:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633512960 00000100:00100000:0.0:1787119497.473319:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633512960 00002000:00010000:0.0:1787119497.473360:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (54126883->18446744073709551615) 00002000:00100000:0.0:1787119497.473364:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe680 with x1873929633512960 ext(54126883->18446744073709551615) 00002000:00010000:0.0:1787119497.473376:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabe680. 00000100:00100000:0.0:1787119497.473416:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10511 00000100:00100000:0.0:1787119497.473436:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633512960:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119497.474117:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 64600736 -> 54126883 00002000:00010000:0.0:1787119497.474123:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119495 -> 1787119496 00002000:00010000:0.0:1787119497.474126:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119492 -> 1787119495 00002000:00010000:0.0:1787119497.474128:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119495 -> 1787119496 00002000:00010000:0.0:1787119497.474130:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 909 -> 1807 00000100:00100000:0.0:1787119497.474554:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633512960:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 1127us (2307us total) trans 4294969201 rc 0/0 00000100:00100000:0.0:1787119497.474563:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10511 00002000:00010000:0.0:1787119497.474568:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (54126883->18446744073709551615) 00002000:00100000:0.0:1787119497.474571:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe680 with x1873929633512960 ext(54126883->18446744073709551615) 00002000:00010000:0.0:1787119497.474577:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabe680. 00000100:00100000:0.0:1787119497.475089:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633512576:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6151us (7134us total) trans 0 rc 20480/20480 00000100:00100000:0.0:1787119497.475097:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10510 00002000:00100000:0.0:1787119497.475107:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (393216->413695) req@ffff92a63414b800 x1873929633512576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.475117:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414b800 with x1873929633512576 ext(393216->413695) 00002000:00010000:0.0:1787119497.475123:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414b800 00000100:00100000:0.0:1787119497.475728:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633512448:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 6880us (7811us total) trans 4294968923 rc 0/0 00000100:00100000:0.0:1787119497.475737:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10509 00002000:00100000:0.0:1787119497.475744:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (995328->1023999) req@ffff92a63414a680 x1873929633512448/t4294968923(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.475754:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414a680 with x1873929633512448 ext(995328->1023999) 00002000:00010000:0.0:1787119497.475758:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414a680 00000100:00100000:1.0:1787119497.479622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.479714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.479789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.479858:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633513344 00000100:00100000:3.0:1787119497.479868:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633513344 00000100:00100000:3.0:1787119497.479924:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19732 00000100:00100000:3.0:1787119497.479933:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:32727:x1873929633513344:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119497.479956:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119497.479978:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e34d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e3a expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.480063:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e34de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.480078:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e34de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.480089:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e34de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119497.480115:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 54126883 00000004:00200000:3.0:1787119497.480119:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119497.480137:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e34de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.480163:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e34d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e3a expref: 39 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.480185:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e34de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e3a expref: 38 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.480194:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119497.480197:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119497.480201:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1400, rc 0) 00000100:00100000:3.0:1787119497.480257:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:32727:x1873929633513344:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 324us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.480264:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19732 00000100:00100000:2.0:1787119497.480590:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633513088 00000100:00100000:2.0:1787119497.480596:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633513088 00002000:00100000:2.0:1787119497.480637:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (3407872->3440639) req@ffff92a63eabd500 x1873929633513088/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.480646:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd500 with x1873929633513088 ext(3407872->3440639) 00002000:00010000:2.0:1787119497.480650:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd500 00000100:00100000:2.0:1787119497.480705:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10512 00000100:00100000:2.0:1787119497.480713:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633513088:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119497.481278:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633513216 00000100:00100000:0.0:1787119497.481284:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633513216 00000100:00100000:0.0:1787119497.481331:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5099 00000100:00100000:0.0:1787119497.481339:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633513216:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119497.483036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.486378:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633513088:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 5655us (6764us total) trans 4294969202 rc 0/0 00000100:00100000:2.0:1787119497.486391:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10512 00002000:00100000:2.0:1787119497.486403:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (3407872->3440639) req@ffff92a63eabd500 x1873929633513088/t4294969202(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.486414:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd500 with x1873929633513088 ext(3407872->3440639) 00002000:00010000:2.0:1787119497.486420:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd500 00000100:00100000:1.0:1787119497.486496:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633513472 00000100:00100000:1.0:1787119497.486504:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633513472 00002000:00100000:1.0:1787119497.486610:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (29409280->29413375) req@ffff92a5066df480 x1873929633513472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.486619:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633513472 ext(29409280->29413375) 00002000:00010000:1.0:1787119497.486624:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:1.0:1787119497.486650:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10513 00000100:00100000:1.0:1787119497.486659:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633513472:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.486890:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633513472:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 231us (3860us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119497.486897:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10513 00002000:00100000:1.0:1787119497.486903:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (29409280->29413375) req@ffff92a5066df480 x1873929633513472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.486911:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633513472 ext(29409280->29413375) 00002000:00010000:1.0:1787119497.486915:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:3.0:1787119497.487167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.487268:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633513600 00000100:00100000:3.0:1787119497.487272:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633513600 00002000:00100000:3.0:1787119497.487294:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (3407872->3411967) req@ffff92a63dc07b80 x1873929633513600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.487302:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07b80 with x1873929633513600 ext(3407872->3411967) 00002000:00010000:3.0:1787119497.487305:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07b80 00000100:00100000:3.0:1787119497.487322:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10514 00000100:00100000:3.0:1787119497.487330:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633513600:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.487501:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633513600:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 171us (334us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.487508:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10514 00002000:00100000:3.0:1787119497.487520:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (3407872->3411967) req@ffff92a63dc07b80 x1873929633513600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.487538:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07b80 with x1873929633513600 ext(3407872->3411967) 00002000:00010000:3.0:1787119497.487541:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07b80 00000100:00100000:3.0:1787119497.490036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.490496:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633513728 00000100:00100000:0.0:1787119497.490506:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633513728 00000100:00100000:0.0:1787119497.490559:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5100 00000100:00100000:0.0:1787119497.490568:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633513728:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119497.493549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.493583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.494105:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633513856 00000100:00100000:2.0:1787119497.494116:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633513856 00002000:00100000:2.0:1787119497.494162:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (3411968->3416063) req@ffff92a634039c00 x1873929633513856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.494174:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039c00 with x1873929633513856 ext(3411968->3416063) 00002000:00010000:2.0:1787119497.494180:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039c00 00000100:00100000:2.0:1787119497.494200:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633513984 00000100:00100000:2.0:1787119497.494203:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633513984 00002000:00100000:2.0:1787119497.494217:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (29433856->29437951) req@ffff92a63403b100 x1873929633513984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.494233:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b100 with x1873929633513984 ext(29433856->29437951) 00002000:00010000:2.0:1787119497.494237:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b100 00000100:00100000:2.0:1787119497.494261:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10515 00000100:00100000:2.0:1787119497.494270:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633513856:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.494332:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10516 00000100:00100000:0.0:1787119497.494340:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633513984:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.494520:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633513856:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 249us (976us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119497.494528:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10515 00002000:00100000:2.0:1787119497.494544:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (3411968->3416063) req@ffff92a634039c00 x1873929633513856/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.494553:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039c00 with x1873929633513856 ext(3411968->3416063) 00002000:00010000:2.0:1787119497.494556:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039c00 00000100:00100000:0.0:1787119497.495593:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633513984:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1245us (2000us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.495604:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10516 00002000:00100000:0.0:1787119497.495612:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (29433856->29437951) req@ffff92a63403b100 x1873929633513984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.495683:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b100 with x1873929633513984 ext(29433856->29437951) 00002000:00010000:0.0:1787119497.495688:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b100 00000100:00100000:2.0:1787119497.498516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.499165:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633514112 00000100:00100000:3.0:1787119497.499174:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633514112 00002000:00100000:3.0:1787119497.499214:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (3387392->3452927) req@ffff92a5066de300 x1873929633514112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.499224:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de300 with x1873929633514112 ext(3387392->3452927) 00002000:00010000:3.0:1787119497.499230:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de300 00000100:00100000:3.0:1787119497.499256:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10517 00000100:00100000:3.0:1787119497.499265:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633514112:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.505588:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633514112:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6314us (7073us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119497.505602:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10517 00002000:00100000:1.0:1787119497.507849:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x21:0x0] (3387392->3452927) req@ffff92a5066de300 x1873929633514112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.507866:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de300 with x1873929633514112 ext(3387392->3452927) 00002000:00010000:1.0:1787119497.507873:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de300 00000100:00100000:0.0:1787119497.515864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.515908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.515999:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633514240 00000100:00100000:0.0:1787119497.515999:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633514368 00000100:00100000:1.0:1787119497.516008:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633514240 00000100:00100000:0.0:1787119497.516008:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633514368 00002000:00100000:1.0:1787119497.516052:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x21:0x0] (3407872->3440639) req@ffff92a511630a80 x1873929633514240/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.516052:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (21741568->21745663) req@ffff92a511632a00 x1873929633514368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.516065:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630a80 with x1873929633514240 ext(3407872->3440639) 00002000:00100000:0.0:1787119497.516065:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633514368 ext(21741568->21745663) 00002000:00010000:0.0:1787119497.516070:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511632a00 00002000:00010000:1.0:1787119497.516071:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511630a80 00000100:00100000:0.0:1787119497.516095:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10518 00000100:00100000:0.0:1787119497.516104:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633514368:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.516496:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633514368:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 391us (587us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.516505:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10518 00002000:00100000:0.0:1787119497.516512:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (21741568->21745663) req@ffff92a511632a00 x1873929633514368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.516522:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633514368 ext(21741568->21745663) 00002000:00010000:0.0:1787119497.516525:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511632a00 00000100:00100000:0.0:1787119497.516542:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10519 00000100:00100000:0.0:1787119497.516550:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633514240:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119497.520387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.522685:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633514496 00000100:00100000:0.0:1787119497.522701:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633514496 00000100:00100000:0.0:1787119497.523175:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633514240:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 6619us (7314us total) trans 4294969203 rc 0/0 00000100:00100000:0.0:1787119497.523186:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10519 00002000:00100000:0.0:1787119497.523198:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (3407872->3440639) req@ffff92a511630a80 x1873929633514240/t4294969203(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.523209:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630a80 with x1873929633514240 ext(3407872->3440639) 00002000:00010000:0.0:1787119497.523215:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511630a80 00002000:00100000:0.0:1787119497.523390:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (21745664->21749759) req@ffff92a634039f80 x1873929633514496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.523410:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039f80 with x1873929633514496 ext(21745664->21749759) 00002000:00010000:0.0:1787119497.523414:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039f80 00000100:00100000:0.0:1787119497.523471:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10520 00000100:00100000:0.0:1787119497.523481:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633514496:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.525784:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633514496:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 2294us (5396us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.525799:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10520 00002000:00100000:0.0:1787119497.525810:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (21745664->21749759) req@ffff92a634039f80 x1873929633514496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.525820:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039f80 with x1873929633514496 ext(21745664->21749759) 00002000:00010000:0.0:1787119497.525826:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039f80 00000100:00100000:3.0:1787119497.528345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.528884:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633514624 00000100:00100000:1.0:1787119497.528896:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633514624 00000100:00100000:1.0:1787119497.528946:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5101 00000100:00100000:1.0:1787119497.528955:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633514624:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119497.537633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.537962:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633514752 00000100:00100000:3.0:1787119497.537973:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633514752 00002000:00100000:3.0:1787119497.538024:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (21721088->21786623) req@ffff92a5066dea00 x1873929633514752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.538035:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633514752 ext(21721088->21786623) 00002000:00010000:3.0:1787119497.538042:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dea00 00000100:00100000:3.0:1787119497.538070:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10521 00000100:00100000:3.0:1787119497.538078:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633514752:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.543679:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633514752:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 5589us (6051us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119497.543692:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10521 00002000:00100000:3.0:1787119497.543704:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (21721088->21786623) req@ffff92a5066dea00 x1873929633514752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.543714:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633514752 ext(21721088->21786623) 00002000:00010000:3.0:1787119497.543721:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dea00 00000100:00100000:0.0:1787119497.550103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.550672:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633514880 00000100:00100000:2.0:1787119497.550682:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633514880 00002000:00100000:2.0:1787119497.550732:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (59912192->59924479) req@ffff92a63eb2a680 x1873929633514880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.550745:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a680 with x1873929633514880 ext(59912192->59924479) 00002000:00010000:2.0:1787119497.550751:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2a680 00000100:00100000:2.0:1787119497.550778:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10522 00000100:00100000:2.0:1787119497.550788:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633514880:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.551079:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633514880:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 290us (983us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119497.551088:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10522 00002000:00100000:2.0:1787119497.551095:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23:0x0] (59912192->59924479) req@ffff92a63eb2a680 x1873929633514880/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/12728 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.551102:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a680 with x1873929633514880 ext(59912192->59924479) 00002000:00010000:2.0:1787119497.551105:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2a680 00000001:00080000:2.0:1787119497.554388:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968923 is committed 00000100:00100000:3.0:1787119497.554583:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633513216:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 73238us (74862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.554596:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5099 00000100:00100000:0.0:1787119497.558584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.558722:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633515008 00000100:00100000:3.0:1787119497.558733:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633515008 00002000:00100000:3.0:1787119497.558780:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (41320448->41332735) req@ffff92a63eb29c00 x1873929633515008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.558792:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29c00 with x1873929633515008 ext(41320448->41332735) 00002000:00010000:3.0:1787119497.558799:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29c00 00000100:00100000:3.0:1787119497.558831:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10523 00000100:00100000:3.0:1787119497.558840:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633515008:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.559090:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633515008:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 250us (513us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1787119497.559099:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10523 00002000:00100000:3.0:1787119497.559106:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (41320448->41332735) req@ffff92a63eb29c00 x1873929633515008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/12728 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.559123:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29c00 with x1873929633515008 ext(41320448->41332735) 00002000:00010000:3.0:1787119497.559126:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29c00 00000001:00080000:2.0:1787119497.562810:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969201 is committed 00000001:00080000:2.0:1787119497.562835:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969202 is committed 00000100:00100000:3.0:1787119497.571551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.573182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.574122:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633515392 00000100:00100000:0.0:1787119497.574133:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633515392 00002000:00100000:0.0:1787119497.574182:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (60612608->60616703) req@ffff92a634038a80 x1873929633515392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.574193:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038a80 with x1873929633515392 ext(60612608->60616703) 00002000:00010000:0.0:1787119497.574199:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038a80 00000100:00100000:0.0:1787119497.574223:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10524 00000100:00100000:0.0:1787119497.574233:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633515392:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.574844:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633515392:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 609us (1670us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.574854:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10524 00002000:00100000:0.0:1787119497.574861:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (60612608->60616703) req@ffff92a634038a80 x1873929633515392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.574871:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038a80 with x1873929633515392 ext(60612608->60616703) 00002000:00010000:0.0:1787119497.574875:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038a80 00000100:00100000:2.0:1787119497.576158:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633515264 00000100:00100000:2.0:1787119497.576172:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633515264 00000100:00100000:2.0:1787119497.576228:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 207 00000100:00100000:2.0:1787119497.576238:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:32720:x1873929633515264:12345-192.168.201.59@tcp:35:fsx.0 00000001:00080000:2.0:1787119497.576693:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976550 00000100:00100000:2.0:1787119497.576887:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:32720:x1873929633515264:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 650us (5344us total) trans 4294976551 rc 0/0 00000100:00100000:2.0:1787119497.576897:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 207 00000020:00080000:2.0:1787119497.576901:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119497.578526:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633513728:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 87948us (88491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119497.578546:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5100 00000100:00100000:0.0:1787119497.585467:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.585628:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633515520 00000100:00100000:1.0:1787119497.585639:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633515520 00002000:00100000:1.0:1787119497.585687:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (60616704->60620799) req@ffff92a63eb28700 x1873929633515520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.585698:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28700 with x1873929633515520 ext(60616704->60620799) 00002000:00010000:1.0:1787119497.585703:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28700 00000100:00100000:1.0:1787119497.585738:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10525 00000100:00100000:1.0:1787119497.585747:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633515520:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.585991:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633515520:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 243us (550us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119497.585999:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10525 00002000:00100000:1.0:1787119497.586007:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (60616704->60620799) req@ffff92a63eb28700 x1873929633515520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.586015:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28700 with x1873929633515520 ext(60616704->60620799) 00002000:00010000:1.0:1787119497.586019:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28700 00000100:00100000:1.0:1787119497.593940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.594138:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633515776 00000100:00100000:0.0:1787119497.594148:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633515776 00000100:00100000:0.0:1787119497.594205:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19733 00000100:00100000:0.0:1787119497.594215:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:32728:x1873929633515776:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:0.0:1787119497.594282:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119497.594325:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e34c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e33 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.594346:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:0.0:1787119497.594352:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119497.594607:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.594634:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119497.594645:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119497.594694:0:12121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976552 00000004:00010000:0.0:1787119497.594718:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079312401 reply state 0000000005126855 transno 4294976553 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119497.594727:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119497.594827:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:32728:x1873929633515776:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 612us (895us total) trans 4294976553 rc 0/0 00000100:00100000:0.0:1787119497.594835:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19733 00000020:00080000:0.0:1787119497.594840:0:12121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119497.605811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.605842:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633515904 00000100:00100000:1.0:1787119497.605850:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633515904 00002000:00010000:1.0:1787119497.605889:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (25582583->18446744073709551615) 00002000:00100000:1.0:1787119497.605893:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233480 with x1873929633515904 ext(25582583->18446744073709551615) 00002000:00010000:1.0:1787119497.605904:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233480. 00000100:00100000:1.0:1787119497.605928:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10526 00000100:00100000:1.0:1787119497.605937:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633515904:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:1.0:1787119497.606299:0:19245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 54126883 -> 25582583 00002000:00010000:1.0:1787119497.606304:0:19245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787119496 -> 1787119496 00002000:00010000:1.0:1787119497.606306:0:19245:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787119495 -> 1787119496 00002000:00010000:1.0:1787119497.606308:0:19245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787119496 -> 1787119496 00002000:00010000:1.0:1787119497.606310:0:19245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1807 -> 1551 00000100:00100000:1.0:1787119497.606374:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633515904:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 437us (574us total) trans 4294969204 rc 0/0 00000100:00100000:1.0:1787119497.606387:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10526 00002000:00010000:1.0:1787119497.606391:0:19245:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (25582583->18446744073709551615) 00002000:00100000:1.0:1787119497.606393:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233480 with x1873929633515904 ext(25582583->18446744073709551615) 00002000:00010000:1.0:1787119497.606398:0:19245:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233480. 00010000:00010000:3.0:1787119497.612493:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.612511:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.612518:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.612525:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119497.612529:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.614272:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.614297:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119497.614300:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119497.614306:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.614314:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e34e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119497.622718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.622761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.622794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.622898:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633516032 00000100:00100000:2.0:1787119497.622912:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633516032 00002000:00100000:2.0:1787119497.622962:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (60592128->60657663) req@ffff92a509230700 x1873929633516032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.622973:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230700 with x1873929633516032 ext(60592128->60657663) 00002000:00010000:2.0:1787119497.622979:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230700 00000100:00100000:2.0:1787119497.623007:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10527 00000100:00100000:2.0:1787119497.623016:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633516032:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.623078:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633516288 00000100:00100000:3.0:1787119497.623083:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633516288 00000100:00100000:3.0:1787119497.623124:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19734 00000100:00100000:3.0:1787119497.623131:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:32728:x1873929633516288:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119497.623147:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119497.623169:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e34ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e48 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623250:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e34f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623268:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e34f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623280:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e34f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119497.623311:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 25582583 00000004:00200000:3.0:1787119497.623315:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119497.623334:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e34f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623362:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e34ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e48 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623380:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0600/0xcaba3de8463e34f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e48 expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623390:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff92a609aaf100) 00010000:00010000:3.0:1787119497.623393:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119497.623396:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0600, rc 0) 00000100:00100000:3.0:1787119497.623466:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:32728:x1873929633516288:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 310us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.623474:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19734 00000100:00100000:3.0:1787119497.623500:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633516160 00000100:00100000:3.0:1787119497.623503:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633516160 00000100:00100000:3.0:1787119497.623529:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5102 00000100:00100000:3.0:1787119497.623536:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:32720:x1873929633516160:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119497.623544:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119497.623554:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000648d1e51/0xcaba3de8463e34fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e41 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623575:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005411ac99/0xcaba3de8463df4c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047148b5 expref: 10 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623585:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=41s v=(0 0) 00010000:00010000:3.0:1787119497.623589:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787119497.623595:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000648d1e51/0xcaba3de8463e34fa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e41 expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623630:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005411ac99/0xcaba3de8463df4c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa8892732047148b5 expref: 10 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.623660:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005411ac99/0xcaba3de8463df4c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047148b5 expref: 10 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119497.623675:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8267:1873929653567488:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119497.623739:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a507972f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119497.634824:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633516032:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 11799us (12108us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119497.634839:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10527 00002000:00100000:0.0:1787119497.634854:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (60592128->60657663) req@ffff92a509230700 x1873929633516032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.634864:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230700 with x1873929633516032 ext(60592128->60657663) 00002000:00010000:0.0:1787119497.634871:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509230700 00000100:00100000:2.0:1787119497.635615:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8267:1873929653567488:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119497.635667:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000648d1e51/0xcaba3de8463e34fa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e41 expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.635690:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00000100:00100000:2.0:1787119497.635730:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:32720:x1873929633516160:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 12194us (12934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119497.635738:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5102 00000100:00100000:2.0:1787119497.636078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.636135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.636214:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633516544 00000100:00100000:0.0:1787119497.636222:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633516544 00000100:00100000:3.0:1787119497.636225:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633516416 00000100:00100000:3.0:1787119497.636232:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633516416 00010000:00010000:3.0:1787119497.636260:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005411ac99/0xcaba3de8463df4c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047148b5 expref: 10 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787119497.636269:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (8941568->8945663) req@ffff92a606159c00 x1873929633516544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.636282:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159c00 with x1873929633516544 ext(8941568->8945663) 00002000:00010000:0.0:1787119497.636287:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606159c00 00000100:00100000:3.0:1787119497.636336:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5201 00000100:00100000:3.0:1787119497.636347:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633516416:12345-192.168.201.59@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787119497.636358:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10528 00010000:00010000:3.0:1787119497.636362:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787119497.636369:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633516544:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119497.636387:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005411ac99/0xcaba3de8463df4c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047148b5 expref: 10 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.636414:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005411ac99/0xcaba3de8463df4c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047148b5 expref: 10 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.636478:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005411ac99/0xcaba3de8463df4c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047148b5 expref: 10 pid: 12469 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.636494:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787119497.636499:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787119497.636508:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000648d1e51/0xcaba3de8463e34fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e41 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.636520:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000648d1e51/0xcaba3de8463e34fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e41 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.636558:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000648d1e51/0xcaba3de8463e34fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e41 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119497.636578:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5834:1873929653567616:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119497.636652:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a507972180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119497.636790:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633516544:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 423us (654us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.636799:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10528 00002000:00100000:0.0:1787119497.636806:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x22:0x0] (8941568->8945663) req@ffff92a606159c00 x1873929633516544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.636814:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159c00 with x1873929633516544 ext(8941568->8945663) 00002000:00010000:0.0:1787119497.636818:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606159c00 00000100:00100000:0.0:1787119497.643056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.643369:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633516672 00000100:00100000:3.0:1787119497.643380:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633516672 00002000:00100000:3.0:1787119497.643463:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (29409280->60633087) req@ffff92a63eb2b100 x1873929633516672/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.643477:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b100 with x1873929633516672 ext(29409280->60633087) 00002000:00010000:3.0:1787119497.643483:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b100 00000100:00100000:3.0:1787119497.643511:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10529 00000100:00100000:3.0:1787119497.643522:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633516672:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119497.643650:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633514624:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 114695us (115313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119497.643729:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5101 00000001:00080000:2.0:1787119497.643761:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969203 is committed 00000100:00100000:1.0:1787119497.647476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.647493:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5834:1873929653567616:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119497.647515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119497.647519:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119497.647536:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633516800 00000100:00100000:2.0:1787119497.647545:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633516800 00000100:00100000:3.0:1787119497.647577:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633516416:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11231us (11498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.647587:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5201 00002000:00100000:2.0:1787119497.648215:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (8945664->8949759) req@ffff92a509233b80 x1873929633516800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.648228:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233b80 with x1873929633516800 ext(8945664->8949759) 00002000:00010000:2.0:1787119497.648233:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233b80 00000100:00100000:2.0:1787119497.648264:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10530 00000100:00100000:2.0:1787119497.648274:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633516800:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.648489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.648562:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633517312 00000100:00100000:3.0:1787119497.648568:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633517312 00000100:00100000:2.0:1787119497.648598:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633516800:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 323us (1130us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.648605:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19735 00000100:00100000:2.0:1787119497.648616:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10530 00002000:00100000:2.0:1787119497.648625:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (8945664->8949759) req@ffff92a509233b80 x1873929633516800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787119497.648630:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:32727:x1873929633517312:12345-192.168.201.59@tcp:36:fsx.0 00002000:00100000:2.0:1787119497.648644:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233b80 with x1873929633516800 ext(8945664->8949759) 00002000:00010000:2.0:1787119497.648648:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233b80 00010000:00010000:3.0:1787119497.648683:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119497.648713:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e34de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e3a expref: 42 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.648737:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119497.648743:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119497.648794:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633517056 00000100:00100000:0.0:1787119497.648800:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633517056 00000100:00100000:0.0:1787119497.648839:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 208 00000100:00100000:0.0:1787119497.648849:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:32720:x1873929633517056:12345-192.168.201.59@tcp:35:fsx.0 00010000:00010000:3.0:1787119497.648987:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.649002:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.649013:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119497.649076:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976555 00000001:00080000:3.0:1787119497.649123:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976554 00000004:00010000:3.0:1787119497.649156:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ba93a21 reply state 00000000b4f26205 transno 4294976557 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119497.649165:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119497.649174:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:32720:x1873929633517056:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 326us (1656us total) trans 4294976556 rc 0/0 00000100:00100000:0.0:1787119497.649183:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 208 00000020:00080000:0.0:1787119497.649188:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119497.649215:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:32727:x1873929633517312:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 589us (725us total) trans 4294976557 rc 0/0 00000100:00100000:3.0:1787119497.649223:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19735 00000020:00080000:3.0:1787119497.649226:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119497.652698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.652776:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633517568 00000100:00100000:0.0:1787119497.652787:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633517568 00000100:00100000:0.0:1787119497.652846:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 209 00000100:00100000:0.0:1787119497.652857:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:32720:x1873929633517568:12345-192.168.201.59@tcp:35:fsx.0 00000100:00100000:0.0:1787119497.653243:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:32720:x1873929633517568:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 387us (553us total) trans 4294976558 rc 0/0 00000100:00100000:0.0:1787119497.653252:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 209 00000100:00100000:3.0:1787119497.653525:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633516672:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 10004us (10478us total) trans 4294969205 rc 0/0 00000100:00100000:3.0:1787119497.653535:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10529 00002000:00100000:3.0:1787119497.653548:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (29409280->60633087) req@ffff92a63eb2b100 x1873929633516672/t4294969205(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.653559:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b100 with x1873929633516672 ext(29409280->60633087) 00002000:00010000:3.0:1787119497.653565:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b100 00000100:00100000:2.0:1787119497.655995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.656073:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633517696 00000100:00100000:1.0:1787119497.656082:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633517696 00002000:00100000:1.0:1787119497.656132:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (8921088->8986623) req@ffff92a60615b800 x1873929633517696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.656144:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b800 with x1873929633517696 ext(8921088->8986623) 00002000:00010000:1.0:1787119497.656149:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b800 00000100:00100000:1.0:1787119497.656185:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10531 00000100:00100000:1.0:1787119497.656194:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633517696:12345-192.168.201.59@tcp:3:fsx.0 00010000:00010000:3.0:1787119497.656199:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.656210:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.656217:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.656224:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119497.656229:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.656235:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.656252:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119497.656255:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119497.656259:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.656266:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3501 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119497.659020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.659060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.659219:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633517824 00000100:00100000:0.0:1787119497.659229:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633517824 00002000:00010000:0.0:1787119497.659265:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (25582583->18446744073709551615) 00002000:00100000:0.0:1787119497.659271:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414fb80 with x1873929633517824 ext(25582583->18446744073709551615) 00002000:00010000:0.0:1787119497.659283:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414fb80. 00000100:00100000:0.0:1787119497.659327:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10532 00000100:00100000:0.0:1787119497.659336:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633517824:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:0.0:1787119497.659704:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 54126883 -> 25582583 00002000:00010000:0.0:1787119497.659710:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787119496 -> 1787119496 00002000:00010000:0.0:1787119497.659712:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787119495 -> 1787119496 00002000:00010000:0.0:1787119497.659715:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787119496 -> 1787119496 00002000:00010000:0.0:1787119497.659717:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 1807 -> 1551 00000100:00100000:0.0:1787119497.659772:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633517824:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 437us (760us total) trans 4294969206 rc 0/0 00000100:00100000:0.0:1787119497.659780:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10532 00002000:00010000:0.0:1787119497.659784:0:6701:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/33 (25582583->18446744073709551615) 00002000:00100000:0.0:1787119497.659787:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414fb80 with x1873929633517824 ext(25582583->18446744073709551615) 00002000:00010000:0.0:1787119497.659909:0:6701:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414fb80. 00000100:00100000:3.0:1787119497.659976:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633517952 00000100:00100000:3.0:1787119497.659981:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633517952 00000100:00100000:3.0:1787119497.660020:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5103 00000100:00100000:3.0:1787119497.660027:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633517952:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:2.0:1787119497.664307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.665268:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633518080 00000100:00100000:3.0:1787119497.665281:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633518080 00000100:00100000:3.0:1787119497.665357:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19736 00000100:00100000:3.0:1787119497.665365:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:32727:x1873929633518080:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119497.665385:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119497.665402:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.665525:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e350f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.665541:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e350f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.665557:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e350f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119497.665586:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 25582583 00000004:00200000:3.0:1787119497.665591:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119497.665611:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e350f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.665639:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e4f expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.665657:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0c00/0xcaba3de8463e350f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e4f expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.665665:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff92a609aafa00) 00010000:00010000:3.0:1787119497.665668:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119497.665673:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0c00, rc 0) 00000100:00100000:3.0:1787119497.665745:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:32727:x1873929633518080:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 379us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.665752:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19736 00000100:00100000:3.0:1787119497.669385:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633517696:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 13178us (13386us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119497.669400:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10531 00002000:00100000:3.0:1787119497.669415:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x22:0x0] (8921088->8986623) req@ffff92a60615b800 x1873929633517696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.669454:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b800 with x1873929633517696 ext(8921088->8986623) 00002000:00010000:3.0:1787119497.669462:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b800 00000100:00100000:2.0:1787119497.681025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.681194:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633518208 00000100:00100000:0.0:1787119497.681207:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633518208 00002000:00100000:0.0:1787119497.681264:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (7327744->7376895) req@ffff92a60615aa00 x1873929633518208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.681276:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615aa00 with x1873929633518208 ext(7327744->7376895) 00002000:00010000:0.0:1787119497.681282:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615aa00 00000100:00100000:0.0:1787119497.681669:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10533 00000100:00100000:0.0:1787119497.681680:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633518208:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.700104:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.700307:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633518208:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 18625us (19287us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1787119497.700321:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10533 00002000:00100000:2.0:1787119497.700337:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22:0x0] (7327744->7376895) req@ffff92a60615aa00 x1873929633518208/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.700348:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615aa00 with x1873929633518208 ext(7327744->7376895) 00002000:00010000:2.0:1787119497.700355:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615aa00 00000100:00100000:2.0:1787119497.700394:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633518336 00000100:00100000:2.0:1787119497.700402:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633518336 00002000:00100000:2.0:1787119497.700472:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (8941568->8945663) req@ffff92a60615b480 x1873929633518336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.700481:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b480 with x1873929633518336 ext(8941568->8945663) 00002000:00010000:2.0:1787119497.700485:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b480 00000100:00100000:2.0:1787119497.700509:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10534 00000100:00100000:2.0:1787119497.700519:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633518336:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.700725:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633518336:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 207us (633us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119497.700731:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10534 00002000:00100000:2.0:1787119497.700737:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (8941568->8945663) req@ffff92a60615b480 x1873929633518336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.700744:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b480 with x1873929633518336 ext(8941568->8945663) 00002000:00010000:2.0:1787119497.700747:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b480 00000100:00100000:2.0:1787119497.706472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.706691:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633518464 00000100:00100000:3.0:1787119497.706702:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633518464 00002000:00100000:3.0:1787119497.706756:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (995328->999423) req@ffff92a60615ad80 x1873929633518464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.706767:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615ad80 with x1873929633518464 ext(995328->999423) 00002000:00010000:3.0:1787119497.706773:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615ad80 00000100:00100000:3.0:1787119497.706815:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10535 00000100:00100000:3.0:1787119497.706825:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633518464:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.707101:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633518464:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 276us (676us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.707111:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10535 00002000:00100000:3.0:1787119497.707119:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22:0x0] (995328->999423) req@ffff92a60615ad80 x1873929633518464/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.707127:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615ad80 with x1873929633518464 ext(995328->999423) 00002000:00010000:3.0:1787119497.707130:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615ad80 00000100:00100000:2.0:1787119497.707825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.708098:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633518592 00000100:00100000:3.0:1787119497.708106:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633518592 00002000:00100000:3.0:1787119497.708134:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (8945664->8949759) req@ffff92a60615b100 x1873929633518592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.708144:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b100 with x1873929633518592 ext(8945664->8949759) 00002000:00010000:3.0:1787119497.708148:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b100 00000100:00100000:3.0:1787119497.708175:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10536 00000100:00100000:3.0:1787119497.708184:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633518592:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.708364:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633518592:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 180us (542us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.708371:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10536 00002000:00100000:3.0:1787119497.708376:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (8945664->8949759) req@ffff92a60615b100 x1873929633518592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.708384:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615b100 with x1873929633518592 ext(8945664->8949759) 00002000:00010000:3.0:1787119497.708387:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615b100 00000100:00100000:3.0:1787119497.711507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.711545:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633518720 00000100:00100000:3.0:1787119497.711554:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633518720 00002000:00100000:3.0:1787119497.711598:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (8921088->8986623) req@ffff92a63403b800 x1873929633518720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.711610:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633518720 ext(8921088->8986623) 00002000:00010000:3.0:1787119497.711615:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b800 00000100:00100000:3.0:1787119497.711643:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10537 00000100:00100000:3.0:1787119497.711651:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633518720:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.713056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.713170:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633518848 00000100:00100000:3.0:1787119497.713179:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633518848 00002000:00100000:3.0:1787119497.713216:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (999424->1003519) req@ffff92a634039180 x1873929633518848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.713228:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633518848 ext(999424->1003519) 00002000:00010000:3.0:1787119497.713234:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039180 00000100:00100000:3.0:1787119497.713259:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10538 00000100:00100000:3.0:1787119497.713268:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633518848:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.713607:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633518848:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 337us (556us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.713615:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10538 00002000:00100000:3.0:1787119497.713623:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x22:0x0] (999424->1003519) req@ffff92a634039180 x1873929633518848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.713631:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633518848 ext(999424->1003519) 00002000:00010000:3.0:1787119497.713635:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039180 00000100:00100000:3.0:1787119497.718300:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633518720:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 6629us (6782us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119497.718313:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10537 00002000:00100000:3.0:1787119497.718326:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (8921088->8986623) req@ffff92a63403b800 x1873929633518720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.718338:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633518720 ext(8921088->8986623) 00002000:00010000:3.0:1787119497.718344:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b800 00000100:00100000:3.0:1787119497.720329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.720593:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633518976 00000100:00100000:0.0:1787119497.720602:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633518976 00002000:00100000:0.0:1787119497.720649:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (974848->1040383) req@ffff92a634038700 x1873929633518976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.720660:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038700 with x1873929633518976 ext(974848->1040383) 00002000:00010000:0.0:1787119497.720666:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038700 00000100:00100000:0.0:1787119497.720701:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10539 00000100:00100000:0.0:1787119497.720711:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633518976:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.724433:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633518976:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 3702us (4092us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119497.724484:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10539 00002000:00100000:0.0:1787119497.724498:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x22:0x0] (974848->1040383) req@ffff92a634038700 x1873929633518976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.724509:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038700 with x1873929633518976 ext(974848->1040383) 00002000:00010000:0.0:1787119497.724515:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038700 00000100:00100000:0.0:1787119497.731284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.731722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000001:00080000:2.0:1787119497.731969:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969206 is committed 00000100:00100000:3.0:1787119497.732096:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2374:x1873929633517952:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 72066us (73033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.732107:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5103 00000100:00100000:3.0:1787119497.737003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.737577:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633519104 00000100:00100000:1.0:1787119497.737589:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633519104 00002000:00100000:1.0:1787119497.737646:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (7327744->7376895) req@ffff92a63eb2ad80 x1873929633519104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.737657:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633519104 ext(7327744->7376895) 00002000:00010000:1.0:1787119497.737664:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ad80 00000100:00100000:2.0:1787119497.737699:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633519232 00000100:00100000:2.0:1787119497.737704:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633519232 00002000:00100000:2.0:1787119497.737726:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (995328->1023999) req@ffff92a63eb28380 x1873929633519232/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.737734:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633519232 ext(995328->1023999) 00002000:00010000:2.0:1787119497.737738:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28380 00000100:00100000:1.0:1787119497.737745:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10540 00000100:00100000:1.0:1787119497.737755:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633519104:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.740907:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633519360 00000100:00100000:1.0:1787119497.740921:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633519360 00002000:00100000:1.0:1787119497.740968:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x23:0x0] (62857216->62881791) req@ffff92a63403a300 x1873929633519360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.740979:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a300 with x1873929633519360 ext(62857216->62881791) 00002000:00010000:1.0:1787119497.740985:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403a300 00000100:00100000:1.0:1787119497.741013:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10541 00000100:00100000:1.0:1787119497.741021:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633519232:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119497.741041:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10542 00000100:00100000:3.0:1787119497.741050:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633519360:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.754672:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633519104:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 16903us (23383us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1787119497.754689:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10540 00002000:00100000:2.0:1787119497.754705:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (7327744->7376895) req@ffff92a63eb2ad80 x1873929633519104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.754716:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633519104 ext(7327744->7376895) 00002000:00010000:2.0:1787119497.754723:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ad80 00000100:00100000:2.0:1787119497.755213:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633519360:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 14162us (18220us total) trans 0 rc 24576/24576 00000100:00100000:2.0:1787119497.755222:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10542 00002000:00100000:2.0:1787119497.755230:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (62857216->62881791) req@ffff92a63403a300 x1873929633519360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.755239:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a300 with x1873929633519360 ext(62857216->62881791) 00002000:00010000:2.0:1787119497.755244:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403a300 00000100:00100000:3.0:1787119497.758071:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633519232:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 17038us (26338us total) trans 4294969207 rc 0/0 00000100:00100000:3.0:1787119497.758097:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10541 00002000:00100000:3.0:1787119497.758109:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (995328->1023999) req@ffff92a63eb28380 x1873929633519232/t4294969207(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.758121:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633519232 ext(995328->1023999) 00002000:00010000:3.0:1787119497.759274:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28380 00000100:00100000:0.0:1787119497.765265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.765339:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633519488 00000100:00100000:2.0:1787119497.765348:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633519488 00002000:00100000:2.0:1787119497.765397:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (995328->999423) req@ffff92a63eb28a80 x1873929633519488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.765408:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633519488 ext(995328->999423) 00002000:00010000:2.0:1787119497.765413:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28a80 00000100:00100000:3.0:1787119497.765724:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10543 00000100:00100000:3.0:1787119497.765737:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633519488:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.766910:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633519488:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 1169us (1648us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.766922:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10543 00002000:00100000:3.0:1787119497.766932:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x21:0x0] (995328->999423) req@ffff92a63eb28a80 x1873929633519488/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.766941:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633519488 ext(995328->999423) 00002000:00010000:3.0:1787119497.766946:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28a80 00000100:00100000:2.0:1787119497.771118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.771371:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633519744 00000100:00100000:3.0:1787119497.771382:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633519744 00000100:00100000:2.0:1787119497.771984:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19737 00000100:00100000:2.0:1787119497.771997:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:32729:x1873929633519744:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:2.0:1787119497.772055:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119497.772094:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430400/0xcaba3de8463e3483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e17 expref: 47 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.772114:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:2.0:1787119497.772118:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119497.772360:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.772374:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.772388:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119497.772487:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976559 00000004:00010000:2.0:1787119497.772514:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f13a4936 reply state 00000000927b0c1d transno 4294976560 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119497.772523:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119497.773751:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:32729:x1873929633519744:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 1749us (2633us total) trans 4294976560 rc 0/0 00000100:00100000:2.0:1787119497.773764:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19737 00000020:00080000:2.0:1787119497.773770:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119497.773967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.774030:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633519872 00000100:00100000:3.0:1787119497.774039:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633519872 00000100:00100000:1.0:1787119497.774114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.774189:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5104 00000100:00100000:3.0:1787119497.774200:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633519872:12345-192.168.201.59@tcp:16:fsx.0 00010000:00010000:3.0:1787119497.776136:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.776154:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.776162:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.776169:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119497.776174:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.776182:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.776200:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119497.776203:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119497.776209:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.776215:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3516 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119497.776471:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633520000 00000100:00100000:3.0:1787119497.776481:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633520000 00002000:00100000:3.0:1787119497.776544:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (999424->1003519) req@ffff92a508da6680 x1873929633520000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.776555:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6680 with x1873929633520000 ext(999424->1003519) 00002000:00010000:3.0:1787119497.776560:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6680 00000100:00100000:3.0:1787119497.776584:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10544 00000100:00100000:3.0:1787119497.776593:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633520000:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119497.776818:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633520000:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 225us (2702us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119497.777079:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10544 00002000:00100000:3.0:1787119497.777090:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (999424->1003519) req@ffff92a508da6680 x1873929633520000/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.777099:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6680 with x1873929633520000 ext(999424->1003519) 00002000:00010000:3.0:1787119497.777103:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6680 00000100:00100000:0.0:1787119497.778411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.780382:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633520128 00000100:00100000:3.0:1787119497.780398:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633520128 00002000:00010000:3.0:1787119497.780475:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (54126883->18446744073709551615) 00002000:00100000:3.0:1787119497.780481:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b480 with x1873929633520128 ext(54126883->18446744073709551615) 00002000:00010000:3.0:1787119497.780505:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b480. 00000100:00100000:3.0:1787119497.780549:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10545 00000100:00100000:3.0:1787119497.780559:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633520128:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119497.781092:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 64600736 -> 54126883 00002000:00010000:3.0:1787119497.781097:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119495 -> 1787119496 00002000:00010000:3.0:1787119497.781100:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119492 -> 1787119496 00002000:00010000:3.0:1787119497.781102:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119495 -> 1787119496 00002000:00010000:3.0:1787119497.781105:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 909 -> 1807 00000100:00100000:3.0:1787119497.781174:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633520128:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 615us (2767us total) trans 4294969208 rc 0/0 00000100:00100000:3.0:1787119497.781182:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10545 00002000:00010000:3.0:1787119497.781186:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (54126883->18446744073709551615) 00002000:00100000:3.0:1787119497.781189:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b480 with x1873929633520128 ext(54126883->18446744073709551615) 00002000:00010000:3.0:1787119497.781194:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b480. 00000100:00100000:3.0:1787119497.790094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.790182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.790221:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633520384 00000100:00100000:3.0:1787119497.790233:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633520384 00002000:00100000:3.0:1787119497.790285:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (974848->1040383) req@ffff92a63403bb80 x1873929633520384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.790297:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633520384 ext(974848->1040383) 00002000:00010000:3.0:1787119497.790302:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403bb80 00000100:00100000:3.0:1787119497.790333:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10546 00000100:00100000:3.0:1787119497.790342:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633520384:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.791002:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633520256 00000100:00100000:1.0:1787119497.791009:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633520256 00000100:00100000:1.0:1787119497.791052:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19738 00000100:00100000:1.0:1787119497.791060:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:32729:x1873929633520256:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119497.791204:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119497.791227:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e351d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e56 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.791408:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.791434:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.791478:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119497.791504:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 54126883 00000004:00200000:1.0:1787119497.791508:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119497.791525:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.791683:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e351d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e56 expref: 50 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.791701:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e56 expref: 49 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.791710:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119497.791713:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119497.791717:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119497.791782:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:32729:x1873929633520256:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 721us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119497.791790:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19738 00000100:00100000:1.0:1787119497.798203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.798455:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633520512 00000100:00100000:2.0:1787119497.798466:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633520512 00002000:00100000:2.0:1787119497.798521:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (3407872->3411967) req@ffff92a508da5f80 x1873929633520512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.798600:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5f80 with x1873929633520512 ext(3407872->3411967) 00002000:00010000:2.0:1787119497.798606:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5f80 00000100:00100000:2.0:1787119497.798634:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10547 00000100:00100000:2.0:1787119497.798644:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633520512:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119497.798875:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633520512:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 232us (682us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119497.798883:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10547 00002000:00100000:2.0:1787119497.798890:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (3407872->3411967) req@ffff92a508da5f80 x1873929633520512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.798898:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5f80 with x1873929633520512 ext(3407872->3411967) 00002000:00010000:2.0:1787119497.798902:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5f80 00000100:00100000:2.0:1787119497.818383:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633520384:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 28031us (28232us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119497.818398:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10546 00002000:00100000:2.0:1787119497.818413:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x21:0x0] (974848->1040383) req@ffff92a63403bb80 x1873929633520384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.818434:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633520384 ext(974848->1040383) 00002000:00010000:2.0:1787119497.818472:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403bb80 00000100:00100000:3.0:1787119497.819852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.819956:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633520640 00000100:00100000:0.0:1787119497.819965:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633520640 00002000:00100000:0.0:1787119497.820011:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (3411968->3416063) req@ffff92a634038000 x1873929633520640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.820020:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633520640 ext(3411968->3416063) 00002000:00010000:0.0:1787119497.820024:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038000 00000100:00100000:0.0:1787119497.820059:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10548 00000100:00100000:0.0:1787119497.820069:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633520640:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119497.820358:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633520640:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 289us (514us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119497.820365:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10548 00002000:00100000:0.0:1787119497.820371:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (3411968->3416063) req@ffff92a634038000 x1873929633520640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119497.820380:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633520640 ext(3411968->3416063) 00002000:00010000:0.0:1787119497.820384:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634038000 00000100:00100000:0.0:1787119497.831212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.835337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.836785:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633519872:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 62577us (62809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119497.836798:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5104 00000001:00080000:3.0:1787119497.836834:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969207 is committed 00000100:00100000:0.0:1787119497.840182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.840262:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633521152 00000100:00100000:3.0:1787119497.840274:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633521152 00000100:00100000:3.0:1787119497.840474:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 210 00000100:00100000:3.0:1787119497.840485:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6080bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:32728:x1873929633521152:12345-192.168.201.59@tcp:35:fsx.0 00000100:00100000:1.0:1787119497.840577:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633520768 00000100:00100000:1.0:1787119497.840583:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633520768 00000100:00100000:3.0:1787119497.840863:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6080bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:32728:x1873929633521152:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 379us (691us total) trans 4294976561 rc 0/0 00000100:00100000:3.0:1787119497.840871:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 210 00002000:00100000:3.0:1787119497.840938:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x21:0x0] (995328->1023999) req@ffff92a63eb28000 x1873929633520768/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.840950:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28000 with x1873929633520768 ext(995328->1023999) 00002000:00010000:3.0:1787119497.840957:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28000 00000100:00100000:3.0:1787119497.840980:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633520896 00000100:00100000:3.0:1787119497.840994:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633520896 00002000:00100000:3.0:1787119497.841009:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (3387392->3452927) req@ffff92a63eb29500 x1873929633520896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.841018:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633520896 ext(3387392->3452927) 00002000:00010000:3.0:1787119497.841022:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29500 00000100:00100000:3.0:1787119497.841045:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10549 00000100:00100000:3.0:1787119497.841053:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633520768:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119497.841153:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10550 00000100:00100000:3.0:1787119497.841161:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633520896:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:1.0:1787119497.856517:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633520768:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 15454us (25304us total) trans 4294969209 rc 0/0 00000100:00100000:1.0:1787119497.856650:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10549 00002000:00100000:1.0:1787119497.856666:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x21:0x0] (995328->1023999) req@ffff92a63eb28000 x1873929633520768/t4294969209(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.856686:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28000 with x1873929633520768 ext(995328->1023999) 00002000:00010000:1.0:1787119497.856692:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28000 00000100:00100000:1.0:1787119497.858727:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633520896:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 17556us (23389us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1787119497.858740:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10550 00002000:00100000:1.0:1787119497.858751:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (3387392->3452927) req@ffff92a63eb29500 x1873929633520896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 504/440 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119497.858761:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633520896 ext(3387392->3452927) 00002000:00010000:1.0:1787119497.858767:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29500 00000100:00100000:2.0:1787119497.876806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119497.876853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.876908:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633521280 00000100:00100000:0.0:1787119497.876917:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633521280 00000100:00100000:0.0:1787119497.877019:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633521408 00000100:00100000:0.0:1787119497.877023:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633521408 00000100:00100000:0.0:1787119497.877092:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5105 00000100:00100000:0.0:1787119497.877103:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633521280:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:1.0:1787119497.877198:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5106 00000100:00100000:1.0:1787119497.877208:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:32728:x1873929633521408:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119497.877216:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119497.877234:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e352b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e5d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.877763:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006db29b3/0xcaba3de8463df2e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204714814 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.877774:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=42s v=(0 0) 00010000:00010000:1.0:1787119497.877778:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119497.877784:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e352b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e5d expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.877817:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006db29b3/0xcaba3de8463df2e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204714814 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.877843:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006db29b3/0xcaba3de8463df2e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714814 expref: 17 pid: 6696 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119497.877859:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653567744:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119497.878505:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119497.884964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.886673:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633521536 00000100:00100000:3.0:1787119497.886691:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633521536 00002000:00100000:3.0:1787119497.886747:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (3407872->3440639) req@ffff92a606158e00 x1873929633521536/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/0 e 0 to 0 dl 1787119508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119497.886759:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158e00 with x1873929633521536 ext(3407872->3440639) 00002000:00010000:3.0:1787119497.886765:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158e00 00000100:00100000:3.0:1787119497.887170:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10551 00000100:00100000:3.0:1787119497.887180:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633521536:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119497.887499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.888228:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653567744:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119497.888262:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e352b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e5d expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.888298:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119497.888599:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:32728:x1873929633521408:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 11391us (11741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119497.888610:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5106 00000100:00100000:2.0:1787119497.891270:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633521536:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 4079us (6305us total) trans 4294969210 rc 0/0 00000100:00100000:2.0:1787119497.891287:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10551 00002000:00100000:2.0:1787119497.891301:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (3407872->3440639) req@ffff92a606158e00 x1873929633521536/t4294969210(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:533/0 lens 488/448 e 0 to 0 dl 1787119508 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119497.891587:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606158e00 with x1873929633521536 ext(3407872->3440639) 00002000:00010000:2.0:1787119497.891595:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606158e00 00000100:00100000:2.0:1787119497.892882:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633521664 00000100:00100000:2.0:1787119497.892895:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633521664 00010000:00010000:2.0:1787119497.892935:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006db29b3/0xcaba3de8463df2e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714814 expref: 19 pid: 6696 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119497.892981:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5202 00000100:00100000:2.0:1787119497.892991:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633521664:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119497.893007:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119497.893026:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006db29b3/0xcaba3de8463df2e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714814 expref: 19 pid: 6696 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.893053:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006db29b3/0xcaba3de8463df2e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714814 expref: 19 pid: 6696 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.893077:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006db29b3/0xcaba3de8463df2e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714814 expref: 19 pid: 6696 timeout: 1123 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.893096:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119497.893100:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119497.893108:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e352b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e5d expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.893119:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e352b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e5d expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119497.893160:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e352b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e5d expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119497.893174:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653567872:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119497.893251:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61819d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119497.896324:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653567872:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119497.896352:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119497.896409:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633521664:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3418us (8910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119497.896430:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5202 00000100:00100000:3.0:1787119497.896876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119497.897200:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633521792 00000100:00100000:1.0:1787119497.897209:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633521792 00000100:00100000:1.0:1787119497.897259:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5107 00000100:00100000:1.0:1787119497.897267:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633521792:12345-192.168.201.59@tcp:16:fsx.0 00000100:00100000:3.0:1787119497.903216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.903317:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633522048 00000100:00100000:0.0:1787119497.903328:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633522048 00000100:00100000:0.0:1787119497.903386:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 211 00000100:00100000:0.0:1787119497.903396:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:32728:x1873929633522048:12345-192.168.201.59@tcp:35:fsx.0 00000001:00080000:0.0:1787119497.903732:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976562 00000100:00100000:0.0:1787119497.904063:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:32728:x1873929633522048:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 666us (855us total) trans 4294976563 rc 0/0 00000100:00100000:0.0:1787119497.904072:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 211 00000020:00080000:0.0:1787119497.904077:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119497.908856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.908891:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633522304 00000100:00100000:3.0:1787119497.908900:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633522304 00000100:00100000:3.0:1787119497.908941:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 212 00000100:00100000:3.0:1787119497.908950:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:32728:x1873929633522304:12345-192.168.201.59@tcp:35:fsx.0 00000100:00100000:3.0:1787119497.909316:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:32728:x1873929633522304:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 365us (468us total) trans 4294976564 rc 0/0 00000100:00100000:3.0:1787119497.909325:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 212 00000100:00100000:2.0:1787119497.944396:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633521280:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 67285us (67589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119497.944410:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5105 00000001:00080000:3.0:1787119497.945078:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969209 is committed 00000100:00100000:0.0:1787119497.948689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.949954:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633522560 00000100:00100000:3.0:1787119497.949965:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633522560 00000100:00100000:3.0:1787119497.950018:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 213 00000100:00100000:3.0:1787119497.950028:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:32727:x1873929633522560:12345-192.168.201.59@tcp:35:fsx.0 00000100:00100000:3.0:1787119497.950344:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:32727:x1873929633522560:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 316us (1665us total) trans 4294976565 rc 0/0 00000100:00100000:3.0:1787119497.950353:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 213 00000100:00100000:1.0:1787119497.985755:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633521792:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 88473us (88866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119497.985772:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5107 00000001:00080000:2.0:1787119497.985784:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969210 is committed 00000100:00100000:0.0:1787119497.989555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.989701:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633522816 00000100:00100000:3.0:1787119497.989711:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633522816 00000100:00100000:3.0:1787119497.989780:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19739 00000100:00100000:3.0:1787119497.989791:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:32729:x1873929633522816:12345-192.168.201.59@tcp:36:fsx.0 00010000:00010000:3.0:1787119497.989860:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119497.989890:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e56 expref: 54 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.989910:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:3.0:1787119497.989915:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119497.990130:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.990145:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119497.990156:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787119497.990207:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976566 00000004:00010000:3.0:1787119497.990231:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbfb777a reply state 000000005f1d639d transno 4294976567 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119497.990241:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787119497.990541:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:32729:x1873929633522816:12345-192.168.201.59@tcp:36:fsx.0 Request processed in 750us (996us total) trans 4294976567 rc 0/0 00000100:00100000:3.0:1787119497.990549:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19739 00000020:00080000:3.0:1787119497.990554:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787119497.994970:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.994987:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.994995:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.995001:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119497.995006:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.995013:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.995028:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119497.995031:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119497.995035:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119497.995040:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e3532 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119497.995493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.995649:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633522944 00000100:00100000:3.0:1787119497.995659:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633522944 00002000:00010000:3.0:1787119497.995702:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (25582583->18446744073709551615) 00002000:00100000:3.0:1787119497.995706:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633522944 ext(25582583->18446744073709551615) 00002000:00010000:3.0:1787119497.995719:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29f80. 00000100:00100000:3.0:1787119497.995754:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10552 00000100:00100000:3.0:1787119497.995764:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633522944:12345-192.168.201.59@tcp:10:fsx.0 00002000:00010000:3.0:1787119497.996233:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 54126883 -> 25582583 00002000:00010000:3.0:1787119497.996238:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787119496 -> 1787119496 00002000:00010000:3.0:1787119497.996241:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787119496 -> 1787119496 00002000:00010000:3.0:1787119497.996243:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787119496 -> 1787119496 00002000:00010000:3.0:1787119497.996245:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 1807 -> 1549 00000100:00100000:3.0:1787119497.996379:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633522944:12345-192.168.201.59@tcp:10:fsx.0 Request processed in 539us (814us total) trans 4294969211 rc 0/0 00000100:00100000:3.0:1787119497.996389:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10552 00002000:00010000:3.0:1787119497.996392:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/35 (25582583->18446744073709551615) 00002000:00100000:3.0:1787119497.996395:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633522944 ext(25582583->18446744073709551615) 00002000:00010000:3.0:1787119497.996400:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29f80. 00000100:00100000:3.0:1787119497.999026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119497.999119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119497.999771:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633523072 00000100:00100000:1.0:1787119497.999968:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633523200 00000100:00100000:1.0:1787119497.999983:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633523200 00000100:00100000:0.0:1787119498.000017:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633523072 00000100:00100000:1.0:1787119498.000048:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19740 00000100:00100000:1.0:1787119498.000058:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:32729:x1873929633523200:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:1.0:1787119498.000080:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119498.000102:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e6b expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119498.000131:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5108 00000100:00100000:0.0:1787119498.000138:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:32727:x1873929633523072:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:0.0:1787119498.000145:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119498.000156:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3540 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e64 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119498.000176:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a82619ee/0xcaba3de8463df2ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471480d expref: 14 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119498.000182:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e3547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119498.000184:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=43s v=(0 0) 00010000:00010000:0.0:1787119498.000189:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119498.000194:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e3547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119498.000194:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3540 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e64 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119498.000206:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e3547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119498.000226:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a82619ee/0xcaba3de8463df2ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471480d expref: 14 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119498.000232:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 25582583 00000004:00200000:1.0:1787119498.000235:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:0.0:1787119498.000250:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a82619ee/0xcaba3de8463df2ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471480d expref: 14 pid: 12469 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787119498.000251:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e3547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119498.000265:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653568000:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119498.000277:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431200/0xcaba3de8463e3539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e6b expref: 57 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119498.000294:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430e00/0xcaba3de8463e3547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e6b expref: 56 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119498.000302:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff92a609aaf900) 00010000:00010000:1.0:1787119498.000305:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119498.000308:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430e00, rc 0) 00000100:00100000:0.0:1787119498.000646:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3000 going to sleep for 10 seconds 00000100:00100000:1.0:1787119498.002634:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:32729:x1873929633523200:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 2565us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119498.002647:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19740 00000100:00100000:0.0:1787119498.007928:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653568000:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119498.007968:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3540 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e64 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119498.007990:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80a00, rc 0) 00000100:00100000:0.0:1787119498.008055:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:32727:x1873929633523072:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 7915us (9036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119498.008064:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5108 00000100:00100000:3.0:1787119498.008549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119498.008591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119498.008679:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633523328 00000100:00100000:2.0:1787119498.008687:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633523328 00010000:00010000:2.0:1787119498.008720:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a82619ee/0xcaba3de8463df2ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471480d expref: 14 pid: 12469 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119498.008754:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5203 00000100:00100000:2.0:1787119498.008763:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633523328:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119498.008776:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119498.008798:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a82619ee/0xcaba3de8463df2ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471480d expref: 14 pid: 12469 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119498.008824:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a82619ee/0xcaba3de8463df2ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471480d expref: 14 pid: 12469 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119498.008849:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a82619ee/0xcaba3de8463df2ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471480d expref: 14 pid: 12469 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119498.008865:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119498.008869:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119498.008877:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e64 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119498.008887:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3540 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e64 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119498.008926:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3540 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e64 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119498.008941:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653568128:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119498.009004:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61819d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119498.011698:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633523456 00000100:00100000:0.0:1787119498.011713:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633523456 00002000:00100000:0.0:1787119498.011768:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (8941568->8945663) req@ffff92a511630000 x1873929633523456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/0 e 0 to 0 dl 1787119509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119498.011780:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630000 with x1873929633523456 ext(8941568->8945663) 00002000:00010000:0.0:1787119498.011785:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511630000 00000100:00100000:0.0:1787119498.011876:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10553 00000100:00100000:0.0:1787119498.011887:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633523456:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119498.012138:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633523456:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 252us (3545us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119498.012145:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10553 00002000:00100000:0.0:1787119498.012152:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x23:0x0] (8941568->8945663) req@ffff92a511630000 x1873929633523456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/4536 e 0 to 0 dl 1787119509 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119498.012160:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630000 with x1873929633523456 ext(8941568->8945663) 00002000:00010000:0.0:1787119498.012163:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511630000 00000100:00100000:2.0:1787119498.016498:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653568128:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119498.016531:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119498.016594:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633523328:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7830us (8046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119498.016607:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5203 00000100:00100000:3.0:1787119498.017963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119498.018243:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633523712 00000100:00100000:0.0:1787119498.018252:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633523712 00000100:00100000:0.0:1787119498.018314:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 214 00000100:00100000:0.0:1787119498.018324:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:32727:x1873929633523712:12345-192.168.201.59@tcp:35:fsx.0 00000001:00080000:0.0:1787119498.018659:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976568 00000100:00100000:0.0:1787119498.018748:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+58:32727:x1873929633523712:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 426us (792us total) trans 4294976569 rc 0/0 00000100:00100000:0.0:1787119498.018753:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 214 00000020:00080000:0.0:1787119498.018757:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119498.023124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119498.023170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119498.023194:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633523840 00000100:00100000:2.0:1787119498.023204:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633523840 00002000:00100000:2.0:1787119498.023254:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (8945664->8949759) req@ffff92a519d26680 x1873929633523840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/0 e 0 to 0 dl 1787119509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119498.023265:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26680 with x1873929633523840 ext(8945664->8949759) 00002000:00010000:2.0:1787119498.023271:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d26680 00000100:00100000:2.0:1787119498.023307:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10554 00000100:00100000:2.0:1787119498.023317:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633523840:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119498.023603:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633523840:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 286us (488us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119498.023611:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10554 00002000:00100000:2.0:1787119498.023617:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (8945664->8949759) req@ffff92a519d26680 x1873929633523840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/4536 e 0 to 0 dl 1787119509 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119498.023631:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26680 with x1873929633523840 ext(8945664->8949759) 00002000:00010000:2.0:1787119498.023635:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d26680 00000100:00100000:0.0:1787119498.023817:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633524096 00000100:00100000:0.0:1787119498.023823:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633524096 00000100:00100000:0.0:1787119498.023862:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 215 00000100:00100000:0.0:1787119498.023870:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+58:32727:x1873929633524096:12345-192.168.201.59@tcp:35:fsx.0 00000100:00100000:0.0:1787119498.026796:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+59:32727:x1873929633524096:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 2913us (3612us total) trans 4294976570 rc 0/0 00000100:00100000:0.0:1787119498.026811:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 215 00000100:00100000:3.0:1787119498.028776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119498.028865:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633524224 00000100:00100000:2.0:1787119498.028875:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633524224 00002000:00100000:2.0:1787119498.028923:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (8921088->8986623) req@ffff92a519d25880 x1873929633524224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 504/0 e 0 to 0 dl 1787119509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119498.028934:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25880 with x1873929633524224 ext(8921088->8986623) 00002000:00010000:2.0:1787119498.028939:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25880 00000100:00100000:2.0:1787119498.028978:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10555 00000100:00100000:2.0:1787119498.028987:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633524224:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119498.033909:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633524224:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4910us (5129us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119498.033922:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10555 00002000:00100000:2.0:1787119498.033935:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x23:0x0] (8921088->8986623) req@ffff92a519d25880 x1873929633524224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 504/440 e 0 to 0 dl 1787119509 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119498.033946:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25880 with x1873929633524224 ext(8921088->8986623) 00002000:00010000:2.0:1787119498.033951:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25880 00000100:00100000:1.0:1787119498.043245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119498.043324:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633524352 00000100:00100000:0.0:1787119498.043334:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633524352 00002000:00100000:0.0:1787119498.043384:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (7327744->7376895) req@ffff92a508da7100 x1873929633524352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/0 e 0 to 0 dl 1787119509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119498.043396:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7100 with x1873929633524352 ext(7327744->7376895) 00002000:00010000:0.0:1787119498.043402:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7100 00000100:00100000:0.0:1787119498.043475:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10556 00000100:00100000:0.0:1787119498.043485:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633524352:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:0.0:1787119498.051142:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633524352:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 7647us (7896us total) trans 0 rc 49152/49152 00000100:00100000:0.0:1787119498.051162:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10556 00002000:00100000:0.0:1787119498.051178:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23:0x0] (7327744->7376895) req@ffff92a508da7100 x1873929633524352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/440 e 0 to 0 dl 1787119509 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119498.051188:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7100 with x1873929633524352 ext(7327744->7376895) 00002000:00010000:0.0:1787119498.051196:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7100 00000100:00100000:3.0:1787119498.064238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119498.064425:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633524480 00000100:00100000:2.0:1787119498.064467:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633524480 00002000:00100000:2.0:1787119498.064535:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (995328->999423) req@ffff92a519d27800 x1873929633524480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/0 e 0 to 0 dl 1787119509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119498.064547:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27800 with x1873929633524480 ext(995328->999423) 00002000:00010000:2.0:1787119498.064553:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27800 00000100:00100000:2.0:1787119498.064584:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10557 00000100:00100000:2.0:1787119498.064594:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633524480:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119498.064994:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633524480:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 399us (766us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119498.065003:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10557 00002000:00100000:2.0:1787119498.065010:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x23:0x0] (995328->999423) req@ffff92a519d27800 x1873929633524480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/4536 e 0 to 0 dl 1787119509 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119498.065019:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27800 with x1873929633524480 ext(995328->999423) 00002000:00010000:2.0:1787119498.065023:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27800 00000100:00100000:1.0:1787119498.069424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119498.069585:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633524608 00000100:00100000:3.0:1787119498.069596:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633524608 00002000:00100000:3.0:1787119498.069649:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (999424->1003519) req@ffff92a508da6300 x1873929633524608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/0 e 0 to 0 dl 1787119509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119498.069660:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6300 with x1873929633524608 ext(999424->1003519) 00002000:00010000:3.0:1787119498.069666:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6300 00000100:00100000:3.0:1787119498.069703:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10558 00000100:00100000:3.0:1787119498.069713:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633524608:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:3.0:1787119498.070143:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633524608:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 430us (736us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119498.070151:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10558 00002000:00100000:3.0:1787119498.070158:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x23:0x0] (999424->1003519) req@ffff92a508da6300 x1873929633524608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/4536 e 0 to 0 dl 1787119509 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119498.070166:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6300 with x1873929633524608 ext(999424->1003519) 00002000:00010000:3.0:1787119498.070169:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da6300 00000100:00100000:0.0:1787119498.075039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119498.075179:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633524736 00000100:00100000:2.0:1787119498.075189:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633524736 00002000:00100000:2.0:1787119498.075239:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x23:0x0] (974848->1040383) req@ffff92a63eb2b800 x1873929633524736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 504/0 e 0 to 0 dl 1787119509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119498.075250:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633524736 ext(974848->1040383) 00002000:00010000:2.0:1787119498.075257:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b800 00000100:00100000:1.0:1787119498.075470:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10559 00000100:00100000:1.0:1787119498.075483:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633524736:12345-192.168.201.59@tcp:3:fsx.0 00000100:00100000:2.0:1787119498.079863:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633524736:12345-192.168.201.59@tcp:3:fsx.0 Request processed in 4371us (4822us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1787119498.079876:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10559 00002000:00100000:2.0:1787119498.079889:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (974848->1040383) req@ffff92a63eb2b800 x1873929633524736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 504/440 e 0 to 0 dl 1787119509 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119498.079900:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633524736 ext(974848->1040383) 00002000:00010000:2.0:1787119498.079907:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b800 00000100:00100000:3.0:1787119498.089838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119498.090060:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633524864 00000100:00100000:0.0:1787119498.090071:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633524864 00002000:00100000:0.0:1787119498.090121:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (995328->1023999) req@ffff92a519d24e00 x1873929633524864/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/0 e 0 to 0 dl 1787119509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119498.090133:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24e00 with x1873929633524864 ext(995328->1023999) 00002000:00010000:0.0:1787119498.090138:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d24e00 00000100:00100000:0.0:1787119498.090171:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10560 00000100:00100000:0.0:1787119498.090181:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633524864:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:0.0:1787119498.103224:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633524864:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 13034us (13385us total) trans 4294969212 rc 0/0 00000100:00100000:0.0:1787119498.103237:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10560 00002000:00100000:0.0:1787119498.103249:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (995328->1023999) req@ffff92a519d24e00 x1873929633524864/t4294969212(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:534/0 lens 488/448 e 0 to 0 dl 1787119509 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119498.103260:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24e00 with x1873929633524864 ext(995328->1023999) 00002000:00010000:0.0:1787119498.103266:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d24e00 00000100:00100000:2.0:1787119498.120693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119498.121197:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633524992 00000100:00100000:3.0:1787119498.121209:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633524992 00000100:00100000:3.0:1787119498.121384:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5109 00000100:00100000:3.0:1787119498.121400:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633524992:12345-192.168.201.59@tcp:16:fsx.0 00000001:00080000:2.0:1787119498.189472:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969212 is committed 00000100:00100000:0.0:1787119498.189638:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633524992:12345-192.168.201.59@tcp:16:fsx.0 Request processed in 68236us (68948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119498.189654:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5109 00000100:00100000:3.0:1787119498.203812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119498.203967:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633525248 00000100:00100000:0.0:1787119498.203977:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633525248 00000100:00100000:0.0:1787119498.204038:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 216 00000100:00100000:0.0:1787119498.204048:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6080be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+59:32729:x1873929633525248:12345-192.168.201.59@tcp:35:fsx.0 00000100:00100000:0.0:1787119498.204376:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6080be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+60:32729:x1873929633525248:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 329us (573us total) trans 4294976571 rc 0/0 00000100:00100000:0.0:1787119498.204384:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 216 00010000:00010000:2.0:1787119498.210432:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119498.244976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119498.245046:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633525376 00000100:00100000:3.0:1787119498.245054:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633525376 00000100:00100000:3.0:1787119498.245098:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5110 00000100:00100000:3.0:1787119498.245105:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:32729:x1873929633525376:12345-192.168.201.59@tcp:101:fsx.0 00010000:00010000:3.0:1787119498.245120:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119498.245140:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e354e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e72 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119498.245173:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463df3ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204714853 expref: 13 pid: 8267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119498.245189:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=42s v=(0 0) 00010000:00010000:3.0:1787119498.245192:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787119498.245196:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e354e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e72 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119498.245228:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463df3ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204714853 expref: 13 pid: 8267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119498.245251:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463df3ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714853 expref: 13 pid: 8267 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119498.245263:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653568256:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119498.245513:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a507972300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119498.252720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119498.253540:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633525504 00000100:00100000:0.0:1787119498.253550:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633525504 00010000:00010000:0.0:1787119498.253588:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463df3ae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714853 expref: 14 pid: 8267 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119498.253618:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5204 00000100:00100000:0.0:1787119498.253625:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633525504:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119498.253638:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119498.253656:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463df3ae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714853 expref: 14 pid: 8267 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119498.253676:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463df3ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714853 expref: 14 pid: 8267 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119498.253696:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787119498.253699:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787119498.253706:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e354e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e72 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119498.253713:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e354e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e72 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119498.253742:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e354e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e72 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119498.253753:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653568384:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119498.253834:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119498.256641:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653568384:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119498.256665:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119498.256712:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633525504:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3087us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119498.256721:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5204 00010000:00010000:2.0:1787119498.258366:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463df3ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204714853 expref: 13 pid: 8267 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119498.258387:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653568256:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119498.258425:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e354e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e72 expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119498.258476:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:2.0:1787119498.258695:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:32729:x1873929633525376:12345-192.168.201.59@tcp:101:fsx.0 Request processed in 13590us (13727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119498.258701:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5110 00000100:00100000:0.0:1787119498.269686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119498.269882:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633525760 00000100:00100000:3.0:1787119498.269893:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633525760 00000100:00100000:3.0:1787119498.270103:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 217 00000100:00100000:3.0:1787119498.270115:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+60:32729:x1873929633525760:12345-192.168.201.59@tcp:35:fsx.0 00000001:00080000:3.0:1787119498.270842:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976572 00000100:00100000:3.0:1787119498.271017:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+62:32729:x1873929633525760:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 902us (1343us total) trans 4294976573 rc 0/0 00000100:00100000:3.0:1787119498.271026:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 217 00000020:00080000:3.0:1787119498.271031:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119498.273255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119498.273717:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633526016 00000100:00100000:2.0:1787119498.273727:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633526016 00000100:00100000:2.0:1787119498.273787:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 218 00000100:00100000:2.0:1787119498.273797:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+62:32729:x1873929633526016:12345-192.168.201.59@tcp:35:fsx.0 00000100:00100000:2.0:1787119498.274174:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+63:32729:x1873929633526016:12345-192.168.201.59@tcp:35:fsx.0 Request processed in 376us (925us total) trans 4294976574 rc 0/0 00000100:00100000:2.0:1787119498.274182:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 218 00000100:00100000:0.0:1787119498.402006:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653568512:0@lo:400:kworker.0 00000100:00100000:0.0:1787119498.402111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119498.402279:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653568768:0@lo:400:kworker.0 00000100:00100000:2.0:1787119498.402318:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119498.402380:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787119498.402386:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653568640:0@lo:400:kworker.0 00000100:00100000:2.0:1787119498.402408:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119498.402468:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653569152:0@lo:400:kworker.0 00000100:00100000:2.0:1787119498.402496:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119498.402972:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653569024:0@lo:400:kworker.0 00000100:00100000:0.0:1787119498.403002:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119498.403018:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787119498.403024:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653568896:0@lo:400:kworker.0 00000100:00100000:0.0:1787119498.403047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119498.403090:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653568768 00000100:00100000:0.0:1787119498.403097:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653568768 00000100:00100000:0.0:1787119498.403148:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653568640 00000100:00100000:0.0:1787119498.403152:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653568640 00000100:00100000:0.0:1787119498.403169:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653569024 00000100:00100000:0.0:1787119498.403172:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653569024 00000100:00100000:0.0:1787119498.403195:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1787119498.403203:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653568768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119498.403252:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653568768:12345-0@lo:400:kworker.0 Request processed in 50us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119498.403260:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1787119498.403276:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1787119498.403281:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653568640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119498.403310:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653568640:12345-0@lo:400:kworker.0 Request processed in 29us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119498.403316:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1787119498.403327:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1787119498.403333:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653569024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119498.403364:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653569024:12345-0@lo:400:kworker.0 Request processed in 31us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119498.403370:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00080000:0.0:1787119498.403386:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119498.403429:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653569024:0@lo:400:kworker.0 00000100:00100000:0.0:1787119498.403481:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653569152 00000100:00100000:0.0:1787119498.403497:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653569152 00000100:00100000:2.0:1787119498.403919:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653568640:0@lo:400:kworker.0 00000100:00100000:2.0:1787119498.403932:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653568768:0@lo:400:kworker.0 00000100:00080000:2.0:1787119498.403966:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119498.404713:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653568896 00000100:00100000:3.0:1787119498.404720:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653568896 00000100:00100000:3.0:1787119498.404765:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1787119498.404774:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653569152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119498.404862:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653569152:12345-0@lo:400:kworker.0 Request processed in 90us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119498.404869:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1787119498.404884:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1787119498.404891:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653568896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119498.404926:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653568896:12345-0@lo:400:kworker.0 Request processed in 36us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119498.404931:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1787119498.404992:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787119498.405003:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653569280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119498.405036:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119498.405069:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653569280 00000100:00100000:3.0:1787119498.405072:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653569280 00000100:00100000:3.0:1787119498.405095:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787119498.405101:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653569280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787119498.405126:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 313327616 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1787119498.405161:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653569280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119498.405168:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:3.0:1787119498.405185:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119498.405208:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653569280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119498.405235:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653569152:0@lo:400:kworker.0 00000100:00100000:3.0:1787119498.405257:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653568896:0@lo:400:kworker.0 00000100:00100000:0.0:1787119498.408081:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787119498.408105:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653569408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119498.408192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119498.408749:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653569408 00000100:00100000:2.0:1787119498.408757:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653569408 00000100:00100000:2.0:1787119498.408818:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787119498.408829:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653569408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787119498.408852:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 831324160 pending 0 free 3828350976 avail 3807379456 00000100:00100000:2.0:1787119498.408900:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653569408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119498.408907:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787119498.411189:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653569408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119498.412099:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653568512 00000100:00100000:1.0:1787119498.412109:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653568512 00000100:00100000:1.0:1787119498.412171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1787119498.412180:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653568512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119498.412271:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653568512:12345-0@lo:400:kworker.0 Request processed in 92us (10160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119498.412278:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1787119498.412397:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653568512:0@lo:400:kworker.0 00010000:00010000:0.0:1787119499.233659:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119500.258983:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119501.203513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119501.203561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119501.203597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119501.203629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119501.203649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119501.203684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119501.203707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119501.203737:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633526656 00000100:00100000:0.0:1787119501.203747:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633526656 00000100:00100000:0.0:1787119501.203806:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633526272 00000100:00100000:0.0:1787119501.203809:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633526272 00000100:00100000:0.0:1787119501.203832:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 683 00000100:00100000:0.0:1787119501.203842:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2376:x1873929633526656:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119501.203915:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2376:x1873929633526656:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 74us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119501.203936:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 683 00000100:00100000:0.0:1787119501.203952:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 684 00000100:00100000:0.0:1787119501.203959:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+63:2376:x1873929633526272:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119501.203990:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+63:2376:x1873929633526272:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119501.203996:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 684 00000100:00100000:1.0:1787119501.204092:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633526144 00000100:00100000:1.0:1787119501.204097:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633526144 00000100:00100000:1.0:1787119501.204138:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 516 00000100:00100000:1.0:1787119501.204146:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633526144:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119501.204175:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633526144:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 30us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119501.204182:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 516 00000100:00100000:2.0:1787119501.204736:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633526400 00000100:00100000:2.0:1787119501.204742:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633526400 00000100:00100000:2.0:1787119501.204781:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633526912 00000100:00100000:2.0:1787119501.204784:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633526912 00000100:00100000:2.0:1787119501.204809:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633526528 00000100:00100000:2.0:1787119501.204813:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633526528 00000100:00100000:0.0:1787119501.205093:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633526784 00000100:00100000:0.0:1787119501.205098:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633526784 00000100:00100000:0.0:1787119501.205128:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 578 00000100:00100000:0.0:1787119501.205135:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633526400:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119501.205399:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633526400:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 263us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119501.205406:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 578 00000100:00100000:0.0:1787119501.205422:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 579 00000100:00100000:0.0:1787119501.205429:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633526912:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119501.205486:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633526912:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 57us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119501.205493:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 579 00000100:00100000:0.0:1787119501.205505:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 580 00000100:00100000:0.0:1787119501.205511:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633526528:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119501.205534:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633526528:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 23us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119501.205540:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 580 00000100:00100000:0.0:1787119501.205550:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 581 00000100:00100000:0.0:1787119501.205556:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633526784:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119501.205581:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633526784:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119501.205586:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 581 00000100:00080000:0.0:1787119501.205708:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119501.205713:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119501.205715:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787119501.288481:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119502.306541:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787119502.576873:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976571 is committed 00000001:00080000:1.0:1787119502.576935:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976574 is committed 00000100:00100000:0.0:1787119502.750697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119502.760548:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633527040 00000100:00100000:2.0:1787119502.760566:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633527040 00000100:00100000:2.0:1787119502.760690:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 50 00000100:00100000:2.0:1787119502.760701:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2374:x1873929633527040:12345-192.168.201.59@tcp:63:ll_sa.0 00010000:00010000:2.0:1787119502.760758:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119502.760822:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e79 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.760892:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.760906:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.760916:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.760943:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.760951:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.760959:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761526:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761537:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761543:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761549:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119502.761553:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761563:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761577:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038b00) 00010000:00010000:2.0:1787119502.761580:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119502.761584:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761590:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e355c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761600:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761605:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761610:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761615:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119502.761618:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761622:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761629:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e30eec7 (ffff92a620038400) 00010000:00010000:2.0:1787119502.761632:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119502.761635:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.761644:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e3563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e30eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.762274:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3555 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e79 expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.762288:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038b00) 00010000:00010000:2.0:1787119502.762291:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787119502.762296:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e79 expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119502.762311:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93e00, rc -2) 00000100:00100000:2.0:1787119502.762403:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2374:x1873929633527040:12345-192.168.201.59@tcp:63:ll_sa.0 Request processed in 1703us (11715us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787119502.762411:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 50 00010000:00010000:0.0:1787119503.329670:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119503.522026:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653569664:0@lo:400:kworker.0 00000100:00100000:3.0:1787119503.522109:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119503.522164:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653570176:0@lo:400:kworker.0 00000100:00100000:3.0:1787119503.522194:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119503.522223:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787119503.522229:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653569792:0@lo:400:kworker.0 00000100:00100000:3.0:1787119503.522250:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119503.522267:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653570304:0@lo:400:kworker.0 00000100:00100000:3.0:1787119503.522289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119503.522335:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653570176 00000100:00100000:3.0:1787119503.522342:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653570176 00000100:00100000:3.0:1787119503.522390:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653569792 00000100:00100000:3.0:1787119503.522393:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653569792 00000100:00100000:3.0:1787119503.522414:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1787119503.522423:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653570176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119503.522498:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653570176:12345-0@lo:400:kworker.0 Request processed in 76us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119503.522505:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1787119503.522520:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1787119503.522525:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653569792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119503.522545:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653569792:12345-0@lo:400:kworker.0 Request processed in 20us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119503.522550:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1787119503.522581:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653569792:0@lo:400:kworker.0 00000100:00100000:3.0:1787119503.522590:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653570176:0@lo:400:kworker.0 00000100:00100000:2.0:1787119503.523533:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653569664 00000100:00100000:2.0:1787119503.523544:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653569664 00000100:00100000:2.0:1787119503.523581:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1787119503.523589:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653569664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119503.523656:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653569664:12345-0@lo:400:kworker.0 Request processed in 67us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119503.523662:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1787119503.523712:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653569664:0@lo:400:kworker.0 00000100:00100000:1.0:1787119503.524563:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653569920:0@lo:400:kworker.0 00000100:00100000:1.0:1787119503.524610:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119503.524646:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787119503.524652:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653569536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787119503.524673:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119503.524690:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653570048:0@lo:400:kworker.0 00000100:00100000:1.0:1787119503.524706:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119503.524734:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653569536 00000100:00100000:1.0:1787119503.524738:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653569536 00000100:00100000:1.0:1787119503.524783:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787119503.524790:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653569536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787119503.524827:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 313327616 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1787119503.524862:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653569536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119503.524963:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787119503.525063:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653569536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119503.525255:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653570304 00000100:00100000:0.0:1787119503.525260:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653570304 00000100:00100000:0.0:1787119503.525293:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653570048 00000100:00100000:0.0:1787119503.525296:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653570048 00000100:00100000:0.0:1787119503.525312:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1787119503.525319:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653570304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119503.525373:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653570304:12345-0@lo:400:kworker.0 Request processed in 54us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119503.525379:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1787119503.525391:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1787119503.525396:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653570048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119503.525429:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653570048:12345-0@lo:400:kworker.0 Request processed in 28us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119503.525455:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00080000:0.0:1787119503.525470:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119503.525473:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119503.525475:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119503.525486:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653569920 00000100:00100000:0.0:1787119503.525489:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653569920 00000100:00100000:0.0:1787119503.525517:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1787119503.525522:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653569920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119503.525551:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653569920:12345-0@lo:400:kworker.0 Request processed in 29us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119503.525556:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00080000:0.0:1787119503.525581:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119503.525850:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653570304:0@lo:400:kworker.0 00000100:00100000:1.0:1787119503.526071:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653570432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119503.526164:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119503.526196:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653570048:0@lo:400:kworker.0 00000100:00100000:1.0:1787119503.526206:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653569920:0@lo:400:kworker.0 00000100:00100000:3.0:1787119503.526625:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653570432 00000100:00100000:3.0:1787119503.526630:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653570432 00000100:00100000:3.0:1787119503.526716:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787119503.526725:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653570432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119503.526749:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 831324160 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1787119503.526789:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653570432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119503.526806:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787119503.527622:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653570432:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787119504.353739:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119505.382221:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119506.330405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119506.330594:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633527168 00000100:00100000:0.0:1787119506.330607:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633527168 00000100:00100000:0.0:1787119506.330668:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 518 00000100:00100000:0.0:1787119506.330678:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633527168:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119506.330765:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633527168:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 88us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119506.330772:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 518 00000100:00100000:3.0:1787119506.330973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119506.331080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119506.331152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119506.331171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119506.331188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119506.331207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119506.331226:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633527680 00000100:00100000:3.0:1787119506.331230:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633527680 00000100:00100000:3.0:1787119506.331263:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633527296 00000100:00100000:3.0:1787119506.331266:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633527296 00000100:00100000:3.0:1787119506.331296:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 688 00000100:00100000:3.0:1787119506.331304:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2375:x1873929633527680:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119506.331341:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2375:x1873929633527680:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 38us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119506.331351:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 688 00000100:00100000:3.0:1787119506.331365:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 689 00000100:00100000:3.0:1787119506.331371:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633527296:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119506.331395:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633527296:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119506.331401:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 689 00000100:00100000:3.0:1787119506.331422:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633527424 00000100:00100000:3.0:1787119506.331426:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633527424 00000100:00100000:0.0:1787119506.331718:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633527936 00000100:00100000:0.0:1787119506.331724:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633527936 00000100:00100000:0.0:1787119506.331751:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633527552 00000100:00100000:0.0:1787119506.331754:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633527552 00000100:00100000:0.0:1787119506.331771:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633527808 00000100:00100000:0.0:1787119506.331773:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633527808 00000100:00100000:0.0:1787119506.331792:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 584 00000100:00100000:0.0:1787119506.331798:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633527936:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119506.331828:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633527936:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 30us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119506.331834:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 584 00000100:00100000:0.0:1787119506.331847:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 585 00000100:00100000:0.0:1787119506.331853:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633527552:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119506.331876:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633527552:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 23us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119506.331881:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 585 00000100:00100000:0.0:1787119506.331894:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 586 00000100:00100000:0.0:1787119506.331900:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633527808:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119506.331922:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633527808:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 22us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119506.331928:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 586 00000100:00080000:0.0:1787119506.331949:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119506.331954:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119506.331955:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119506.332230:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 587 00000100:00100000:3.0:1787119506.332236:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633527424:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119506.332263:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633527424:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 27us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119506.332270:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 587 00000100:00080000:0.0:1787119506.332956:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787119506.409069:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787119507.177193:0:21052:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 17: resource creation/LVB creation race ========================================================================= 02:05:04 (1787119504) 00010000:00010000:0.0:1787119507.425739:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119507.703967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.704071:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633528064 00000100:00100000:0.0:1787119507.704081:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633528064 00000100:00100000:0.0:1787119507.704154:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19741 00000100:00100000:0.0:1787119507.704165:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:33365:x1873929633528064:12345-192.168.201.59@tcp:101:lfs.0 00010000:00010000:0.0:1787119507.704194:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119507.704217:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e356a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e80 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.704297:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e3571 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.704313:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e3571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.704322:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e3571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119507.704556:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119507.704560:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 42 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119507.704631:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e3571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.704654:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e356a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e80 expref: 36 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.704672:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e3571 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e80 expref: 35 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.704680:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ee00) 00010000:00010000:0.0:1787119507.704683:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119507.704686:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80800, rc 0) 00000100:00100000:0.0:1787119507.704742:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33365:x1873929633528064:12345-192.168.201.59@tcp:101:lfs.0 Request processed in 580us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119507.704748:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19741 00000100:00100000:1.0:1787119507.707653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119507.707716:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633528320 00000100:00100000:3.0:1787119507.707729:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633528320 00000100:00100000:3.0:1787119507.707788:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19742 00000100:00100000:3.0:1787119507.707798:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33365:x1873929633528320:12345-192.168.201.59@tcp:101:lfs.0 00010000:00010000:3.0:1787119507.707819:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119507.707822:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787119507.707860:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e3571 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e80 expref: 35 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.707882:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ee00) 00010000:00010000:3.0:1787119507.707893:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119507.707908:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3578 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e87 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.708288:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.708302:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.708312:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.708378:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.708386:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.708393:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709499:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709513:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709523:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119507.709533:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 0 00010000:00010000:3.0:1787119507.709561:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709572:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709578:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709585:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119507.709590:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709597:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709608:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a60384c100) 00010000:00010000:3.0:1787119507.709611:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119507.709615:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709620:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e357f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787119507.709632:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a490e99 reply state 0000000037c5e18f transno 4294976575 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119507.709642:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787119507.709674:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3578 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e87 expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709695:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e87 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.709708:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a60384c200) 00010000:00010000:3.0:1787119507.709710:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119507.709712:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1400, rc 0) 00000100:00100000:3.0:1787119507.709787:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33365:x1873929633528320:12345-192.168.201.59@tcp:101:lfs.0 Request processed in 1991us (2146us total) trans 4294976575 rc 0/0 00000100:00100000:3.0:1787119507.709795:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19742 00010000:00010000:0.0:1787119507.711970:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.711984:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.711990:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.711994:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119507.711998:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.712002:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.712018:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ec7601 (ffff92a60384cb00) 00010000:00010000:0.0:1787119507.712021:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119507.712025:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.712030:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e3586 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119507.714960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.715036:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633528576 00000100:00100000:0.0:1787119507.715046:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633528576 00000100:00100000:0.0:1787119507.715112:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19743 00000100:00100000:0.0:1787119507.715123:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33365:x1873929633528576:12345-192.168.201.59@tcp:101:lfs.0 00010000:00010000:0.0:1787119507.715219:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119507.715246:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e359b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e8e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.715361:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.715377:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e87 expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.715386:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.715418:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715e87 expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.715476:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715e87 expref: 37 pid: 5848 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119507.715702:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653570560:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119507.715802:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a618558c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119507.721553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.721624:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653570560:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119507.721662:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119507.721665:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633528704 00000100:00100000:1.0:1787119507.721674:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633528704 00010000:00010000:1.0:1787119507.721725:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715e87 expref: 38 pid: 5848 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119507.721764:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5205 00000100:00100000:1.0:1787119507.721774:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633528704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119507.721791:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119507.721799:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715e87 expref: 38 pid: 5848 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.721833:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715e87 expref: 38 pid: 5848 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.721862:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e358d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715e87 expref: 38 pid: 5848 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.721877:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a60384c200) 00010000:00010000:1.0:1787119507.721882:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.721891:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.721899:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.721927:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119507.721951:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.721958:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119507.721979:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 0 00000100:00100000:1.0:1787119507.721989:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633528704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 215us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119507.721998:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5205 00000004:00080000:0.0:1787119507.722375:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x29:0x0], index 0: 0 00010000:00010000:1.0:1787119507.724715:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.724732:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.724739:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.724747:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d81e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119507.724752:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.724764:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.724783:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a60384c200) 00010000:00010000:1.0:1787119507.724786:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787119507.724791:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.724797:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e35a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.724874:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e359b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e8e expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.724884:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3e900) 00010000:00010000:1.0:1787119507.724887:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787119507.724890:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e359b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e8e expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.724903:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80400, rc 0) 00000100:00100000:1.0:1787119507.724979:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33365:x1873929633528576:12345-192.168.201.59@tcp:101:lfs.0 Request processed in 9857us (10028us total) trans 4294976576 rc 301/301 00000100:00100000:1.0:1787119507.724985:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19743 00000100:00100000:3.0:1787119507.733927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.734024:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633528960 00000100:00100000:0.0:1787119507.734035:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633528960 00000100:00100000:0.0:1787119507.734105:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 219 00000100:00100000:0.0:1787119507.734115:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33365:x1873929633528960:12345-192.168.201.59@tcp:35:lfs.0 00000100:00100000:0.0:1787119507.735469:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33365:x1873929633528960:12345-192.168.201.59@tcp:35:lfs.0 Request processed in 1322us (1519us total) trans 4294976577 rc 0/0 00000100:00100000:0.0:1787119507.735483:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 219 00000100:00100000:3.0:1787119507.742261:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.742336:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633529088 00000100:00100000:0.0:1787119507.742347:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633529088 00000100:00100000:0.0:1787119507.742409:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19744 00000100:00100000:0.0:1787119507.742420:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33365:x1873929633529088:12345-192.168.201.59@tcp:101:lfs.0 00010000:00010000:0.0:1787119507.742479:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119507.742514:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e35b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e95 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.742577:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e35b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e95 expref: 38 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.742592:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81200/0xcaba3de8463e35b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e95 expref: 38 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.742612:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00010000:00010000:0.0:1787119507.742616:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787119507.742620:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d81200, rc 0) 00000100:00100000:0.0:1787119507.742682:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33365:x1873929633529088:12345-192.168.201.59@tcp:101:lfs.0 Request processed in 263us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119507.742689:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19744 00000100:00100000:2.0:1787119507.745575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119507.745770:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633529344 00000100:00100000:1.0:1787119507.745782:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633529344 00000100:00100000:1.0:1787119507.745845:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 220 00000100:00100000:1.0:1787119507.745855:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33365:x1873929633529344:12345-192.168.201.59@tcp:35:lfs.0 00000100:00100000:1.0:1787119507.746095:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33365:x1873929633529344:12345-192.168.201.59@tcp:35:lfs.0 Request processed in 240us (528us total) trans 4294976578 rc 0/0 00000100:00100000:1.0:1787119507.746103:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 220 00000100:00100000:3.0:1787119507.773566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.773633:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633529472 00000100:00100000:0.0:1787119507.773643:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633529472 00000100:00100000:0.0:1787119507.773762:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19745 00000100:00100000:0.0:1787119507.773772:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33366:x1873929633529472:12345-192.168.201.59@tcp:101:cp.0 00010000:00010000:0.0:1787119507.773794:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119507.773818:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e35b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715e9c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.773903:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e35be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.773917:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e35be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.773929:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e35be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119507.773991:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119507.773995:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 43 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119507.774034:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e35be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.774067:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e35b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e9c expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.774086:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e35be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e9c expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.774106:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ef00) 00010000:00010000:0.0:1787119507.774109:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119507.774113:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d81800, rc 0) 00000100:00100000:0.0:1787119507.774185:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33366:x1873929633529472:12345-192.168.201.59@tcp:101:cp.0 Request processed in 415us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119507.774192:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19745 00000100:00100000:3.0:1787119507.776410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119507.776622:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633529600 00000100:00100000:2.0:1787119507.776632:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633529600 00000100:00100000:2.0:1787119507.776759:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19746 00000100:00100000:2.0:1787119507.776771:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33366:x1873929633529600:12345-192.168.201.59@tcp:101:cp.0 00010000:00010000:2.0:1787119507.776795:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119507.776819:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e35c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ea3 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.776940:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.776953:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.776964:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.776980:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.776988:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.776994:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777333:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777343:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777349:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119507.777382:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 0 00000004:00200000:2.0:1787119507.777386:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119507.777406:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777417:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777425:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777431:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777520:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777528:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119507.777533:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777542:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777556:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ef00) 00010000:00010000:2.0:1787119507.777560:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119507.777565:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777571:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e35cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777585:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777590:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777596:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777600:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119507.777603:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777609:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777616:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ec7601 (ffff92a620038400) 00010000:00010000:2.0:1787119507.777618:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119507.777620:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777625:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e35d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777768:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e35c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ea3 expref: 42 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777783:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ea3 expref: 41 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.777791:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00010000:00010000:2.0:1787119507.777793:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119507.777796:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119507.777928:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33366:x1873929633529600:12345-192.168.201.59@tcp:101:cp.0 Request processed in 1160us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119507.777937:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19746 00000100:00100000:2.0:1787119507.792851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119507.792960:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633529728 00000100:00100000:3.0:1787119507.792970:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633529728 00000100:00100000:3.0:1787119507.793032:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5111 00000100:00100000:3.0:1787119507.793042:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633529728:12345-192.168.201.59@tcp:101:cp.0 00010000:00010000:3.0:1787119507.793069:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119507.793101:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715eaa expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119507.793134:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787119507.793158:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=1033s v=(0 0) 00010000:00010000:3.0:1787119507.793163:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787119507.793172:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715eaa expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.793195:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715eaa expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.793208:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119507.793276:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633529728:12345-192.168.201.59@tcp:101:cp.0 Request processed in 235us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119507.793283:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5111 00000100:00100000:3.0:1787119507.803114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.803431:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633529984 00000100:00100000:0.0:1787119507.803529:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633529984 00000100:00100000:0.0:1787119507.803591:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19747 00000100:00100000:0.0:1787119507.803601:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33366:x1873929633529984:12345-192.168.201.59@tcp:101:cp.0 00010000:00010000:0.0:1787119507.803620:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119507.803640:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e35e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715eb1 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.803808:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.803824:0:15720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ea3 expref: 42 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.803834:0:15720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.803867:0:15720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ea3 expref: 42 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.803893:0:15720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ea3 expref: 42 pid: 12121 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119507.803907:0:15720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653570688:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119507.804046:0:15720:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6051c1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119507.807554:0:15720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653570688:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119507.807585:0:15720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119507.810377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119507.810564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633530112 00000100:00100000:2.0:1787119507.810574:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633530112 00010000:00010000:2.0:1787119507.810617:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ea3 expref: 43 pid: 12121 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119507.810702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5206 00000100:00100000:2.0:1787119507.810713:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2375:x1873929633530112:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119507.810731:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119507.810738:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ea3 expref: 43 pid: 12121 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.810765:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ea3 expref: 43 pid: 12121 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.810795:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e35da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ea3 expref: 43 pid: 12121 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.810811:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00010000:00010000:2.0:1787119507.810817:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.810826:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.810833:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.810868:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119507.810926:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633530112:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 215us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119507.810935:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5206 00010000:00010000:0.0:1787119507.811471:0:15720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.811482:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119507.811503:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 0 00010000:00010000:0.0:1787119507.811678:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e35e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715eb1 expref: 43 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.811698:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715eb1 expref: 42 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.811705:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00010000:00010000:0.0:1787119507.811708:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787119507.811711:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d81c00, rc 0) 00000100:00100000:0.0:1787119507.811765:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33366:x1873929633529984:12345-192.168.201.59@tcp:101:cp.0 Request processed in 8166us (8662us total) trans 4294976579 rc 0/0 00000100:00100000:0.0:1787119507.811773:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19747 00000100:00100000:3.0:1787119507.813991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.814319:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633530368 00000100:00100000:0.0:1787119507.814329:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633530368 00000100:00100000:0.0:1787119507.814388:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19748 00000100:00100000:0.0:1787119507.814398:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33366:x1873929633530368:12345-192.168.201.59@tcp:36:cp.0 00010000:00010000:0.0:1787119507.814848:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.814867:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.814879:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119507.814931:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976580 00000004:00010000:0.0:1787119507.814956:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023fbb20f reply state 000000002276ca0f transno 4294976581 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119507.814965:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119507.815691:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33366:x1873929633530368:12345-192.168.201.59@tcp:36:cp.0 Request processed in 1291us (1705us total) trans 4294976581 rc 0/0 00000100:00100000:0.0:1787119507.815700:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19748 00000020:00080000:0.0:1787119507.815705:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119507.819852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119507.819987:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633530496 00000100:00100000:2.0:1787119507.819998:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633530496 00000100:00100000:2.0:1787119507.820075:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5112 00000100:00100000:2.0:1787119507.820086:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:33366:x1873929633530496:12345-192.168.201.59@tcp:101:cp.0 00010000:00010000:2.0:1787119507.820113:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119507.820144:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e3604 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715eb8 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.820177:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715eaa expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.820192:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119507.820197:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119507.820201:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e3604 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.59@tcp remote: 0xa889273204715eb8 expref: 11 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.820235:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.59@tcp remote: 0xa889273204715eaa expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.820270:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715eaa expref: 11 pid: 6695 timeout: 1133 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119507.820285:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20843:1873929653570816:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119507.820371:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604c11480 going to sleep for 11 seconds 00010000:00010000:3.0:1787119507.829949:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.829967:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.829975:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.829981:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119507.829986:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.829993:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.830009:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00000100:00100000:1.0:1787119507.830591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119507.830843:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20843:1873929653570816:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119507.830879:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e3604 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.59@tcp remote: 0xa889273204715eb8 expref: 11 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.830898:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92000, rc 0) 00000100:00100000:2.0:1787119507.830947:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:33366:x1873929633530496:12345-192.168.201.59@tcp:101:cp.0 Request processed in 10864us (11105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119507.830956:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5112 00000100:00100000:0.0:1787119507.831037:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633530624 00000100:00100000:0.0:1787119507.831045:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633530624 00010000:00010000:0.0:1787119507.831081:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715eaa expref: 11 pid: 6695 timeout: 1133 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119507.831121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5207 00000100:00100000:0.0:1787119507.831128:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633530624:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119507.831147:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119507.831152:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715eaa expref: 11 pid: 6695 timeout: 1133 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.831176:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715eaa expref: 11 pid: 6695 timeout: 1133 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.831198:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee553e76/0xcaba3de8463e35e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715eaa expref: 11 pid: 6695 timeout: 1133 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.831212:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787119507.831216:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787119507.831223:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e3604 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.59@tcp remote: 0xa889273204715eb8 expref: 10 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.831233:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e3604 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.59@tcp remote: 0xa889273204715eb8 expref: 10 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.831278:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e3604 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.59@tcp remote: 0xa889273204715eb8 expref: 10 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119507.831294:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5835:1873929653570944:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119507.831344:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6051c1d80 going to sleep for 11 seconds 00010000:00010000:3.0:1787119507.831844:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119507.831854:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.831861:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e35fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119507.835809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.838587:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5835:1873929653570944:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119507.838610:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119507.838672:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633530624:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7544us (8086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119507.838681:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5207 00000100:00100000:2.0:1787119507.842803:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633530752 00000100:00100000:2.0:1787119507.842815:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633530752 00002000:00010000:2.0:1787119507.842860:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/41 (0->18446744073709551615) 00002000:00100000:2.0:1787119507.842866:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfce00 with x1873929633530752 ext(0->18446744073709551615) 00002000:00010000:2.0:1787119507.842879:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfce00. 00000100:00100000:2.0:1787119507.842967:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10561 00000100:00100000:2.0:1787119507.842975:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633530752:12345-192.168.201.59@tcp:10:cp.0 00002000:00010000:2.0:1787119507.843919:0:19246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787119507.843925:0:19246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb mtime from disk: 0 -> 1787119506 00002000:00010000:2.0:1787119507.843928:0:19246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787119507.843930:0:19246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb ctime from disk: 0 -> 1787119506 00002000:00010000:2.0:1787119507.843932:0:19246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787119507.844067:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633530752:12345-192.168.201.59@tcp:10:cp.0 Request processed in 1089us (8264us total) trans 4294968924 rc 0/0 00000100:00100000:2.0:1787119507.844076:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10561 00002000:00010000:2.0:1787119507.844079:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/41 (0->18446744073709551615) 00002000:00100000:2.0:1787119507.844081:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfce00 with x1873929633530752 ext(0->18446744073709551615) 00002000:00010000:2.0:1787119507.844092:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfce00. 00000100:00100000:1.0:1787119507.858041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.858202:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633530880 00000100:00100000:0.0:1787119507.858214:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633530880 00000100:00100000:0.0:1787119507.858292:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19749 00000100:00100000:0.0:1787119507.858303:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33366:x1873929633530880:12345-192.168.201.59@tcp:101:cp.0 00010000:00010000:0.0:1787119507.858328:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119507.858351:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e360b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ebf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.858523:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.858539:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715eb1 expref: 45 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.858555:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.858591:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715eb1 expref: 45 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119507.858618:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715eb1 expref: 45 pid: 15720 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119507.858633:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653571072:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119507.858821:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6051c1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119507.862006:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653571072:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119507.862663:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119507.863841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119507.863994:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633531008 00000100:00100000:3.0:1787119507.864003:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633531008 00010000:00010000:3.0:1787119507.864041:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715eb1 expref: 46 pid: 15720 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119507.864081:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5208 00000100:00100000:3.0:1787119507.864091:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:2376:x1873929633531008:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119507.864105:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119507.864118:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715eb1 expref: 46 pid: 15720 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.864144:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715eb1 expref: 46 pid: 15720 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.864168:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e35ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x67:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715eb1 expref: 46 pid: 15720 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.864185:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00010000:00010000:3.0:1787119507.864189:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.864199:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.864206:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119507.864237:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119507.864308:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:2376:x1873929633531008:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 218us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119507.864316:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5208 00010000:00010000:1.0:1787119507.864429:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.864467:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119507.864514:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 0 00000004:00200000:1.0:1787119507.864519:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119507.864542:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.864576:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e360b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ebf expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.864591:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81e00/0xcaba3de8463e3612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ebf expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119507.864599:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00010000:00010000:1.0:1787119507.864602:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119507.864605:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d81e00, rc 0) 00000100:00100000:1.0:1787119507.864648:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33366:x1873929633530880:12345-192.168.201.59@tcp:101:cp.0 Request processed in 6347us (6623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119507.864658:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19749 00000100:00100000:1.0:1787119507.906964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119507.907022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119507.907245:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633531392 00000100:00100000:2.0:1787119507.907288:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633531392 00000100:00100000:2.0:1787119507.907361:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 221 00000100:00100000:2.0:1787119507.907371:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33366:x1873929633531392:12345-192.168.201.59@tcp:35:cp.0 00000100:00100000:2.0:1787119507.907837:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33366:x1873929633531392:12345-192.168.201.59@tcp:35:cp.0 Request processed in 465us (883us total) trans 4294976582 rc 0/0 00000100:00100000:2.0:1787119507.907845:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 221 00000100:00100000:0.0:1787119507.908330:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633531136 00000100:00100000:0.0:1787119507.908337:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633531136 00002000:00100000:0.0:1787119507.908376:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x29:0x0] (0->1048575) req@ffff92a508cfed80 x1873929633531136/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:543/0 lens 488/0 e 0 to 0 dl 1787119518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787119507.908387:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633531136 ext(0->1048575) 00002000:00010000:0.0:1787119507.908392:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfed80 00000100:00100000:0.0:1787119507.908423:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10562 00000100:00100000:0.0:1787119507.908431:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633531136:12345-192.168.201.59@tcp:4:cp.0 00000100:00100000:1.0:1787119507.961398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119507.966878:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633531520 00000100:00100000:2.0:1787119507.966892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633531520 00000100:00100000:2.0:1787119507.966966:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 198 00000100:00100000:2.0:1787119507.966977:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:5615:x1873929633531520:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119507.966991:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119507.967031:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009186abcd/0xcaba3de8463dc857 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa889273204713a30 expref: 6 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.967058:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119507.971896:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633531136:12345-192.168.201.59@tcp:4:cp.0 Request processed in 63451us (64858us total) trans 4294968925 rc 0/0 00000100:00100000:3.0:1787119507.971913:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10562 00002000:00100000:3.0:1787119507.971928:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x29:0x0] (0->1048575) req@ffff92a508cfed80 x1873929633531136/t4294968925(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:543/0 lens 488/448 e 0 to 0 dl 1787119518 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119507.971938:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633531136 ext(0->1048575) 00002000:00010000:3.0:1787119507.971944:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508cfed80 00000100:00100000:2.0:1787119507.972574:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+5:5615:x1873929633531520:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5594us (11179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119507.972585:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 198 00000100:00100000:1.0:1787119507.979747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119507.979902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119507.980196:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633531776 00000100:00100000:3.0:1787119507.980207:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633531776 00002000:00100000:3.0:1787119507.980272:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x28:0x0] (0->320) req@ffff92a508cff100 x1873929633531776/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:543/0 lens 816/0 e 0 to 0 dl 1787119518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119507.980284:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633531776 ext(0->320) 00002000:00010000:3.0:1787119507.980291:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff100 00000100:00100000:3.0:1787119507.980324:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10563 00000100:00100000:3.0:1787119507.980333:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633531776:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119507.980845:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633531776:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 512us (941us total) trans 4294969213 rc 0/0 00000100:00100000:3.0:1787119507.980857:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10563 00002000:00100000:3.0:1787119507.980864:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x28:0x0] (0->320) req@ffff92a508cff100 x1873929633531776/t4294969213(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:543/0 lens 816/448 e 0 to 0 dl 1787119518 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119507.980873:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633531776 ext(0->320) 00002000:00010000:3.0:1787119507.980876:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff100 00000100:00100000:2.0:1787119507.986519:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633531648 00000100:00100000:2.0:1787119507.986536:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633531648 00000100:00100000:2.0:1787119507.987267:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 199 00000100:00100000:2.0:1787119507.987283:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+6:14534:x1873929633531648:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119507.987302:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787119507.987323:0:5835:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787119507.987354:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463dc9ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa889273204713aa0 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119507.987382:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119507.987516:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+5:14534:x1873929633531648:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 239us (7778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119507.987524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 199 00000100:00100000:0.0:1787119507.995932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119507.996028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119507.998509:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633531904 00000100:00100000:2.0:1787119507.998527:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633531904 00002000:00100000:2.0:1787119507.998587:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x26:0x0] (0->320) req@ffff92a63497bb80 x1873929633531904/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:543/0 lens 816/0 e 0 to 0 dl 1787119518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119507.998604:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497bb80 with x1873929633531904 ext(0->320) 00002000:00010000:2.0:1787119507.998610:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497bb80 00000100:00100000:2.0:1787119507.998640:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633532032 00000100:00100000:2.0:1787119507.998643:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633532032 00002000:00100000:2.0:1787119507.998658:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x28:0x0] (0->320) req@ffff92a6358ee850 x1873929633532032/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:543/0 lens 816/0 e 0 to 0 dl 1787119518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119507.998666:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358ee850 with x1873929633532032 ext(0->320) 00002000:00010000:2.0:1787119507.998669:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6358ee850 00000100:00100000:2.0:1787119507.998683:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10564 00000100:00100000:2.0:1787119507.998692:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633531904:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:3.0:1787119507.999137:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10565 00000100:00100000:3.0:1787119507.999148:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6358ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633532032:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119507.999234:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633531904:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 543us (3312us total) trans 4294969214 rc 0/0 00000100:00100000:2.0:1787119507.999242:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10564 00002000:00100000:2.0:1787119507.999260:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x26:0x0] (0->320) req@ffff92a63497bb80 x1873929633531904/t4294969214(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:543/0 lens 816/448 e 0 to 0 dl 1787119518 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119507.999268:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497bb80 with x1873929633531904 ext(0->320) 00002000:00010000:2.0:1787119507.999273:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497bb80 00000100:00100000:3.0:1787119507.999400:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6358ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633532032:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 253us (3372us total) trans 4294968926 rc 0/0 00000100:00100000:3.0:1787119507.999407:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10565 00002000:00100000:3.0:1787119507.999413:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x28:0x0] (0->320) req@ffff92a6358ee850 x1873929633532032/t4294968926(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:543/0 lens 816/448 e 0 to 0 dl 1787119518 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787119507.999420:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358ee850 with x1873929633532032 ext(0->320) 00002000:00010000:3.0:1787119507.999423:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6358ee850 00000100:00100000:0.0:1787119508.007893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119508.007964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119508.008004:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633532160 00000100:00100000:2.0:1787119508.008014:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633532160 00000100:00100000:1.0:1787119508.008041:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633532288 00000100:00100000:1.0:1787119508.008046:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633532288 00002000:00100000:2.0:1787119508.008080:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x27:0x0] (0->320) req@ffff92a63497a680 x1873929633532160/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:544/0 lens 816/0 e 0 to 0 dl 1787119519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119508.008080:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x27:0x0] (0->320) req@ffff92a634979880 x1873929633532288/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:544/0 lens 816/0 e 0 to 0 dl 1787119519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119508.008092:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a680 with x1873929633532160 ext(0->320) 00002000:00100000:1.0:1787119508.008092:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979880 with x1873929633532288 ext(0->320) 00002000:00010000:2.0:1787119508.008098:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63497a680 00002000:00010000:1.0:1787119508.008098:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979880 00000100:00100000:2.0:1787119508.008132:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10566 00000100:00100000:1.0:1787119508.008137:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10567 00000100:00100000:2.0:1787119508.008145:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633532160:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:1.0:1787119508.008145:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633532288:12345-192.168.201.59@tcp:4:fsx.0 00000100:00100000:2.0:1787119508.008617:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633532160:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 475us (736us total) trans 4294968927 rc 0/0 00000100:00100000:2.0:1787119508.008625:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10566 00002000:00100000:2.0:1787119508.008632:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x27:0x0] (0->320) req@ffff92a63497a680 x1873929633532160/t4294968927(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:544/0 lens 816/448 e 0 to 0 dl 1787119519 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119508.008641:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a680 with x1873929633532160 ext(0->320) 00002000:00010000:2.0:1787119508.008645:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63497a680 00000100:00100000:1.0:1787119508.008682:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633532288:12345-192.168.201.59@tcp:4:fsx.0 Request processed in 537us (717us total) trans 4294969215 rc 0/0 00000100:00100000:1.0:1787119508.008689:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10567 00002000:00100000:1.0:1787119508.008695:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x27:0x0] (0->320) req@ffff92a634979880 x1873929633532288/t4294969215(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:544/0 lens 816/448 e 0 to 0 dl 1787119519 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119508.008702:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979880 with x1873929633532288 ext(0->320) 00002000:00010000:1.0:1787119508.008705:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979880 00000100:00080000:0.0:1787119508.010065:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119508.010076:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119508.014937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119508.015058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119508.015332:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633532416 00000100:00100000:3.0:1787119508.015343:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633532416 00000100:00100000:3.0:1787119508.015411:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633532544 00000100:00100000:3.0:1787119508.015415:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633532544 00000100:00100000:3.0:1787119508.015484:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 200 00000100:00100000:3.0:1787119508.015495:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:6076:x1873929633532416:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119508.015512:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 7 locks, starting at 0 00010000:00010000:3.0:1787119508.015557:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463df314 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.59@tcp remote: 0xa889273204714822 expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.015603:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463df1fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.59@tcp remote: 0xa8892732047147ce expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.015622:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5603411/0xcaba3de8463df1f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.59@tcp remote: 0xa8892732047147c7 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119508.015638:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x28:0x0] updating lvb size from disk: 0 -> 321 00002000:00010000:3.0:1787119508.015641:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x28:0x0] updating lvb mtime from disk: 0 -> 1787119496 00002000:00010000:3.0:1787119508.015644:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x28:0x0] updating lvb ctime from disk: 0 -> 1787119496 00010000:00010000:3.0:1787119508.015651:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e354e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e72 expref: 15 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119508.015668:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb size from disk: 0 -> 321 00002000:00010000:3.0:1787119508.015670:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb mtime from disk: 0 -> 1787119496 00002000:00010000:3.0:1787119508.015672:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb ctime from disk: 0 -> 1787119496 00010000:00010000:3.0:1787119508.015678:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3540 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e64 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119508.015695:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb size from disk: 0 -> 321 00002000:00010000:3.0:1787119508.015697:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb mtime from disk: 0 -> 1787119496 00002000:00010000:3.0:1787119508.015699:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb ctime from disk: 0 -> 1787119496 00010000:00010000:3.0:1787119508.015707:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e352b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e5d expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.015733:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463deca7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 25190400->26214399) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047145c8 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.015746:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119508.015801:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:6076:x1873929633532416:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 308us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119508.015810:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 200 00000100:00100000:3.0:1787119508.015853:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 201 00000100:00100000:3.0:1787119508.015860:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:5616:x1873929633532544:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119508.015868:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00002000:00010000:3.0:1787119508.015879:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 1787119495 -> 1787119496 00002000:00010000:3.0:1787119508.015881:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 1787119495 -> 1787119496 00002000:00010000:3.0:1787119508.015883:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 1787119495 -> 1787119496 00010000:00010000:3.0:1787119508.015894:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072bafce8/0xcaba3de8463df3ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.59@tcp remote: 0xa88927320471486f expref: 17 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.015918:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc3bce63/0xcaba3de8463df265 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.59@tcp remote: 0xa8892732047147ea expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119508.015933:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb size from disk: 0 -> 1048576 00010000:00010000:3.0:1787119508.015940:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e3604 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.201.59@tcp remote: 0xa889273204715eb8 expref: 15 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119508.015967:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb size from disk: 0 -> 321 00002000:00010000:3.0:1787119508.015970:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb mtime from disk: 0 -> 1787119496 00002000:00010000:3.0:1787119508.015972:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb ctime from disk: 0 -> 1787119496 00010000:00010000:3.0:1787119508.015980:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000648d1e51/0xcaba3de8463e34fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e41 expref: 14 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119508.015995:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb size from disk: 0 -> 321 00002000:00010000:3.0:1787119508.015997:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb mtime from disk: 0 -> 1787119495 00002000:00010000:3.0:1787119508.015999:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb ctime from disk: 0 -> 1787119495 00010000:00010000:3.0:1787119508.016007:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe247cf3/0xcaba3de8463e34a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715e25 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.016018:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119508.016039:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:5616:x1873929633532544:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 179us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119508.016046:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 201 00010000:00010000:2.0:1787119508.451337:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119508.642222:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787119508.642254:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653571200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119508.642327:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119508.643554:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653571200 00000100:00100000:0.0:1787119508.643566:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653571200 00000100:00100000:0.0:1787119508.643631:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787119508.643641:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653571200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787119508.643664:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 5111808 free 3856662528 avail 3854565376 00000100:00100000:0.0:1787119508.643727:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653571200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119508.643734:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:0.0:1787119508.643780:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119508.643825:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653571200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119508.643964:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787119508.643977:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653571328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119508.644012:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119508.644051:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653571328 00000100:00100000:3.0:1787119508.644055:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653571328 00000100:00100000:3.0:1787119508.644089:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787119508.644095:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653571328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119508.644106:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 834207744 pending 5111808 free 3828350976 avail 3826253824 00000100:00100000:3.0:1787119508.644138:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653571328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119508.644146:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:3.0:1787119508.644159:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119508.644176:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653571328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119508.647113:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653571584:0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647190:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119508.647227:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787119508.647245:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653571712:0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647271:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119508.647302:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653571584 00000100:00100000:2.0:1787119508.647309:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653571584 00000100:00100000:2.0:1787119508.647349:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653571712 00000100:00100000:2.0:1787119508.647353:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653571712 00000100:00100000:2.0:1787119508.647383:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1787119508.647391:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653571584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647460:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653571584:12345-0@lo:400:kworker.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119508.647468:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1787119508.647484:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1787119508.647491:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653571712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647520:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653571712:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119508.647525:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00080000:2.0:1787119508.647546:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119508.647571:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653571712:0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647580:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653571584:0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647602:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653571456:0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647628:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119508.647654:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787119508.647659:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653571840:0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119508.647698:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653571456 00000100:00100000:2.0:1787119508.647701:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653571456 00000100:00100000:2.0:1787119508.647726:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1787119508.647731:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653571456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647764:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653571456:12345-0@lo:400:kworker.0 Request processed in 32us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119508.647770:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1787119508.647796:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653571840 00000100:00100000:2.0:1787119508.647800:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653571840 00000100:00100000:2.0:1787119508.647826:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1787119508.647832:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653571840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647861:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653571840:12345-0@lo:400:kworker.0 Request processed in 29us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119508.647867:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00080000:2.0:1787119508.647885:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119508.647900:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653571840:0@lo:400:kworker.0 00000100:00100000:2.0:1787119508.647907:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653571456:0@lo:400:kworker.0 00000001:00080000:2.0:1787119508.722192:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969215 is committed 00000100:00100000:0.0:1787119508.771946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119508.772024:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633532800 00000100:00100000:1.0:1787119508.772036:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633532800 00000100:00100000:1.0:1787119508.772112:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19750 00000100:00100000:1.0:1787119508.772123:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33384:x1873929633532800:12345-192.168.201.59@tcp:101:bash.0 00010000:00010000:1.0:1787119508.772148:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119508.772152:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787119508.772178:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e35be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715e9c expref: 45 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.772195:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ef00) 00010000:00010000:1.0:1787119508.772206:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00020000:1.0:1787119508.772217:0:15690:0:(ldlm_resource.c:1633:ldlm_resource_get()) cfs_fail_timeout id 30a sleeping for 2000ms 00000100:00080000:3.0:1787119508.774084:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119508.799946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119508.809602:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633532928 00000100:00100000:1.0:1787119508.809618:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633532928 00000100:00100000:0.0:1787119508.809788:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19751 00000100:00100000:0.0:1787119508.809800:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+13:33386:x1873929633532928:12345-192.168.201.59@tcp:101:bash.0 00010000:00010000:0.0:1787119508.809821:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119508.809842:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e3619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ecd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.809909:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e3620 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.809923:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e3620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.809934:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e3620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119508.809994:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119508.809998:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 43 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119508.810025:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e3620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.810052:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e3619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ecd expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.810073:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e3620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ecd expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.810083:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:0.0:1787119508.810086:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119508.810090:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80000, rc 0) 00000100:00100000:0.0:1787119508.810175:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+14:33386:x1873929633532928:12345-192.168.201.59@tcp:101:bash.0 Request processed in 375us (10235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119508.810183:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19751 00000100:00080000:1.0:1787119508.810632:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119508.844094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119508.845816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119508.855164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119508.856632:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633533056 00000100:00100000:2.0:1787119508.856644:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633533056 00000100:00100000:2.0:1787119508.856704:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633533184 00000100:00100000:2.0:1787119508.856708:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633533184 00000100:00100000:2.0:1787119508.856743:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19752 00000100:00100000:2.0:1787119508.856754:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+14:33385:x1873929633533056:12345-192.168.201.59@tcp:101:ls.0 00010000:00010000:2.0:1787119508.856774:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119508.856795:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ed4 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.856862:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.856876:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.856887:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119508.856949:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1787119508.856953:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 43 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119508.856977:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.857002:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92400/0xcaba3de8463e3627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ed4 expref: 16 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.857024:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ed4 expref: 15 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.857032:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:2.0:1787119508.857035:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787119508.857039:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119508.857097:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+15:33385:x1873929633533056:12345-192.168.201.59@tcp:101:ls.0 Request processed in 345us (13013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119508.857104:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19752 00000100:00100000:2.0:1787119508.857124:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19753 00000100:00100000:2.0:1787119508.857131:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33383:x1873929633533184:12345-192.168.201.59@tcp:101:ls.0 00010000:00010000:2.0:1787119508.857139:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119508.857147:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715edb expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.857174:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.857182:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.857189:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119508.857210:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1787119508.857213:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 43 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119508.857228:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.857255:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e3635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715edb expref: 47 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.857268:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715edb expref: 46 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.857287:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:2.0:1787119508.857290:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787119508.857292:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:2.0:1787119508.857314:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:33383:x1873929633533184:12345-192.168.201.59@tcp:101:ls.0 Request processed in 184us (11509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119508.857320:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19753 00000100:00100000:3.0:1787119508.859317:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633533440 00000100:00100000:3.0:1787119508.859331:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633533440 00000100:00100000:3.0:1787119508.859394:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19754 00000100:00100000:3.0:1787119508.859404:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+15:33386:x1873929633533440:12345-192.168.201.59@tcp:101:bash.0 00010000:00010000:3.0:1787119508.859423:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119508.859426:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787119508.859469:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e3620 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ecd expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.859487:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:3.0:1787119508.859491:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119508.859503:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3643 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ee2 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.859611:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.859625:0:15720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ed4 expref: 15 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.859634:0:15720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715edb expref: 45 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.859647:0:15720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.859679:0:15720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715edb expref: 45 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.859705:0:15720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715edb expref: 45 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119508.859718:0:15720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181af800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653571968:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119508.859811:0:15720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ed4 expref: 15 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.859820:0:15720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ed4 expref: 15 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119508.859829:0:15720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181af100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653572096:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119508.859853:0:15720:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a602bada80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119508.862266:0:15720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181af800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653571968:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119508.862280:0:15720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181af100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653572096:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119508.862311:0:15720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119508.866649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119508.866689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119508.868347:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633533568 00000100:00100000:2.0:1787119508.868363:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633533568 00010000:00010000:2.0:1787119508.868404:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ed4 expref: 16 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119508.868458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633533696 00000100:00100000:2.0:1787119508.868462:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633533696 00010000:00010000:2.0:1787119508.868478:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715edb expref: 46 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119508.868506:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5209 00000100:00100000:2.0:1787119508.868516:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2373:x1873929633533568:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119508.868531:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119508.868537:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ed4 expref: 16 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868550:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ed4 expref: 16 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868574:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e362e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ed4 expref: 16 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868588:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:2.0:1787119508.868593:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868601:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119508.868663:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+15:2373:x1873929633533568:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 148us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119508.868670:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5209 00000100:00100000:2.0:1787119508.868689:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5210 00000100:00100000:2.0:1787119508.868710:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:2373:x1873929633533696:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119508.868719:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119508.868724:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715edb expref: 46 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868749:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715edb expref: 46 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868761:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93200/0xcaba3de8463e363c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715edb expref: 46 pid: 12121 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868776:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:2.0:1787119508.868780:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868788:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868796:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.868820:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119508.868840:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:2373:x1873929633533696:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 145us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119508.868847:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5210 00010000:00010000:3.0:1787119508.871105:0:15720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.871126:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.871153:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.871165:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.871176:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787119508.872324:0:15720:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a:0x0], index 0: 0 00010000:00010000:3.0:1787119508.872529:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0200/0xcaba3de8463e3658 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872541:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0200/0xcaba3de8463e3658 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872551:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0200/0xcaba3de8463e3658 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872586:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872594:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872601:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872607:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119508.872612:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872620:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872631:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:3.0:1787119508.872634:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119508.872639:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872645:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e364a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787119508.872658:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a3fe08b reply state 000000001381b3d9 transno 4294976583 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119508.872667:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787119508.872791:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e3643 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ee2 expref: 16 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872808:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0200/0xcaba3de8463e3658 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ee2 expref: 15 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.872816:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff92a60384c300) 00010000:00010000:3.0:1787119508.872818:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119508.872821:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0200, rc 0) 00000100:00100000:3.0:1787119508.872885:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+16:33386:x1873929633533440:12345-192.168.201.59@tcp:101:bash.0 Request processed in 13483us (17729us total) trans 4294976583 rc 0/0 00000100:00100000:3.0:1787119508.872893:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19754 00000100:00100000:3.0:1787119508.888221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119508.888344:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.888358:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.888367:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.888374:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119508.888379:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.888386:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.888403:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x319d86dc (ffff92a60384c100) 00010000:00010000:1.0:1787119508.888407:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119508.888411:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.888417:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e3651 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x319d86dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119508.889510:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633533824 00000100:00100000:3.0:1787119508.889524:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633533824 00000100:00100000:3.0:1787119508.889585:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19755 00000100:00100000:3.0:1787119508.889595:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+15:33385:x1873929633533824:12345-192.168.201.59@tcp:101:ls.0 00010000:00010000:3.0:1787119508.889618:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119508.889636:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1200/0xcaba3de8463e3666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ee9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889709:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889722:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889732:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889745:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889752:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889758:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889849:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e367b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889858:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e367b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889865:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e367b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119508.889896:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 1048576 00000004:00200000:3.0:1787119508.889901:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119508.889919:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e367b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889932:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e367b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889939:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889944:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889950:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889956:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119508.889959:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889965:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889975:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:3.0:1787119508.889978:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119508.889982:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.889992:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e366d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890005:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890010:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890016:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890021:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119508.890024:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890030:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890038:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ec7601 (ffff92a60384ce00) 00010000:00010000:3.0:1787119508.890040:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119508.890042:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890047:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e3674 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890076:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1200/0xcaba3de8463e3666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ee9 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890089:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1400/0xcaba3de8463e367b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ee9 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.890110:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00010000:00010000:3.0:1787119508.890113:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119508.890116:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1400, rc 0) 00000100:00100000:3.0:1787119508.890184:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+16:33385:x1873929633533824:12345-192.168.201.59@tcp:101:ls.0 Request processed in 588us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119508.890191:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19755 00000100:00100000:1.0:1787119508.897814:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119508.898202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119508.899046:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633533952 00000100:00100000:2.0:1787119508.899062:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633533952 00000100:00080000:1.0:1787119508.899101:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787119508.899133:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633534080 00000100:00100000:2.0:1787119508.899137:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633534080 00000100:00100000:2.0:1787119508.899171:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5113 00000100:00100000:2.0:1787119508.899182:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633533952:12345-192.168.201.59@tcp:101:awk.0 00010000:00010000:2.0:1787119508.899203:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119508.899226:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ef0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119508.899230:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5114 00000100:00100000:1.0:1787119508.899249:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633534080:12345-192.168.201.59@tcp:101:ls.0 00010000:00010000:1.0:1787119508.899257:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1787119508.899267:0:20841:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787119508.899270:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e83b97c0/0xcaba3de8463e3689 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ef7 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.899297:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=1034s v=(0 0) 00010000:00010000:2.0:1787119508.899302:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119508.899312:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ef0 expref: 7 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.899330:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ef0 expref: 7 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119508.899353:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00002000:00010000:1.0:1787119508.899353:0:12469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 1048576, mtime: 0x6a854792, atime: 0x0, ctime: 0x6a854792, blocks: 0x1 00010000:00010000:1.0:1787119508.899363:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=1034s v=(0 0) 00010000:00010000:1.0:1787119508.899366:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119508.899372:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e83b97c0/0xcaba3de8463e3689 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ef7 expref: 8 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119508.899412:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633533952:12345-192.168.201.59@tcp:101:awk.0 Request processed in 231us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119508.899419:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5113 00010000:00010000:1.0:1787119508.899554:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e83b97c0/0xcaba3de8463e3689 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ef7 expref: 7 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.899565:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431e00, rc 0) 00000100:00100000:1.0:1787119508.899588:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2376:x1873929633534080:12345-192.168.201.59@tcp:101:ls.0 Request processed in 341us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119508.899595:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5114 00000100:00100000:2.0:1787119508.905306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119508.905351:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633534208 00000100:00100000:0.0:1787119508.905362:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633534208 00000100:00100000:0.0:1787119508.905417:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19756 00000100:00100000:0.0:1787119508.905427:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+16:33385:x1873929633534208:12345-192.168.201.59@tcp:101:ls.0 00010000:00010000:0.0:1787119508.905466:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119508.905487:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e3690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715efe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.905544:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.905558:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.905570:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119508.905623:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119508.905626:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 44 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119508.905648:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.905671:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e3690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715efe expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.905687:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715efe expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.905706:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:0.0:1787119508.905709:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119508.905713:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80600, rc 0) 00000100:00100000:0.0:1787119508.905780:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+17:33385:x1873929633534208:12345-192.168.201.59@tcp:101:ls.0 Request processed in 354us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119508.905786:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19756 00000100:00100000:3.0:1787119508.913746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119508.915205:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633534336 00000100:00100000:1.0:1787119508.915218:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633534336 00000100:00100000:1.0:1787119508.915291:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5115 00000100:00100000:1.0:1787119508.915302:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+7:33386:x1873929633534336:12345-192.168.201.59@tcp:101:awk.0 00010000:00010000:1.0:1787119508.915320:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119508.915340:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec6ef8e0/0xcaba3de8463e369e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f05 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.915372:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ef0 expref: 8 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.915382:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119508.915386:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119508.915391:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6ef8e0/0xcaba3de8463e369e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f05 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.915426:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ef0 expref: 8 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119508.915472:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ef0 expref: 8 pid: 20841 timeout: 1134 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119508.915488:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1873929653572224:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119508.915587:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5052229c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119508.925532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119508.925561:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633534464 00000100:00100000:3.0:1787119508.925569:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633534464 00010000:00010000:3.0:1787119508.925607:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ef0 expref: 9 pid: 20841 timeout: 1134 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119508.925643:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5211 00000100:00100000:3.0:1787119508.925654:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2376:x1873929633534464:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119508.925675:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119508.925698:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ef0 expref: 9 pid: 20841 timeout: 1134 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.925727:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ef0 expref: 9 pid: 20841 timeout: 1134 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.925760:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787119508.925764:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787119508.925773:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec6ef8e0/0xcaba3de8463e369e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f05 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.925780:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b2393c/0xcaba3de8463e3682 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715ef0 expref: 9 pid: 20841 timeout: 1134 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.925783:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6ef8e0/0xcaba3de8463e369e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f05 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119508.925793:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1873929653572224:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119508.925819:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec6ef8e0/0xcaba3de8463e369e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715f05 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119508.925821:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ec6ef8e0/0xcaba3de8463e369e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715f05 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119508.925834:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431200, rc 0) 00000100:00100000:3.0:1787119508.925835:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:20609:1873929653572352:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119508.925889:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33386:x1873929633534336:12345-192.168.201.59@tcp:101:awk.0 Request processed in 10589us (12153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119508.925896:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5115 00000100:00100000:3.0:1787119508.927464:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a602bada80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119508.930782:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:20609:1873929653572352:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119508.930809:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119508.930858:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2376:x1873929633534464:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5205us (5334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119508.930869:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5211 00000100:00100000:3.0:1787119508.940586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119508.940625:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633534720 00000100:00100000:3.0:1787119508.940635:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633534720 00000100:00100000:3.0:1787119508.940686:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 222 00000100:00100000:3.0:1787119508.940696:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6080bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+17:33386:x1873929633534720:12345-192.168.201.59@tcp:35:awk.0 00000100:00100000:3.0:1787119508.944530:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6080bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33386:x1873929633534720:12345-192.168.201.59@tcp:35:awk.0 Request processed in 3825us (3943us total) trans 4294976584 rc 0/0 00000100:00100000:3.0:1787119508.944544:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 222 00010000:00010000:0.0:1787119509.477710:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119510.497863:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1787119510.865615:0:15690:0:(ldlm_resource.c:1633:ldlm_resource_get()) cfs_fail_timeout id 30a awake 00010000:00010000:1.0:1787119510.884036:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e36a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ec6 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.884260:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.884280:0:15690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715efe expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.884290:0:15690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.884329:0:15690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715efe expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.884361:0:15690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715efe expref: 17 pid: 5850 timeout: 1136 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119510.884377:0:15690:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15690:1873929653572480:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119510.884530:0:15690:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119510.895633:0:15690:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15690:1873929653572480:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119510.895665:0:15690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119510.895935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119510.896252:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633534848 00000100:00100000:1.0:1787119510.896260:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633534848 00010000:00010000:1.0:1787119510.896320:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715efe expref: 18 pid: 5850 timeout: 1136 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119510.896357:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5212 00000100:00100000:1.0:1787119510.896369:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633534848:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119510.896384:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119510.896403:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715efe expref: 18 pid: 5850 timeout: 1136 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.896427:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715efe expref: 18 pid: 5850 timeout: 1136 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.896475:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3697 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715efe expref: 18 pid: 5850 timeout: 1136 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.896492:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:1.0:1787119510.896497:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.896506:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.896513:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.896544:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119510.896593:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+17:2375:x1873929633534848:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 225us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119510.896601:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5212 00010000:00010000:0.0:1787119510.896666:0:15690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.896673:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.896698:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.896709:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.896717:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787119510.897265:0:15690:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x29:0x0], index 1: 0 00010000:00010000:0.0:1787119510.897427:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e36ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x68:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897479:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e36ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897488:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e36ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897529:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897535:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897542:0:15690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897548:0:15690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119510.897552:0:15690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897560:0:15690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897569:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19200) 00010000:00010000:0.0:1787119510.897572:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119510.897577:0:15690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897583:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430000/0xcaba3de8463e36ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787119510.897594:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b313c65 reply state 00000000ebc9c213 transno 4294976585 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119510.897603:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787119510.897637:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430800/0xcaba3de8463e36a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ec6 expref: 47 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897660:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81c00/0xcaba3de8463e36ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ec6 expref: 46 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.897668:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x68:0x0].0x0 (ffff92a603b3eb00) 00010000:00010000:0.0:1787119510.897670:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119510.897672:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d81c00, rc 0) 00000100:00100000:0.0:1787119510.897719:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33384:x1873929633532800:12345-192.168.201.59@tcp:101:bash.0 Request processed in 2125598us (2125785us total) trans 4294976585 rc 0/0 00000100:00100000:0.0:1787119510.897728:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19750 00000100:00080000:2.0:1787119510.898037:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787119510.899844:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.899862:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.899869:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.899876:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119510.899881:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.899889:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.899905:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94573c07 (ffff92a603b3e800) 00010000:00010000:1.0:1787119510.899909:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119510.899913:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.899932:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e36b3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119510.902666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119510.902972:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633534976 00000100:00100000:0.0:1787119510.902982:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633534976 00000100:00100000:0.0:1787119510.903041:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19757 00000100:00100000:0.0:1787119510.903050:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:33383:x1873929633534976:12345-192.168.201.59@tcp:101:ls.0 00010000:00010000:0.0:1787119510.903083:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119510.903107:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e36c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f0c expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903169:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903181:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903192:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903214:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903222:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903229:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903313:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e36dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903321:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e36dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903328:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e36dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119510.903357:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 1048576 00000004:00200000:0.0:1787119510.903361:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119510.903377:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e36dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903387:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e36dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903396:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903402:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903408:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903420:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119510.903424:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903431:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903464:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ef00) 00010000:00010000:0.0:1787119510.903467:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119510.903470:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903476:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e36cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903489:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903495:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903501:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903506:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119510.903508:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903514:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903524:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ec7601 (ffff92a603b3e900) 00010000:00010000:0.0:1787119510.903526:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119510.903529:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903534:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80000/0xcaba3de8463e36d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903558:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e36c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f0c expref: 48 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903571:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e36dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f0c expref: 47 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119510.903577:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00010000:00010000:0.0:1787119510.903579:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119510.903581:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80a00, rc 0) 00000100:00100000:0.0:1787119510.903633:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33383:x1873929633534976:12345-192.168.201.59@tcp:101:ls.0 Request processed in 584us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119510.903640:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19757 00000100:00080000:2.0:1787119510.903796:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119510.908937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119510.909087:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633535104 00000100:00100000:2.0:1787119510.909097:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633535104 00000100:00100000:2.0:1787119510.909168:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5116 00000100:00100000:2.0:1787119510.909179:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633535104:12345-192.168.201.59@tcp:101:ls.0 00010000:00010000:2.0:1787119510.909210:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119510.909229:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2119088/0xcaba3de8463e36e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f13 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119510.909254:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787119510.909259:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119510.909268:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2119088/0xcaba3de8463e36e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f13 expref: 13 pid: 20843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119510.909292:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2119088/0xcaba3de8463e36e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f13 expref: 13 pid: 20843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119510.909306:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93800, rc 0) 00000100:00100000:2.0:1787119510.909368:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633535104:12345-192.168.201.59@tcp:101:ls.0 Request processed in 191us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119510.909375:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5116 00000100:00080000:1.0:1787119510.909576:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119510.913583:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119510.913642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119510.913723:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633535360 00000100:00100000:1.0:1787119510.913733:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633535360 00000100:00100000:1.0:1787119510.913791:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19758 00000100:00100000:1.0:1787119510.913800:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33383:x1873929633535360:12345-192.168.201.59@tcp:101:ls.0 00010000:00010000:1.0:1787119510.913821:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119510.913844:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e36eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f1a expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.913914:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e36f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.913945:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e36f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.913957:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e36f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119510.914017:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:1.0:1787119510.914021:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 45 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119510.914045:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e36f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.914069:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431a00/0xcaba3de8463e36eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f1a expref: 49 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.914086:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e36f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f1a expref: 48 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.914095:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19f00) 00010000:00010000:1.0:1787119510.914098:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787119510.914100:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:1.0:1787119510.914169:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:33383:x1873929633535360:12345-192.168.201.59@tcp:101:ls.0 Request processed in 369us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119510.914176:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19758 00000100:00100000:2.0:1787119510.914740:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633535232 00000100:00100000:2.0:1787119510.914747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633535232 00000100:00100000:2.0:1787119510.914787:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 202 00000100:00100000:2.0:1787119510.914795:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:2374:x1873929633535232:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119510.914807:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119510.914824:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80a00/0xcaba3de8463e36dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f0c expref: 48 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119510.914838:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff92a603b3ea00) 00010000:00010000:2.0:1787119510.914842:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119510.914882:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:2374:x1873929633535232:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 88us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119510.914889:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 202 00000100:00100000:0.0:1787119510.933946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119510.934091:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633535488 00000100:00100000:2.0:1787119510.934101:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633535488 00000100:00100000:2.0:1787119510.934177:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5117 00000100:00100000:2.0:1787119510.934188:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+5:2375:x1873929633535488:12345-192.168.201.59@tcp:101:awk.0 00010000:00010000:2.0:1787119510.934221:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119510.934245:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f21 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119510.934271:0:20841:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787119510.934290:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=1037s v=(0 0) 00010000:00010000:2.0:1787119510.934295:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119510.934303:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f21 expref: 6 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119510.934322:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f21 expref: 6 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119510.934334:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:2.0:1787119510.934392:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:2375:x1873929633535488:12345-192.168.201.59@tcp:101:awk.0 Request processed in 207us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119510.934399:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5117 00000100:00080000:1.0:1787119510.935230:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119510.947952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119510.948108:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633535616 00000100:00100000:1.0:1787119510.948118:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633535616 00000100:00100000:1.0:1787119510.948176:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5118 00000100:00100000:1.0:1787119510.948186:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:33384:x1873929633535616:12345-192.168.201.59@tcp:101:awk.0 00010000:00010000:1.0:1787119510.948218:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119510.948240:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbad708c/0xcaba3de8463e3700 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f28 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.948272:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f21 expref: 7 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.948282:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119510.948286:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119510.948292:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbad708c/0xcaba3de8463e3700 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f28 expref: 7 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.948326:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f21 expref: 7 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.948354:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f21 expref: 7 pid: 20841 timeout: 1137 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119510.948369:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653572608:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119510.948502:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119510.954218:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653572608:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119510.954257:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fbad708c/0xcaba3de8463e3700 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715f28 expref: 7 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.954277:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431a00, rc 0) 00000100:00100000:1.0:1787119510.954341:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:33384:x1873929633535616:12345-192.168.201.59@tcp:101:awk.0 Request processed in 6155us (6398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119510.954350:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5118 00000100:00100000:0.0:1787119510.963532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119510.963644:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633535744 00000100:00100000:1.0:1787119510.963655:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633535744 00010000:00010000:1.0:1787119510.963700:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f21 expref: 7 pid: 20841 timeout: 1137 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119510.963751:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5213 00000100:00100000:1.0:1787119510.963762:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633535744:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119510.963780:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119510.963805:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f21 expref: 7 pid: 20841 timeout: 1137 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.963832:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f21 expref: 7 pid: 20841 timeout: 1137 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.963855:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e36f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f21 expref: 7 pid: 20841 timeout: 1137 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.963872:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119510.963876:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119510.963884:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fbad708c/0xcaba3de8463e3700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715f28 expref: 6 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.963895:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbad708c/0xcaba3de8463e3700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715f28 expref: 6 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119510.963949:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fbad708c/0xcaba3de8463e3700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715f28 expref: 6 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119510.963966:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653572736:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119510.964048:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119510.971347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119510.971949:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633536000 00000100:00100000:3.0:1787119510.971962:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633536000 00000100:00100000:3.0:1787119510.972029:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 223 00000100:00100000:3.0:1787119510.972040:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33384:x1873929633536000:12345-192.168.201.59@tcp:35:awk.0 00000001:00080000:3.0:1787119510.972531:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976586 00000100:00100000:3.0:1787119510.973483:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:33384:x1873929633536000:12345-192.168.201.59@tcp:35:awk.0 Request processed in 1439us (2141us total) trans 4294976587 rc 0/0 00000100:00100000:3.0:1787119510.973495:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 223 00000020:00080000:3.0:1787119510.973502:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787119510.974591:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653572736:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119510.974684:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119510.974731:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:2374:x1873929633535744:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10971us (11212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119510.974739:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5213 00000100:00100000:0.0:1787119511.004955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119511.005053:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633536128 00000100:00100000:1.0:1787119511.005073:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633536128 00000100:00100000:1.0:1787119511.005132:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19759 00000100:00100000:1.0:1787119511.005142:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+17:33388:x1873929633536128:12345-192.168.201.59@tcp:101:diff.0 00010000:00010000:1.0:1787119511.005164:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119511.005184:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e3707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f2f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119511.005288:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119511.005301:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119511.005315:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119511.005377:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:1.0:1787119511.005381:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 45 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119511.005407:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119511.005432:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430a00/0xcaba3de8463e3707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f2f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119511.005497:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f2f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119511.005506:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19f00) 00010000:00010000:1.0:1787119511.005509:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787119511.005512:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119511.005583:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33388:x1873929633536128:12345-192.168.201.59@tcp:101:diff.0 Request processed in 441us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119511.005590:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19759 00000100:00100000:2.0:1787119511.011722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119511.011824:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633536384 00000100:00100000:0.0:1787119511.011834:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633536384 00000100:00100000:0.0:1787119511.011947:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19760 00000100:00100000:0.0:1787119511.011958:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:33388:x1873929633536384:12345-192.168.201.59@tcp:101:diff.0 00010000:00010000:0.0:1787119511.011990:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119511.012013:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e3715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f36 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119511.012109:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e371c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x68:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119511.012123:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e371c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x68:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119511.012133:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e371c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x68:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119511.012144:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x68:0x0]: returning size 10 00010000:00010000:0.0:1787119511.012293:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e3715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f36 expref: 52 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119511.012311:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81800/0xcaba3de8463e371c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x68:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f36 expref: 51 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119511.012319:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x68:0x0].0x0 (ffff92a603b3eb00) 00010000:00010000:0.0:1787119511.012322:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787119511.012326:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d81800, rc 0) 00000100:00100000:0.0:1787119511.012395:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:33388:x1873929633536384:12345-192.168.201.59@tcp:101:diff.0 Request processed in 438us (683us total) trans 4294976588 rc 0/0 00000100:00100000:0.0:1787119511.012407:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19760 00000100:00100000:0.0:1787119511.021130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119511.021552:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633536640 00000100:00100000:2.0:1787119511.021563:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633536640 00000100:00100000:2.0:1787119511.021627:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19761 00000100:00100000:2.0:1787119511.021637:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33388:x1873929633536640:12345-192.168.201.59@tcp:101:diff.0 00010000:00010000:2.0:1787119511.021655:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119511.021675:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e372a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f3d expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119511.021773:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3731 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119511.021786:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119511.021797:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119511.021807:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 10 00010000:00010000:2.0:1787119511.021923:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e372a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f3d expref: 21 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119511.022322:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3731 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f3d expref: 20 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119511.022332:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff92a60384c300) 00010000:00010000:2.0:1787119511.022335:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119511.022338:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119511.022408:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+20:33388:x1873929633536640:12345-192.168.201.59@tcp:101:diff.0 Request processed in 765us (1281us total) trans 4294976589 rc 0/0 00000100:00100000:2.0:1787119511.022414:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19761 00000100:00100000:3.0:1787119511.025956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119511.026044:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633536768 00000100:00100000:0.0:1787119511.026055:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633536768 00000100:00100000:0.0:1787119511.026118:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 203 00000100:00100000:0.0:1787119511.026127:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2373:x1873929633536768:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119511.026142:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119511.026167:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3731 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f3d expref: 20 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119511.026186:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff92a60384c300) 00010000:00010000:0.0:1787119511.026191:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119511.026267:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+19:2373:x1873929633536768:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 140us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119511.026275:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 203 00000100:00100000:0.0:1787119511.043621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119511.043731:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633537024 00000100:00100000:1.0:1787119511.043743:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633537024 00000100:00100000:1.0:1787119511.043811:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 224 00000100:00100000:1.0:1787119511.043822:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33388:x1873929633537024:12345-192.168.201.59@tcp:35:diff.0 00000100:00100000:1.0:1787119511.044096:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+20:33388:x1873929633537024:12345-192.168.201.59@tcp:35:diff.0 Request processed in 275us (484us total) trans 4294976590 rc 0/0 00000100:00100000:1.0:1787119511.044105:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 224 00000100:00100000:3.0:1787119511.441476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119511.441537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119511.441590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119511.441674:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633537408 00000100:00100000:0.0:1787119511.441691:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633537408 00000100:00100000:2.0:1787119511.441798:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633537152 00000100:00100000:0.0:1787119511.441799:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633537280 00000100:00100000:0.0:1787119511.441811:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633537280 00000100:00100000:2.0:1787119511.441812:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633537152 00000100:00100000:0.0:1787119511.441858:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 588 00000100:00100000:0.0:1787119511.441874:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+5:2375:x1873929633537408:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119511.441883:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 520 00000100:00100000:2.0:1787119511.441898:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633537152:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119511.442030:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 589 00000100:00100000:1.0:1787119511.442043:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633537280:12345-192.168.201.59@tcp:400:kworker.0 00000100:00080000:3.0:1787119511.442140:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787119511.442147:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119511.444371:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+5:2375:x1873929633537408:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 103us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119511.444389:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 588 00000100:00100000:2.0:1787119511.446169:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633537152:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 4255us (4725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119511.446345:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 520 00000100:00100000:1.0:1787119511.450271:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633537280:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 8215us (8664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119511.450289:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 589 00010000:00010000:0.0:1787119511.522713:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119512.548719:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787119512.814869:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968927 is committed 00000001:00080000:2.0:1787119512.820026:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976588 is committed 00000001:00080000:2.0:1787119512.820188:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976590 is committed 00010000:00010000:0.0:1787119513.569807:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119513.761601:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653572864:0@lo:400:kworker.0 00000100:00100000:2.0:1787119513.761670:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119513.761715:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653573376:0@lo:400:kworker.0 00000100:00100000:2.0:1787119513.761738:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119513.761759:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787119513.761764:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653573248:0@lo:400:kworker.0 00000100:00100000:2.0:1787119513.761782:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119513.761815:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653573248 00000100:00100000:2.0:1787119513.761817:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653572992:0@lo:400:kworker.0 00000100:00100000:3.0:1787119513.761828:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653573248 00000100:00100000:1.0:1787119513.761832:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653573120:0@lo:400:kworker.0 00000100:00100000:2.0:1787119513.761867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119513.761895:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653573504:0@lo:400:kworker.0 00000100:00100000:2.0:1787119513.761923:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119513.761956:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653572864 00000100:00100000:2.0:1787119513.761959:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653572864 00000100:00100000:2.0:1787119513.761983:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1787119513.761990:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653572864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119513.761995:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653573504 00000100:00100000:3.0:1787119513.762001:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653573504 00000100:00100000:2.0:1787119513.762031:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653572864:12345-0@lo:400:kworker.0 Request processed in 40us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119513.762036:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1787119513.762044:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1787119513.762055:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653573248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119513.762080:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653572864:0@lo:400:kworker.0 00000100:00100000:3.0:1787119513.762104:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653573248:12345-0@lo:400:kworker.0 Request processed in 51us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119513.762111:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653573248:0@lo:400:kworker.0 00000100:00100000:3.0:1787119513.762114:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1787119513.762157:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1787119513.762166:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653573504:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787119513.762169:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787119513.762175:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119513.762209:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653573504:12345-0@lo:400:kworker.0 Request processed in 44us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119513.762217:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1787119513.762226:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653573504:0@lo:400:kworker.0 00000100:00100000:2.0:1787119513.762305:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787119513.762311:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653573632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787119513.762336:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119513.762367:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653573632 00000100:00100000:3.0:1787119513.762372:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653573632 00000100:00100000:3.0:1787119513.762400:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787119513.762407:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653573632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787119513.762433:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 318439424 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1787119513.762503:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653573376 00000100:00100000:1.0:1787119513.762508:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653573376 00000100:00100000:1.0:1787119513.762542:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653572992 00000100:00100000:1.0:1787119513.762545:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653572992 00000100:00100000:1.0:1787119513.762568:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1787119513.762576:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653573376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119513.762611:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653573632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119513.762617:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787119513.762632:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653573376:12345-0@lo:400:kworker.0 Request processed in 57us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119513.762640:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1787119513.762645:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653573632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787119513.762666:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1787119513.762674:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653572992:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787119513.762689:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119513.762701:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653573376:0@lo:400:kworker.0 00000100:00100000:1.0:1787119513.762772:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119513.762805:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653573120 00000100:00100000:1.0:1787119513.762809:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653573120 00000100:00100000:3.0:1787119513.762836:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653573760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119513.762838:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1787119513.762844:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653573120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119513.762866:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119513.762879:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653573120:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119513.762885:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1787119513.762895:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653573760 00000100:00100000:3.0:1787119513.762898:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653573760 00000100:00080000:1.0:1787119513.762905:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119513.762925:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653573120:0@lo:400:kworker.0 00000100:00100000:3.0:1787119513.762931:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787119513.762938:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653573760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119513.762958:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 829095936 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1787119513.762994:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653573760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119513.763001:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787119513.763401:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653573760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119513.763519:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653572992:12345-0@lo:400:kworker.0 Request processed in 846us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119513.763524:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1787119513.763545:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653572992:0@lo:400:kworker.0 00000100:00100000:0.0:1787119514.001396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119514.001788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119514.001922:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633537664 00000100:00100000:3.0:1787119514.001932:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633537664 00000100:00100000:3.0:1787119514.001998:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5119 00000100:00100000:3.0:1787119514.002024:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2373:x1873929633537664:12345-192.168.201.59@tcp:16:kworker.0 00000100:00100000:3.0:1787119514.002157:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2373:x1873929633537664:12345-192.168.201.59@tcp:16:kworker.0 Request processed in 149us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119514.002165:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5119 00000100:00080000:2.0:1787119514.002502:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119514.004988:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633537536 00000100:00100000:1.0:1787119514.005005:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633537536 00002000:00100000:1.0:1787119514.005243:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2a:0x0] (0->9) req@ffff92a634979500 x1873929633537536/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:550/0 lens 504/0 e 0 to 0 dl 1787119525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119514.005256:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979500 with x1873929633537536 ext(0->9) 00002000:00010000:1.0:1787119514.005262:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634979500 00000100:00100000:1.0:1787119514.005346:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10568 00000100:00100000:1.0:1787119514.005357:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2373:x1873929633537536:12345-192.168.201.59@tcp:4:diff.0 00000100:00100000:1.0:1787119514.006193:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2373:x1873929633537536:12345-192.168.201.59@tcp:4:diff.0 Request processed in 831us (4801us total) trans 4294968928 rc 0/0 00000100:00100000:1.0:1787119514.006203:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10568 00002000:00100000:1.0:1787119514.006211:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2a:0x0] (0->9) req@ffff92a634979500 x1873929633537536/t4294968928(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:550/0 lens 504/448 e 0 to 0 dl 1787119525 ref 1 fl Complete:/600/0 rc 0/0 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787119514.006219:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979500 with x1873929633537536 ext(0->9) 00002000:00010000:1.0:1787119514.006223:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634979500 00010000:00010000:2.0:1787119514.594055:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119515.631041:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119516.563857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119516.563901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119516.563920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119516.563943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119516.563960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119516.563974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119516.563994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119516.564029:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633538048 00000100:00100000:0.0:1787119516.564039:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633538048 00000100:00100000:0.0:1787119516.564093:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633538560 00000100:00100000:0.0:1787119516.564096:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633538560 00000100:00100000:0.0:1787119516.564128:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633538176 00000100:00100000:0.0:1787119516.564131:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633538176 00000100:00100000:0.0:1787119516.564149:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633538432 00000100:00100000:0.0:1787119516.564152:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633538432 00000100:00100000:0.0:1787119516.564169:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 592 00000100:00100000:0.0:1787119516.564178:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:2376:x1873929633538048:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119516.564283:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:2376:x1873929633538048:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 104us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119516.564305:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 592 00000100:00100000:0.0:1787119516.564326:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 593 00000100:00100000:0.0:1787119516.564333:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+5:2376:x1873929633538560:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119516.564359:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+5:2376:x1873929633538560:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119516.564366:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 593 00000100:00100000:0.0:1787119516.564379:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 594 00000100:00100000:0.0:1787119516.564385:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:2376:x1873929633538176:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119516.564408:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:2376:x1873929633538176:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119516.564414:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 594 00000100:00100000:0.0:1787119516.564426:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 595 00000100:00100000:0.0:1787119516.564432:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2376:x1873929633538432:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119516.564479:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2376:x1873929633538432:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 47us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119516.564485:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 595 00000100:00100000:2.0:1787119516.564702:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633537792 00000100:00100000:2.0:1787119516.564707:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633537792 00000100:00100000:2.0:1787119516.564739:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 522 00000100:00100000:2.0:1787119516.564746:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633537792:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119516.564780:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633537792:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 35us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119516.564791:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 522 00000100:00100000:2.0:1787119516.564824:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633538304 00000100:00100000:2.0:1787119516.564827:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633538304 00000100:00100000:2.0:1787119516.564850:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633537920 00000100:00100000:2.0:1787119516.564852:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633537920 00000100:00100000:2.0:1787119516.564869:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 696 00000100:00100000:2.0:1787119516.564876:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2376:x1873929633538304:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119516.564905:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2376:x1873929633538304:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 29us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119516.564911:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 696 00000100:00100000:2.0:1787119516.564922:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 697 00000100:00100000:2.0:1787119516.564927:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633537920:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119516.564950:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633537920:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 23us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119516.564955:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 697 00000100:00080000:2.0:1787119516.564973:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787119516.564977:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787119516.564979:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787119516.646535:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787119516.737677:0:21300:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 18: mmap sanity check =========================================================================================== 02:05:14 (1787119514) 00000100:00100000:0.0:1787119516.845714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119516.845813:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633538816 00000100:00100000:2.0:1787119516.845823:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633538816 00000100:00100000:2.0:1787119516.845873:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19762 00000100:00100000:2.0:1787119516.845882:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633538816:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119516.845903:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119516.845906:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787119516.845931:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e36f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f1a expref: 39 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119516.845949:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19f00) 00010000:00010000:2.0:1787119516.845954:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119516.845981:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e373f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f44 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119516.846570:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119516.846587:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f2f expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119516.846596:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119516.846631:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f2f expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119516.846657:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f2f expref: 15 pid: 5849 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119516.846673:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653573888:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119516.846762:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6011cac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119516.854771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119516.854861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633538944 00000100:00100000:3.0:1787119516.854872:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633538944 00010000:00010000:3.0:1787119516.854915:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f2f expref: 16 pid: 5849 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119516.854958:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5214 00000100:00100000:3.0:1787119516.854983:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2375:x1873929633538944:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119516.855000:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119516.855008:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f2f expref: 16 pid: 5849 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.855035:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f2f expref: 16 pid: 5849 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.855058:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19f00) 00010000:00010000:3.0:1787119516.855064:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.855073:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.855090:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.855121:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119516.855171:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2375:x1873929633538944:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 205us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119516.855178:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5214 00010000:00010000:0.0:1787119516.857588:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e370e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715f2f expref: 15 pid: 5849 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119516.857612:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653573888:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119516.857639:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.857649:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.857655:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.857712:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.857725:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.857735:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787119516.864733:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b:0x0], index 0: 0 00010000:00010000:0.0:1787119516.866270:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e3754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x69:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866548:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e3754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866563:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e3754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866610:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866618:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866624:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866632:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119516.866637:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866645:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866664:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19f00) 00010000:00010000:0.0:1787119516.866668:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119516.866673:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866679:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3746 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787119516.866691:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003de37cb0 reply state 0000000054168dac transno 4294976591 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119516.866700:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787119516.866738:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e373f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f44 expref: 41 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866759:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e3754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f44 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.866766:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x69:0x0].0x0 (ffff92a603b3e900) 00010000:00010000:0.0:1787119516.866769:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119516.866772:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80400, rc 0) 00000100:00100000:0.0:1787119516.867580:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633538816:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 21692us (21869us total) trans 4294976591 rc 0/0 00000100:00100000:0.0:1787119516.867591:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19762 00000100:00100000:0.0:1787119516.882883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119516.882923:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633539072 00000100:00100000:0.0:1787119516.882934:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633539072 00000100:00100000:0.0:1787119516.882996:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5120 00000100:00100000:0.0:1787119516.883007:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:33946:x1873929633539072:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119516.883027:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119516.883050:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3762 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f4b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119516.883091:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787119516.883123:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=1042s v=(0 0) 00010000:00010000:0.0:1787119516.883129:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787119516.883140:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3762 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f4b expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.883158:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5b72eb7/0xcaba3de8463e3762 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f4b expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.883356:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80a00, rc 0) 00000100:00100000:0.0:1787119516.883416:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:33946:x1873929633539072:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 410us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119516.883424:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5120 00010000:00010000:3.0:1787119516.883898:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.883913:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.883920:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.883927:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119516.883932:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.883940:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.883955:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcf1d5a2f (ffff92a603b3ef00) 00010000:00010000:3.0:1787119516.883971:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119516.883975:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.883983:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e374d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119516.917736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119516.917823:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633539328 00000100:00100000:1.0:1787119516.917835:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633539328 00000100:00100000:1.0:1787119516.917896:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 225 00000100:00100000:1.0:1787119516.917907:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633539328:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1787119516.918312:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633539328:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 405us (586us total) trans 4294976592 rc 0/0 00000100:00100000:1.0:1787119516.918320:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 225 00000100:00100000:3.0:1787119516.923238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119516.923328:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633539456 00000100:00100000:1.0:1787119516.923339:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633539456 00000100:00100000:1.0:1787119516.923404:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19763 00000100:00100000:1.0:1787119516.923414:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633539456:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119516.923468:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119516.923494:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f52 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119516.923561:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e3770 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119516.923574:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e3770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119516.923586:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e3770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119516.923650:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:1.0:1787119516.923654:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 46 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119516.923676:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e3770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119516.923701:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e3769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f52 expref: 43 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119516.923718:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e3770 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f52 expref: 42 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119516.923727:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19100) 00010000:00010000:1.0:1787119516.923730:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787119516.923734:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119516.923794:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633539456:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 380us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119516.923802:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19763 00000100:00100000:3.0:1787119516.937018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119516.937058:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633539584 00000100:00100000:3.0:1787119516.937067:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633539584 00000100:00100000:3.0:1787119516.937128:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19764 00000100:00100000:3.0:1787119516.937138:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633539584:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119516.937158:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119516.937178:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1200/0xcaba3de8463e3777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f59 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937240:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937255:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937267:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937283:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937291:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937298:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937364:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937372:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937379:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937386:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119516.937390:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937400:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937412:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19100) 00010000:00010000:3.0:1787119516.937415:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119516.937420:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937427:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e377e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937459:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937466:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937472:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937476:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119516.937479:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937484:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937491:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefc67454 (ffff92a60384cf00) 00010000:00010000:3.0:1787119516.937494:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119516.937496:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937506:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e3785 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937540:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1200/0xcaba3de8463e3777 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f59 expref: 43 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937551:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19100) 00010000:00010000:3.0:1787119516.937553:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119516.937556:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1200/0xcaba3de8463e3777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f59 expref: 43 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.937566:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:3.0:1787119516.937624:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633539584:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 488us (613us total) trans 0 rc 301/301 00000100:00100000:3.0:1787119516.937631:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19764 00000100:00100000:3.0:1787119516.952620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119516.952661:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633539840 00000100:00100000:3.0:1787119516.952671:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633539840 00000100:00100000:3.0:1787119516.952724:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19765 00000100:00100000:3.0:1787119516.952735:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633539840:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119516.952756:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119516.952759:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787119516.952786:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e3770 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f52 expref: 42 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.952806:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a61bc19100) 00010000:00010000:3.0:1787119516.952818:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119516.952833:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e378c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f60 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.952959:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.953832:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.953851:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.953870:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.953879:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.953886:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787119516.954407:0:15690:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a:0x0], index 1: 0 00010000:00010000:3.0:1787119516.954616:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e37a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954628:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e37a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954637:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e37a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954671:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954680:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954687:0:15690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954693:0:15690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119516.954698:0:15690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954705:0:15690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954716:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:3.0:1787119516.954719:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119516.954723:0:15690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954729:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e3793 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787119516.954742:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098d00cc3 reply state 000000002657e957 transno 4294976593 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119516.954751:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787119516.954785:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e378c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f60 expref: 44 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954812:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e37a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f60 expref: 43 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.954825:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff92a60384c400) 00010000:00010000:3.0:1787119516.954827:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119516.954830:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:3.0:1787119516.954907:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633539840:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2173us (2297us total) trans 4294976593 rc 0/0 00000100:00100000:3.0:1787119516.954916:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19765 00000100:00100000:0.0:1787119516.967219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119516.967257:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.967269:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.967278:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.967289:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf0800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119516.967294:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.967302:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.967318:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefc67454 (ffff92a60384c900) 00010000:00010000:0.0:1787119516.967322:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119516.967326:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.967332:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e379a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119516.967375:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633540096 00000100:00100000:0.0:1787119516.967384:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633540096 00000100:00100000:0.0:1787119516.967434:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19766 00000100:00100000:0.0:1787119516.967466:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633540096:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1787119516.967524:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119516.967542:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0000/0xcaba3de8463e37a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f60 expref: 43 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.967553:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff92a60384c400) 00010000:00010000:0.0:1787119516.967562:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119516.967801:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.967815:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119516.967824:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787119516.967874:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976594 00000004:00010000:0.0:1787119516.967899:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adcb2222 reply state 00000000915ad163 transno 4294976595 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119516.967908:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119516.968055:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633540096:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 591us (844us total) trans 4294976595 rc 0/0 00000100:00100000:0.0:1787119516.968063:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19766 00000020:00080000:0.0:1787119516.968068:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787119516.995955:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.995975:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.995983:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.995989:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119516.995994:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.996002:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.996019:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff92a603b3ed00) 00010000:00010000:3.0:1787119516.996022:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119516.996027:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119516.996033:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.004272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.004353:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633540224 00000100:00100000:3.0:1787119517.004363:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633540224 00000100:00100000:3.0:1787119517.004425:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19767 00000100:00100000:3.0:1787119517.004435:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633540224:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119517.004483:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119517.004508:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e37b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f67 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.004572:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e37b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f67 expref: 45 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.004586:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e37b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f67 expref: 45 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.004606:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:3.0:1787119517.004609:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787119517.004613:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00000100:00100000:3.0:1787119517.004668:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633540224:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 233us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119517.004675:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19767 00000100:00100000:3.0:1787119517.017307:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.017426:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633540352 00000100:00100000:0.0:1787119517.017472:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633540352 00000100:00100000:0.0:1787119517.017525:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5121 00000100:00100000:0.0:1787119517.017535:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:33946:x1873929633540352:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.017553:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.017576:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f6e expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.017602:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787119517.017624:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=1043s v=(0 0) 00010000:00010000:0.0:1787119517.017629:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787119517.017638:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f6e expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.017657:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f6e expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.017671:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80000, rc 0) 00000100:00100000:0.0:1787119517.017727:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:33946:x1873929633540352:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 193us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.017734:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5121 00000100:00100000:3.0:1787119517.022284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.022403:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633540480 00000100:00100000:2.0:1787119517.022414:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633540480 00002000:00010000:2.0:1787119517.022658:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/42 (40960->18446744073709551615) 00002000:00100000:2.0:1787119517.022664:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ace00 with x1873929633540480 ext(40960->18446744073709551615) 00002000:00010000:2.0:1787119517.022677:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ace00. 00000100:00100000:2.0:1787119517.022778:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10569 00000100:00100000:2.0:1787119517.022788:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633540480:12345-192.168.201.59@tcp:10:mmap_sanity.0 00002000:00010000:2.0:1787119517.023174:0:19246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2a:0x0] updating lvb size from disk: 0 -> 40960 00002000:00010000:2.0:1787119517.023178:0:19246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2a:0x0] updating lvb mtime from disk: 0 -> 1787119515 00002000:00010000:2.0:1787119517.023180:0:19246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787119517.023182:0:19246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2a:0x0] updating lvb ctime from disk: 0 -> 1787119515 00002000:00010000:2.0:1787119517.023184:0:19246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787119517.023299:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633540480:12345-192.168.201.59@tcp:10:mmap_sanity.0 Request processed in 511us (1024us total) trans 4294969216 rc 0/0 00000100:00100000:2.0:1787119517.023307:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10569 00002000:00010000:2.0:1787119517.023311:0:19246:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/42 (40960->18446744073709551615) 00002000:00100000:2.0:1787119517.023314:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ace00 with x1873929633540480 ext(40960->18446744073709551615) 00002000:00010000:2.0:1787119517.023319:0:19246:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ace00. 00000100:00100000:2.0:1787119517.028226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.028433:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633540608 00000100:00100000:3.0:1787119517.028465:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633540608 00002000:00100000:3.0:1787119517.028517:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2a:0x0] (0->4095) req@ffff92a519cd7800 x1873929633540608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.028535:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd7800 with x1873929633540608 ext(0->4095) 00002000:00010000:3.0:1787119517.028542:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd7800 00000100:00100000:3.0:1787119517.028582:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10570 00000100:00100000:3.0:1787119517.028592:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633540608:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.028920:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633540608:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 328us (706us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119517.028928:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10570 00002000:00100000:3.0:1787119517.028935:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2a:0x0] (0->4095) req@ffff92a519cd7800 x1873929633540608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.028943:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd7800 with x1873929633540608 ext(0->4095) 00002000:00010000:3.0:1787119517.028947:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd7800 00000100:00100000:0.0:1787119517.032642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.032746:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633540736 00000100:00100000:1.0:1787119517.032757:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633540736 00002000:00100000:1.0:1787119517.032809:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2a:0x0] (4096->8191) req@ffff92a62a125f80 x1873929633540736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.032821:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125f80 with x1873929633540736 ext(4096->8191) 00002000:00010000:1.0:1787119517.032827:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a125f80 00000100:00100000:1.0:1787119517.032862:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10571 00000100:00100000:1.0:1787119517.032871:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633540736:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.033111:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633540736:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 240us (478us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119517.033119:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10571 00002000:00100000:1.0:1787119517.033127:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2a:0x0] (4096->8191) req@ffff92a62a125f80 x1873929633540736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.033134:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125f80 with x1873929633540736 ext(4096->8191) 00002000:00010000:1.0:1787119517.033138:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a125f80 00000100:00100000:0.0:1787119517.035787:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.035900:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633540864 00000100:00100000:3.0:1787119517.035909:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633540864 00002000:00100000:3.0:1787119517.035954:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2a:0x0] (8192->12287) req@ffff92a62a125c00 x1873929633540864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.035966:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125c00 with x1873929633540864 ext(8192->12287) 00002000:00010000:3.0:1787119517.035981:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a125c00 00000100:00100000:3.0:1787119517.036060:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10572 00000100:00100000:3.0:1787119517.036070:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633540864:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.036376:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633540864:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 306us (597us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119517.036384:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10572 00002000:00100000:3.0:1787119517.036393:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2a:0x0] (8192->12287) req@ffff92a62a125c00 x1873929633540864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.036401:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125c00 with x1873929633540864 ext(8192->12287) 00002000:00010000:3.0:1787119517.036405:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a125c00 00000100:00100000:2.0:1787119517.039787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.039889:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633540992 00000100:00100000:0.0:1787119517.039905:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633540992 00002000:00100000:0.0:1787119517.039956:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2a:0x0] (12288->40959) req@ffff92a519cd7b80 x1873929633540992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.039969:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd7b80 with x1873929633540992 ext(12288->40959) 00002000:00010000:0.0:1787119517.039974:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd7b80 00000100:00100000:0.0:1787119517.040008:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10573 00000100:00100000:0.0:1787119517.040018:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633540992:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.041872:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633540992:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1847us (2086us total) trans 0 rc 28672/28672 00000100:00100000:1.0:1787119517.041884:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10573 00002000:00100000:1.0:1787119517.041895:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2a:0x0] (12288->40959) req@ffff92a519cd7b80 x1873929633540992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 28672/28672 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.041906:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd7b80 with x1873929633540992 ext(12288->40959) 00002000:00010000:1.0:1787119517.041912:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd7b80 00000100:00100000:0.0:1787119517.045692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.045799:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633541248 00000100:00100000:1.0:1787119517.045809:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633541248 00000100:00100000:1.0:1787119517.045889:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 226 00000100:00100000:1.0:1787119517.045900:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633541248:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1787119517.046290:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:33946:x1873929633541248:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 391us (607us total) trans 4294976596 rc 0/0 00000100:00100000:1.0:1787119517.046299:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 226 00000100:00100000:2.0:1787119517.048363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.048522:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633541376 00000100:00100000:0.0:1787119517.048531:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633541376 00000100:00100000:0.0:1787119517.048586:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19768 00000100:00100000:0.0:1787119517.048595:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:33946:x1873929633541376:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.048620:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.048642:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.048704:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e37cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.048718:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e37cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.048728:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e37cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119517.048793:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119517.048798:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 47 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119517.048824:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e37cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.048850:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f75 expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.048871:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e37cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f75 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.048880:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ed00) 00010000:00010000:0.0:1787119517.048883:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119517.048886:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80e00, rc 0) 00000100:00100000:0.0:1787119517.048949:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633541376:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 355us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.048958:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19768 00000100:00100000:0.0:1787119517.050641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.050723:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633541504 00000100:00100000:1.0:1787119517.050732:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633541504 00000100:00100000:1.0:1787119517.050791:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19769 00000100:00100000:1.0:1787119517.050802:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633541504:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.050820:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.050838:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e37d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f7c expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.050904:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.050917:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.050929:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.050944:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.050952:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.050963:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051255:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e37e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051264:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e37e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051271:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e37e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119517.051303:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6a:0x0]: returning size 40960 00000004:00200000:1.0:1787119517.051307:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119517.051324:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e37e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051337:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e37e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051346:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051352:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051359:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051365:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119517.051369:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051377:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051391:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ed00) 00010000:00010000:1.0:1787119517.051394:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119517.051399:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051406:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430200/0xcaba3de8463e37d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051419:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051426:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051432:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051558:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a513430c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119517.051561:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051568:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051576:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefc67454 (ffff92a61bc19000) 00010000:00010000:1.0:1787119517.051579:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119517.051582:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051593:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e37e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051623:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431400/0xcaba3de8463e37d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f7c expref: 49 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051636:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e37e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f7c expref: 48 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.051643:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:1.0:1787119517.051646:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119517.051648:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:1.0:1787119517.051758:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:33946:x1873929633541504:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 957us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.051767:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19769 00000100:00100000:3.0:1787119517.054935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.055563:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633541760 00000100:00100000:0.0:1787119517.055572:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633541760 00000100:00100000:0.0:1787119517.055612:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19770 00000100:00100000:0.0:1787119517.055618:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:33946:x1873929633541760:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1787119517.055663:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787119517.055687:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513431c00/0xcaba3de8463e37e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f7c expref: 48 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055709:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e37b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f67 expref: 47 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055720:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:0.0:1787119517.055740:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80e00/0xcaba3de8463e37cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f75 expref: 46 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055751:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ed00) 00010000:00010000:0.0:1787119517.055755:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119517.055774:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055783:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055789:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055797:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055801:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055805:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055895:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055900:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.055904:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787119517.056633:0:12121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9600 00000004:00080000:0.0:1787119517.056645:0:12121:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1043134205345ns, next at 1044134202692ns, rc = 0 00010000:00010000:0.0:1787119517.056710:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056722:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056731:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056739:0:12121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056746:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056751:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056769:0:12121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787119517.056788:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056795:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056802:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056808:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d81600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.056813:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056821:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056831:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff92a609aaf800) 00010000:00010000:0.0:1787119517.056834:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787119517.056837:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056843:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d81600/0xcaba3de8463e37fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056861:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056867:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056873:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056878:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.056882:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056888:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056895:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a603b3ef00) 00010000:00010000:0.0:1787119517.056897:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.056900:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.056906:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80800/0xcaba3de8463e37ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787119517.056918:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000392f3e6c reply state 000000005ada6244 transno 4294976597 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.056928:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787119517.057134:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787119517.057142:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.057149:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80600 already unused, calling callback (ffffffffc163d010) 00010000:00010000:3.0:1787119517.057152:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.057158:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.057167:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff92a609aaf800) 00010000:00010000:3.0:1787119517.057169:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787119517.057172:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.057177:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80600/0xcaba3de8463e3803 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.057191:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787119517.057193:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787119517.057195:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119517.057287:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633541760:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 1664us (2359us total) trans 4294976597 rc 0/0 00000100:00100000:0.0:1787119517.057296:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19770 00010000:00010000:0.0:1787119517.060305:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.060325:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.060333:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.060340:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d80200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.060345:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.060354:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.060372:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefc67454 (ffff92a603b3e800) 00010000:00010000:0.0:1787119517.060375:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.060380:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.060387:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80200/0xcaba3de8463e37f5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.062398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.062504:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633541888 00000100:00100000:0.0:1787119517.062514:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633541888 00000100:00100000:0.0:1787119517.062578:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19771 00000100:00100000:0.0:1787119517.062588:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:33946:x1873929633541888:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.062612:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.062639:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e380a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f83 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.062709:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84400/0xcaba3de8463e3811 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.062723:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84400/0xcaba3de8463e3811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.062735:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84400/0xcaba3de8463e3811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119517.062797:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119517.062801:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 46 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119517.062826:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84400/0xcaba3de8463e3811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.062852:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e380a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f83 expref: 48 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.062872:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84400/0xcaba3de8463e3811 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f83 expref: 47 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.062881:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaf600) 00010000:00010000:0.0:1787119517.062884:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119517.062887:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84400, rc 0) 00000100:00100000:0.0:1787119517.062941:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633541888:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 354us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.062948:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19771 00000100:00100000:2.0:1787119517.066152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.066263:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633542016 00000100:00100000:0.0:1787119517.066274:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633542016 00000100:00100000:0.0:1787119517.066383:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19772 00000100:00100000:0.0:1787119517.066393:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633542016:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.066416:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.066464:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3818 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f8a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066534:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066549:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066565:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066606:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066615:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066622:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066688:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066696:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066703:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066709:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d84200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.066714:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066722:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066734:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaf600) 00010000:00010000:0.0:1787119517.066738:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.066742:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066749:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e381f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066766:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066773:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066779:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066784:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d85800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.066787:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066794:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066801:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8635a1a7 (ffff92a609aafb00) 00010000:00010000:0.0:1787119517.066803:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.066806:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066812:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3826 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066841:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3818 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f8a expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066857:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaf600) 00010000:00010000:0.0:1787119517.066859:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.066863:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3818 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f8a expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.066873:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:0.0:1787119517.067120:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633542016:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 726us (977us total) trans 0 rc 301/301 00000100:00100000:0.0:1787119517.067128:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19772 00000100:00100000:1.0:1787119517.070713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.071234:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633542272 00000100:00100000:2.0:1787119517.071247:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633542272 00000100:00100000:2.0:1787119517.071396:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19773 00000100:00100000:2.0:1787119517.071408:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633542272:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.071433:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.071468:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787119517.071499:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84400/0xcaba3de8463e3811 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f83 expref: 47 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.071524:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaf600) 00010000:00010000:2.0:1787119517.071535:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119517.071549:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e382d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f91 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.071671:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.071684:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.071695:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.071708:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.071714:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.071720:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787119517.072410:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c:0x0], index 0: 0 00010000:00010000:2.0:1787119517.072621:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072633:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072648:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072682:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072689:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072696:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072702:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119517.072706:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072713:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072723:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038a00) 00010000:00010000:2.0:1787119517.072725:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119517.072729:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072735:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e3834 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787119517.072748:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000685ad874 reply state 00000000c0eea8f8 transno 4294976598 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.072757:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787119517.072784:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e382d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f91 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072803:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f91 expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.072811:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b:0x0].0x0 (ffff92a620038300) 00010000:00010000:2.0:1787119517.072813:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119517.072816:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92000, rc 0) 00000100:00100000:2.0:1787119517.072888:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:33946:x1873929633542272:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1482us (2185us total) trans 4294976598 rc 0/0 00000100:00100000:2.0:1787119517.072897:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19773 00010000:00010000:0.0:1787119517.078622:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.078639:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.078647:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.078653:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.078658:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.078665:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.078682:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8635a1a7 (ffff92a620038c00) 00010000:00010000:0.0:1787119517.078685:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.078689:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.078697:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93400/0xcaba3de8463e383b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.083190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.083289:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633542528 00000100:00100000:2.0:1787119517.083298:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633542528 00000100:00100000:2.0:1787119517.083360:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19774 00000100:00100000:2.0:1787119517.083370:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:33946:x1873929633542528:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1787119517.083432:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.083477:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92000/0xcaba3de8463e3842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f91 expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.083498:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b:0x0].0x0 (ffff92a620038300) 00010000:00010000:2.0:1787119517.083509:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119517.083741:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.083755:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.083766:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119517.083815:0:15690:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976599 00000004:00010000:2.0:1787119517.083841:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044dd8bcf reply state 000000005bd02eb0 transno 4294976600 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.083850:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119517.083928:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:33946:x1873929633542528:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 558us (749us total) trans 4294976600 rc 0/0 00000100:00100000:2.0:1787119517.083936:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19774 00000020:00080000:2.0:1787119517.083941:0:15690:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787119517.085887:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.085906:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.085914:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.085921:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.085926:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.085934:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.085949:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b:0x0].0x0 (ffff92a620038200) 00010000:00010000:0.0:1787119517.085952:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.085956:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.085979:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92a00/0xcaba3de8463e3850 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.089855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.089958:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633542656 00000100:00100000:1.0:1787119517.089969:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633542656 00000100:00100000:1.0:1787119517.090031:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19775 00000100:00100000:1.0:1787119517.090042:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:33946:x1873929633542656:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.090066:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.090090:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f98 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.090172:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f98 expref: 50 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.090192:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f98 expref: 50 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.090212:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b:0x0].0x0 (ffff92a61bc19000) 00010000:00010000:1.0:1787119517.090216:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787119517.090219:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119517.090278:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:33946:x1873929633542656:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 237us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.090286:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19775 00000100:00100000:3.0:1787119517.092897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.092994:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633542784 00000100:00100000:2.0:1787119517.093004:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633542784 00000100:00100000:2.0:1787119517.093062:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5122 00000100:00100000:2.0:1787119517.093071:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:33946:x1873929633542784:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.093088:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.093120:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715f9f expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119517.093146:0:8267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787119517.093167:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=1043s v=(0 0) 00010000:00010000:2.0:1787119517.093171:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119517.093179:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f9f expref: 8 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.093198:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f9f expref: 8 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.093216:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92000, rc 0) 00000100:00100000:2.0:1787119517.093275:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:33946:x1873929633542784:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 205us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.093283:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5122 00000100:00100000:3.0:1787119517.095583:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.095685:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633542912 00000100:00100000:1.0:1787119517.095695:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633542912 00002000:00010000:1.0:1787119517.095734:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/44 (4096->18446744073709551615) 00002000:00100000:1.0:1787119517.095739:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd880 with x1873929633542912 ext(4096->18446744073709551615) 00002000:00010000:1.0:1787119517.095751:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd880. 00000100:00100000:1.0:1787119517.095783:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10574 00000100:00100000:1.0:1787119517.095792:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633542912:12345-192.168.201.59@tcp:10:mmap_sanity.0 00002000:00010000:1.0:1787119517.096122:0:18546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2c:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1787119517.096127:0:18546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2c:0x0] updating lvb mtime from disk: 0 -> 1787119515 00002000:00010000:1.0:1787119517.096129:0:18546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787119517.096132:0:18546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2c:0x0] updating lvb ctime from disk: 0 -> 1787119515 00002000:00010000:1.0:1787119517.096134:0:18546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787119517.096197:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633542912:12345-192.168.201.59@tcp:10:mmap_sanity.0 Request processed in 405us (621us total) trans 4294968929 rc 0/0 00000100:00100000:1.0:1787119517.096206:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10574 00002000:00010000:1.0:1787119517.096209:0:18546:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/44 (4096->18446744073709551615) 00002000:00100000:1.0:1787119517.096213:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bd880 with x1873929633542912 ext(4096->18446744073709551615) 00002000:00010000:1.0:1787119517.096218:0:18546:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bd880. 00000100:00100000:3.0:1787119517.100270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.100426:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633543040 00000100:00100000:0.0:1787119517.100474:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633543040 00002000:00100000:0.0:1787119517.100522:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2c:0x0] (0->4095) req@ffff92a6068bc380 x1873929633543040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.100541:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc380 with x1873929633543040 ext(0->4095) 00002000:00010000:0.0:1787119517.100546:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc380 00000100:00100000:0.0:1787119517.100579:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10575 00000100:00100000:0.0:1787119517.100588:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633543040:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119517.100835:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633543040:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 247us (575us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119517.100844:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10575 00002000:00100000:0.0:1787119517.100851:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2c:0x0] (0->4095) req@ffff92a6068bc380 x1873929633543040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.100859:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc380 with x1873929633543040 ext(0->4095) 00002000:00010000:0.0:1787119517.100862:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a6068bc380 00000100:00100000:3.0:1787119517.103981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.104084:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633543296 00000100:00100000:2.0:1787119517.104102:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633543296 00000100:00100000:2.0:1787119517.104160:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 227 00000100:00100000:2.0:1787119517.104170:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:33946:x1873929633543296:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1787119517.104416:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:33946:x1873929633543296:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 245us (444us total) trans 4294976601 rc 0/0 00000100:00100000:2.0:1787119517.104424:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 227 00000100:00100000:1.0:1787119517.106737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.106832:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633543424 00000100:00100000:0.0:1787119517.106842:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633543424 00000100:00100000:0.0:1787119517.106899:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19776 00000100:00100000:0.0:1787119517.106909:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:33946:x1873929633543424:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.106933:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.106967:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fa6 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.107035:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e386c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.107048:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e386c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.107064:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e386c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119517.107138:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119517.107142:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 47 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119517.107167:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e386c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.107193:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fa6 expref: 53 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.107215:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e386c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fa6 expref: 52 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.107223:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:0.0:1787119517.107226:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119517.107230:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85800, rc 0) 00000100:00100000:0.0:1787119517.107290:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633543424:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 382us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.107298:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19776 00000100:00100000:3.0:1787119517.110053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.110916:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633543680 00000100:00100000:2.0:1787119517.110928:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633543680 00000100:00100000:2.0:1787119517.110999:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19777 00000100:00100000:2.0:1787119517.111009:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633543680:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.111029:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.111049:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fad expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111155:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111171:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111186:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111201:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111208:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111215:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111354:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e3888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111364:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e3888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111372:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e3888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119517.111382:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6b:0x0]: returning size 4096 00010000:00010000:2.0:1787119517.111504:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111512:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111519:0:15690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111526:0:15690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119517.111531:0:15690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111539:0:15690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111551:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:2.0:1787119517.111554:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119517.111559:0:15690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111566:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e387a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111579:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111585:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111591:0:15690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111596:0:15690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119517.111599:0:15690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111606:0:15690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111613:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8635a1a7 (ffff92a620038b00) 00010000:00010000:2.0:1787119517.111615:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119517.111618:0:15690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111624:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e3881 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111662:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e3873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fad expref: 55 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111676:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e3888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fad expref: 54 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.111684:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b:0x0].0x0 (ffff92a61bc19000) 00010000:00010000:2.0:1787119517.111687:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119517.111689:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:2.0:1787119517.111760:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:33946:x1873929633543680:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 752us (1717us total) trans 4294976602 rc 0/0 00000100:00100000:2.0:1787119517.111768:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19777 00000100:00100000:3.0:1787119517.114938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.115239:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633543936 00000100:00100000:1.0:1787119517.115249:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633543936 00000100:00100000:1.0:1787119517.115316:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 228 00000100:00100000:1.0:1787119517.115326:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6080bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:33946:x1873929633543936:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1787119517.115596:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6080bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:33946:x1873929633543936:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 270us (666us total) trans 4294976603 rc 0/0 00000100:00100000:1.0:1787119517.115604:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 228 00000100:00100000:1.0:1787119517.118620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.118721:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633544192 00000100:00100000:0.0:1787119517.118731:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633544192 00000100:00100000:0.0:1787119517.118804:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19778 00000100:00100000:0.0:1787119517.118814:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:33946:x1873929633544192:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1787119517.118874:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787119517.118903:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93c00/0xcaba3de8463e3888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fad expref: 55 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.118929:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a513430c00/0xcaba3de8463e3857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f98 expref: 54 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.118938:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b:0x0].0x0 (ffff92a61bc19000) 00010000:00010000:0.0:1787119517.118952:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e386c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fa6 expref: 53 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.118974:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:0.0:1787119517.118979:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119517.119002:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119014:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119021:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119032:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119038:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119043:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119162:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119175:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119182:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787119517.119851:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9408 00000004:00080000:0.0:1787119517.119863:0:15720:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1043197422840ns, next at 1044197420223ns, rc = 0 00010000:00010000:0.0:1787119517.119929:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119941:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119950:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119958:0:15720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119965:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.119971:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120002:0:15720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787119517.120022:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120028:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120035:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120042:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d84600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.120047:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120054:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120065:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b:0x0].0x0 (ffff92a609aaf300) 00010000:00010000:0.0:1787119517.120068:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787119517.120073:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120078:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e38a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120108:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120115:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120120:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120126:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d85400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.120129:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120139:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120147:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafe00) 00010000:00010000:0.0:1787119517.120149:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.120152:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.120157:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85400/0xcaba3de8463e3896 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787119517.120172:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b3f0a30 reply state 0000000075d6a63c transno 4294976604 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.120181:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119517.120272:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:33946:x1873929633544192:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 1456us (1659us total) trans 4294976604 rc 0/0 00000100:00100000:0.0:1787119517.120280:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19778 00010000:00010000:2.0:1787119517.121319:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787119517.121330:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.121340:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d84000 already unused, calling callback (ffffffffc163d010) 00010000:00010000:2.0:1787119517.121343:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.121352:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.121366:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b:0x0].0x0 (ffff92a609aaf300) 00010000:00010000:2.0:1787119517.121369:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787119517.121373:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.121379:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84000/0xcaba3de8463e38ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.121402:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119517.121404:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119517.121405:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119517.123012:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.123028:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.123037:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.123044:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d84200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.123049:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.123061:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.123077:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8635a1a7 (ffff92a609aaff00) 00010000:00010000:0.0:1787119517.123079:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.123084:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.123090:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e389d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.125324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.126410:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633544320 00000100:00100000:3.0:1787119517.126422:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633544320 00000100:00100000:3.0:1787119517.126659:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19779 00000100:00100000:3.0:1787119517.126671:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:33946:x1873929633544320:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119517.126702:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119517.126728:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1200/0xcaba3de8463e38b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fb4 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.126801:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e38b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.126815:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e38b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.126828:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e38b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119517.126893:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1787119517.126898:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 46 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119517.126923:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e38b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.126949:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1200/0xcaba3de8463e38b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fb4 expref: 55 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.127105:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e38b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fb4 expref: 54 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.127114:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a60384cf00) 00010000:00010000:3.0:1787119517.127117:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787119517.127121:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1a00, rc 0) 00000100:00100000:3.0:1787119517.127235:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:33946:x1873929633544320:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 566us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119517.127243:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19779 00000100:00100000:0.0:1787119517.138598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.138736:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633544448 00000100:00100000:3.0:1787119517.138746:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633544448 00000100:00100000:3.0:1787119517.138912:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19780 00000100:00100000:3.0:1787119517.138923:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:33946:x1873929633544448:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119517.138945:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119517.138965:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e38c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fbb expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139036:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139050:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139060:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139132:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139141:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139148:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139218:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139225:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139231:0:15690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139237:0:15690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119517.139253:0:15690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139261:0:15690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139273:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a60384cf00) 00010000:00010000:3.0:1787119517.139276:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119517.139281:0:15690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139287:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1800/0xcaba3de8463e38c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139299:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139305:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139310:0:15690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139314:0:15690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119517.139317:0:15690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139323:0:15690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139330:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1b4ce6b (ffff92a60384ce00) 00010000:00010000:3.0:1787119517.139333:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119517.139336:0:15690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139341:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e38ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139376:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e38c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fbb expref: 55 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139386:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a60384cf00) 00010000:00010000:3.0:1787119517.139388:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119517.139390:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e38c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fbb expref: 55 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.139402:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1600, rc 0) 00000100:00100000:3.0:1787119517.139488:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:33946:x1873929633544448:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 566us (899us total) trans 0 rc 301/301 00000100:00100000:3.0:1787119517.139497:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19780 00000100:00100000:3.0:1787119517.143547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.143666:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633544704 00000100:00100000:2.0:1787119517.143677:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633544704 00000100:00100000:2.0:1787119517.143832:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19781 00000100:00100000:2.0:1787119517.143843:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:33946:x1873929633544704:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.143862:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.143865:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787119517.143890:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1a00/0xcaba3de8463e38b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fb4 expref: 54 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.143907:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a60384cf00) 00010000:00010000:2.0:1787119517.143919:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119517.143932:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e38d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fc2 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144072:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144085:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144110:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144123:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144131:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144138:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787119517.144720:0:15690:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b:0x0], index 1: 0 00010000:00010000:2.0:1787119517.144895:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e38ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144907:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e38ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144915:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e38ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144950:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144958:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144964:0:15690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144971:0:15690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f92800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119517.144975:0:15690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144986:0:15690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.144995:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038b00) 00010000:00010000:2.0:1787119517.144998:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119517.145002:0:15690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.145008:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92800/0xcaba3de8463e38dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787119517.145019:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000027ec0a7 reply state 00000000eed846d3 transno 4294976605 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.145028:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787119517.145056:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92c00/0xcaba3de8463e38d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fc2 expref: 56 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.145073:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e38ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fc2 expref: 55 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.145080:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a620038100) 00010000:00010000:2.0:1787119517.145082:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119517.145084:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119517.145171:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633544704:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1330us (1634us total) trans 4294976605 rc 0/0 00000100:00100000:2.0:1787119517.145179:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19781 00000100:00100000:1.0:1787119517.150894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.150936:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633544960 00000100:00100000:2.0:1787119517.150946:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633544960 00000100:00100000:2.0:1787119517.151111:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19782 00000100:00100000:2.0:1787119517.151122:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633544960:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1787119517.151181:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.151208:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f92200/0xcaba3de8463e38ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fc2 expref: 56 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.151229:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a620038100) 00010000:00010000:2.0:1787119517.151239:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119517.151522:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.151537:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.151547:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119517.151627:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976606 00000004:00010000:1.0:1787119517.151659:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000762c188f reply state 000000001d98445e transno 4294976607 ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.151669:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787119517.151776:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+58:33946:x1873929633544960:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 654us (887us total) trans 4294976607 rc 0/0 00000100:00100000:1.0:1787119517.151784:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19782 00000020:00080000:1.0:1787119517.151789:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787119517.152504:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.152515:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.152522:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.152529:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.152534:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.152541:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.152555:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1b4ce6b (ffff92a620038600) 00010000:00010000:0.0:1787119517.152559:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.152563:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.152568:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93000/0xcaba3de8463e38e3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.156593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119517.156658:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.156671:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.156679:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.156699:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a505f93e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.156704:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.156711:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.156728:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a620038e00) 00010000:00010000:0.0:1787119517.156731:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.156735:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.156742:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a505f93e00/0xcaba3de8463e38f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.157316:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633545088 00000100:00100000:3.0:1787119517.157327:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633545088 00000100:00100000:3.0:1787119517.157386:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19783 00000100:00100000:3.0:1787119517.157397:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633545088:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119517.157421:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119517.157464:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e38ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fc9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.157522:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e38ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fc9 expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.157532:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e38ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fc9 expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.157546:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:3.0:1787119517.157548:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787119517.157550:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1600, rc 0) 00000100:00100000:3.0:1787119517.157599:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633545088:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 204us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119517.157606:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19783 00000100:00100000:2.0:1787119517.161747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.161802:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633545216 00000100:00100000:1.0:1787119517.161811:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633545216 00000100:00100000:1.0:1787119517.161870:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5123 00000100:00100000:1.0:1787119517.161880:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:33946:x1873929633545216:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.161904:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.161926:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fd0 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119517.161952:0:20843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787119517.162068:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=1043s v=(0 0) 00010000:00010000:1.0:1787119517.162074:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119517.162083:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 9 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.162117:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 9 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.162130:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119517.162196:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:33946:x1873929633545216:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 316us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.162203:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5123 00000100:00100000:1.0:1787119517.169617:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.170074:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633545344 00000100:00100000:3.0:1787119517.170086:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633545344 00002000:00010000:3.0:1787119517.170144:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/43 (409600->18446744073709551615) 00002000:00100000:3.0:1787119517.170149:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc700 with x1873929633545344 ext(409600->18446744073709551615) 00002000:00010000:3.0:1787119517.170162:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc700. 00000100:00100000:3.0:1787119517.170199:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10576 00000100:00100000:3.0:1787119517.170210:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633545344:12345-192.168.201.59@tcp:10:mmap_sanity.0 00002000:00010000:3.0:1787119517.170804:0:20606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:3.0:1787119517.170809:0:20606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 0 -> 1787119515 00002000:00010000:3.0:1787119517.170812:0:20606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787119517.170814:0:20606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 0 -> 1787119515 00002000:00010000:3.0:1787119517.170816:0:20606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787119517.170889:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633545344:12345-192.168.201.59@tcp:10:mmap_sanity.0 Request processed in 679us (1284us total) trans 4294969217 rc 0/0 00000100:00100000:3.0:1787119517.170897:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10576 00002000:00010000:3.0:1787119517.170901:0:20606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/43 (409600->18446744073709551615) 00002000:00100000:3.0:1787119517.170904:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc700 with x1873929633545344 ext(409600->18446744073709551615) 00002000:00010000:3.0:1787119517.170910:0:20606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfc700. 00000100:00100000:3.0:1787119517.174578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.174625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.174708:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633545472 00000100:00100000:2.0:1787119517.174718:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633545472 00002000:00100000:2.0:1787119517.174767:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (0->4095) req@ffff92a6068bc000 x1873929633545472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.174779:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633545472 ext(0->4095) 00002000:00010000:2.0:1787119517.174784:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bc000 00000100:00100000:0.0:1787119517.174806:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633545600 00000100:00100000:2.0:1787119517.174807:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10577 00000100:00100000:0.0:1787119517.174811:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633545600 00000100:00100000:2.0:1787119517.174816:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633545472:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119517.174846:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19784 00000100:00100000:0.0:1787119517.174853:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+15:33957:x1873929633545600:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.174865:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.174886:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e390d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fd7 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.174951:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.174965:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.174976:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119517.175033:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119517.175036:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 47 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119517.175059:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.175076:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633545472:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 261us (508us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119517.175084:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10577 00010000:00010000:0.0:1787119517.175086:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e390d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fd7 expref: 17 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.175118:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fd7 expref: 16 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.175127:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaff00) 00010000:00010000:0.0:1787119517.175130:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119517.175133:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84600, rc 0) 00002000:00100000:2.0:1787119517.175160:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (0->4095) req@ffff92a6068bc000 x1873929633545472/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787119517.175164:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+16:33957:x1873929633545600:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 312us (539us total) trans 0 rc 0/0 00002000:00100000:2.0:1787119517.175170:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633545472 ext(0->4095) 00002000:00010000:2.0:1787119517.175173:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bc000 00000100:00100000:0.0:1787119517.175174:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19784 00000100:00100000:3.0:1787119517.186727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.187039:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633545856 00000100:00100000:0.0:1787119517.187051:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633545856 00000100:00100000:0.0:1787119517.187234:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19785 00000100:00100000:0.0:1787119517.187246:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+16:33957:x1873929633545856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.187270:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.187293:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e391b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fde expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187376:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187390:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187401:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187415:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187421:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187427:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187593:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187607:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187623:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119517.187633:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6c:0x0]: returning size 409600 00010000:00010000:0.0:1787119517.187734:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187742:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187749:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187755:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d85800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.187759:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187767:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187780:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaff00) 00010000:00010000:0.0:1787119517.187788:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.187792:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187798:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d85800/0xcaba3de8463e3922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187814:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187821:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187826:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187831:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d84800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119517.187834:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187838:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187845:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1b4ce6b (ffff92a609aafe00) 00010000:00010000:0.0:1787119517.187847:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119517.187849:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187853:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e3929 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187895:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84200/0xcaba3de8463e391b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fde expref: 19 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187908:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fde expref: 18 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.187915:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:0.0:1787119517.187917:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119517.187920:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84a00, rc 0) 00000100:00100000:0.0:1787119517.187989:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33957:x1873929633545856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 746us (1270us total) trans 4294976608 rc 0/0 00000100:00100000:0.0:1787119517.187997:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19785 00000100:00100000:3.0:1787119517.189218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.190061:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633545984 00000100:00100000:1.0:1787119517.190071:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633545984 00002000:00100000:1.0:1787119517.190223:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (4096->8191) req@ffff92a6068be680 x1873929633545984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.190234:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be680 with x1873929633545984 ext(4096->8191) 00002000:00010000:1.0:1787119517.190240:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068be680 00000100:00100000:1.0:1787119517.190274:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10578 00000100:00100000:1.0:1787119517.190285:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633545984:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.190529:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633545984:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 245us (1317us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119517.190538:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10578 00002000:00100000:1.0:1787119517.190545:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (4096->8191) req@ffff92a6068be680 x1873929633545984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.190553:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be680 with x1873929633545984 ext(4096->8191) 00002000:00010000:1.0:1787119517.190557:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068be680 00000100:00100000:2.0:1787119517.193891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.194274:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633546240 00000100:00100000:3.0:1787119517.194296:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633546240 00002000:00100000:3.0:1787119517.194346:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (8192->12287) req@ffff92a62a120000 x1873929633546240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.194364:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120000 with x1873929633546240 ext(8192->12287) 00002000:00010000:3.0:1787119517.194370:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120000 00000100:00100000:3.0:1787119517.194394:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10579 00000100:00100000:3.0:1787119517.194404:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633546240:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.194679:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633546240:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 275us (799us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119517.194687:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10579 00002000:00100000:3.0:1787119517.194694:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (8192->12287) req@ffff92a62a120000 x1873929633546240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.194703:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120000 with x1873929633546240 ext(8192->12287) 00002000:00010000:3.0:1787119517.194707:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120000 00000100:00100000:3.0:1787119517.197242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.198647:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633546112 00000100:00100000:0.0:1787119517.198662:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633546112 00000100:00100000:0.0:1787119517.198732:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5124 00000100:00100000:0.0:1787119517.198743:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+5:2375:x1873929633546112:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.198760:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.198777:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e393e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fe5 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.198835:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653574016:192.168.201.59@tcp:106: 00000100:00100000:0.0:1787119517.198924:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc06000 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.200827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.201350:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633546368 00000100:00100000:3.0:1787119517.201359:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633546368 00002000:00100000:3.0:1787119517.201410:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (12288->69631) req@ffff92a62a120a80 x1873929633546368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.201420:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120a80 with x1873929633546368 ext(12288->69631) 00002000:00010000:3.0:1787119517.201425:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120a80 00000100:00100000:3.0:1787119517.201500:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10580 00000100:00100000:3.0:1787119517.201510:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633546368:12345-192.168.201.59@tcp:3:kworker.0 00002000:00010000:0.0:1787119517.204685:0:20841:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb atime: 0 -> 1787119515 00000100:00100000:0.0:1787119517.204718:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653574016:192.168.201.59@tcp:106: 00010000:00010000:0.0:1787119517.204767:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e393e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fe5 expref: 6 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.204792:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e393e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fe5 expref: 6 pid: 20841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.204806:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84200, rc 0) 00000100:00100000:0.0:1787119517.204875:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+5:2375:x1873929633546112:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6133us (7642us total) trans 0 rc 301/301 00000100:00100000:0.0:1787119517.204884:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5124 00000100:00100000:3.0:1787119517.208182:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633546368:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6662us (7352us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119517.208199:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10580 00002000:00100000:3.0:1787119517.208212:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (12288->69631) req@ffff92a62a120a80 x1873929633546368/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.208223:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120a80 with x1873929633546368 ext(12288->69631) 00002000:00010000:3.0:1787119517.208230:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120a80 00000100:00100000:2.0:1787119517.210430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.210585:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633546496 00000100:00100000:0.0:1787119517.210596:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633546496 00000100:00100000:0.0:1787119517.210654:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5125 00000100:00100000:0.0:1787119517.210663:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+5:33957:x1873929633546496:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.210681:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.210700:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715fec expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.210730:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 9 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.210739:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787119517.210744:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787119517.210749:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.210780:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 9 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.210805:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 9 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.210820:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653574144:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119517.210902:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc06000 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.216231:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653574144:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119517.216286:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.216308:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84200, rc 0) 00000100:00100000:0.0:1787119517.216377:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+6:33957:x1873929633546496:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5713us (5954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.216386:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5125 00000100:00100000:1.0:1787119517.221366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.221633:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633546624 00000100:00100000:0.0:1787119517.221644:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633546624 00002000:00100000:0.0:1787119517.221697:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (0->32767) req@ffff92a508cfce00 x1873929633546624/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.221709:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfce00 with x1873929633546624 ext(0->32767) 00010000:00010000:0.0:1787119517.221719:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 10 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.221749:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 10 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.221757:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfce00 00000100:00100000:0.0:1787119517.221791:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1114 00000100:00100000:0.0:1787119517.221802:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633546624:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119517.228542:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633546624:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 6733us (7177us total) trans 4294969218 rc 0/0 00000100:00100000:0.0:1787119517.228555:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1114 00002000:00100000:0.0:1787119517.228567:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (0->32767) req@ffff92a508cfce00 x1873929633546624/t4294969218(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/448 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.228583:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfce00 with x1873929633546624 ext(0->32767) 00010000:00010000:0.0:1787119517.228593:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 12 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.228621:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 12 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.228630:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfce00 00000100:00100000:2.0:1787119517.233553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.233789:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633546752 00000100:00100000:0.0:1787119517.233799:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633546752 00002000:00100000:0.0:1787119517.233846:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (32768->36863) req@ffff92a62a121c00 x1873929633546752/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 4584/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.233857:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121c00 with x1873929633546752 ext(32768->36863) 00010000:00010000:0.0:1787119517.233867:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 12 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.233895:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 12 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.233903:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a121c00 00000100:00100000:0.0:1787119517.233939:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1115 00000100:00100000:0.0:1787119517.233948:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633546752:12345-192.168.201.59@tcp:4:kworker.0 00000100:00100000:0.0:1787119517.234721:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633546752:12345-192.168.201.59@tcp:4:kworker.0 Request processed in 769us (1173us total) trans 4294969219 rc 0/0 00000100:00100000:0.0:1787119517.234731:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1115 00002000:00100000:0.0:1787119517.234740:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (32768->36863) req@ffff92a62a121c00 x1873929633546752/t4294969219(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 4584/448 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 0/0 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.234749:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121c00 with x1873929633546752 ext(32768->36863) 00010000:00010000:0.0:1787119517.234757:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 14 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.234775:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 14 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.234782:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a121c00 00000100:00100000:1.0:1787119517.236079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.238338:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633546880 00000100:00100000:0.0:1787119517.238354:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633546880 00000100:00100000:0.0:1787119517.238420:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5126 00000100:00100000:0.0:1787119517.238430:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633546880:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.238479:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.238502:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ff3 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.238531:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787119517.238536:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1787119517.238542:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 15 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.238556:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 15 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.238571:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:0.0:1787119517.238631:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633546880:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 202us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.238639:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5126 00000100:00100000:2.0:1787119517.239836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.239919:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633547008 00000100:00100000:1.0:1787119517.239927:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633547008 00010000:00010000:1.0:1787119517.239982:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 15 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.240024:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5215 00000100:00100000:1.0:1787119517.240032:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633547008:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119517.240046:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119517.240069:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 15 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.240104:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 15 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.240128:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3906 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd0 expref: 15 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.240144:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787119517.240148:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787119517.240157:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 5 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.240167:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 5 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.240176:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787119517.240179:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787119517.240184:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.240192:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.240229:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.240243:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653574272:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.240622:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 5 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.240633:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653574400:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.240662:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.244664:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653574272:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.244690:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653574400:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.244720:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.244781:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633547008:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4748us (4950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.244791:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5215 00000100:00100000:1.0:1787119517.250266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.250367:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633547136 00000100:00100000:3.0:1787119517.250379:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633547136 00002000:00100000:3.0:1787119517.250430:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (0->4095) req@ffff92a508cfea00 x1873929633547136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.250488:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfea00 with x1873929633547136 ext(0->4095) 00002000:00010000:3.0:1787119517.250495:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfea00 00000100:00100000:3.0:1787119517.250529:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10581 00000100:00100000:3.0:1787119517.250539:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633547136:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.250745:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633547136:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 207us (488us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119517.250752:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10581 00002000:00100000:3.0:1787119517.250759:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (0->4095) req@ffff92a508cfea00 x1873929633547136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.250767:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfea00 with x1873929633547136 ext(0->4095) 00002000:00010000:3.0:1787119517.250771:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfea00 00000100:00100000:2.0:1787119517.261398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.262571:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633547264 00000100:00100000:3.0:1787119517.262584:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633547264 00002000:00100000:3.0:1787119517.262645:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (4096->8191) req@ffff92a62a120e00 x1873929633547264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.262658:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120e00 with x1873929633547264 ext(4096->8191) 00002000:00010000:3.0:1787119517.262664:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120e00 00000100:00100000:3.0:1787119517.262701:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10582 00000100:00100000:3.0:1787119517.262711:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633547264:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.262926:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633547264:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 216us (1538us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119517.262934:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10582 00002000:00100000:3.0:1787119517.262941:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (4096->8191) req@ffff92a62a120e00 x1873929633547264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.262961:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120e00 with x1873929633547264 ext(4096->8191) 00002000:00010000:3.0:1787119517.262965:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120e00 00000100:00100000:0.0:1787119517.265895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.265999:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633547392 00000100:00100000:1.0:1787119517.266009:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633547392 00002000:00100000:1.0:1787119517.266058:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (32768->36863) req@ffff92a62a124000 x1873929633547392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.266070:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124000 with x1873929633547392 ext(32768->36863) 00002000:00010000:1.0:1787119517.266076:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a124000 00000100:00100000:1.0:1787119517.266124:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10583 00000100:00100000:1.0:1787119517.266134:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633547392:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.266386:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633547392:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 252us (501us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119517.266394:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10583 00002000:00100000:1.0:1787119517.266401:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (32768->36863) req@ffff92a62a124000 x1873929633547392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.266410:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124000 with x1873929633547392 ext(32768->36863) 00002000:00010000:1.0:1787119517.266413:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a124000 00000100:00100000:1.0:1787119517.272202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.272528:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633547520 00000100:00100000:2.0:1787119517.272540:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633547520 00002000:00100000:2.0:1787119517.272589:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (8192->12287) req@ffff92a508cff100 x1873929633547520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.272600:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633547520 ext(8192->12287) 00002000:00010000:2.0:1787119517.272606:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff100 00000100:00100000:2.0:1787119517.272643:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10584 00000100:00100000:2.0:1787119517.272653:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633547520:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119517.272917:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633547520:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 265us (726us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119517.272925:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10584 00002000:00100000:2.0:1787119517.272931:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (8192->12287) req@ffff92a508cff100 x1873929633547520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.272946:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633547520 ext(8192->12287) 00002000:00010000:2.0:1787119517.272949:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff100 00000100:00100000:2.0:1787119517.279145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.279260:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633547648 00000100:00100000:1.0:1787119517.279270:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633547648 00002000:00100000:1.0:1787119517.279330:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (36864->40959) req@ffff92a62a121180 x1873929633547648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.279342:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121180 with x1873929633547648 ext(36864->40959) 00002000:00010000:1.0:1787119517.279348:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121180 00000100:00100000:1.0:1787119517.279381:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10585 00000100:00100000:1.0:1787119517.279391:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633547648:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.279609:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633547648:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 219us (473us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119517.279617:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10585 00002000:00100000:1.0:1787119517.279625:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (36864->40959) req@ffff92a62a121180 x1873929633547648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.279634:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121180 with x1873929633547648 ext(36864->40959) 00002000:00010000:1.0:1787119517.279637:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121180 00000100:00100000:0.0:1787119517.283136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.283289:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633547776 00000100:00100000:3.0:1787119517.283300:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633547776 00002000:00100000:3.0:1787119517.283354:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (12288->32767) req@ffff92a62041ed80 x1873929633547776/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.283367:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ed80 with x1873929633547776 ext(12288->32767) 00002000:00010000:3.0:1787119517.283374:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ed80 00000100:00100000:3.0:1787119517.283411:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10586 00000100:00100000:3.0:1787119517.283422:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633547776:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.287084:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633547776:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3651us (3945us total) trans 0 rc 20480/20480 00000100:00100000:3.0:1787119517.287114:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10586 00002000:00100000:3.0:1787119517.287127:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (12288->32767) req@ffff92a62041ed80 x1873929633547776/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.287137:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ed80 with x1873929633547776 ext(12288->32767) 00002000:00010000:3.0:1787119517.287143:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ed80 00000100:00100000:3.0:1787119517.294967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.295123:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633547904 00000100:00100000:1.0:1787119517.295134:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633547904 00002000:00100000:1.0:1787119517.295193:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a6068be300 x1873929633547904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.295204:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be300 with x1873929633547904 ext(40960->45055) 00002000:00010000:1.0:1787119517.295209:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068be300 00000100:00100000:1.0:1787119517.295241:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10587 00000100:00100000:1.0:1787119517.295251:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633547904:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.295484:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633547904:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 234us (539us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119517.295493:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10587 00002000:00100000:1.0:1787119517.295499:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a6068be300 x1873929633547904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.295506:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be300 with x1873929633547904 ext(40960->45055) 00002000:00010000:1.0:1787119517.295509:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068be300 00000100:00100000:2.0:1787119517.297218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.297680:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633548032 00000100:00100000:1.0:1787119517.297689:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633548032 00000100:00100000:1.0:1787119517.297751:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5127 00000100:00100000:1.0:1787119517.297762:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+6:33957:x1873929633548032:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.297780:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.297803:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204715ffa expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.297838:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.297848:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787119517.297853:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1787119517.297859:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.297895:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.297927:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 13 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.297943:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653574528:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119517.298053:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.301813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.301904:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633548160 00000100:00100000:0.0:1787119517.301913:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633548160 00002000:00100000:0.0:1787119517.301967:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (32768->40959) req@ffff92a62a123100 x1873929633548160/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 8680/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.301977:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123100 with x1873929633548160 ext(32768->40959) 00010000:00010000:0.0:1787119517.301987:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 14 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.302015:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 14 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.302023:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a123100 00000100:00100000:0.0:1787119517.302052:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1116 00000100:00100000:0.0:1787119517.302060:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633548160:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119517.302474:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633548160:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 413us (669us total) trans 4294969220 rc 0/0 00000100:00100000:0.0:1787119517.302482:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1116 00002000:00100000:0.0:1787119517.302490:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (32768->40959) req@ffff92a62a123100 x1873929633548160/t4294969220(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 8680/448 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.302499:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123100 with x1873929633548160 ext(32768->40959) 00010000:00010000:0.0:1787119517.302505:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 16 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.302520:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 16 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.302527:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a123100 00000100:00100000:1.0:1787119517.303009:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653574528:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119517.303038:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.303054:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431000, rc 0) 00000100:00100000:1.0:1787119517.303103:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+7:33957:x1873929633548032:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5329us (5881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.303110:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5127 00000100:00100000:2.0:1787119517.316804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.316932:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633548288 00000100:00100000:0.0:1787119517.316942:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633548288 00000100:00100000:0.0:1787119517.317012:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5128 00000100:00100000:0.0:1787119517.317021:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633548288:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.317039:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.317059:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716001 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.317126:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1787119517.317132:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1787119517.317138:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.317152:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.317172:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:0.0:1787119517.317245:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633548288:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 224us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.317253:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5128 00000100:00100000:0.0:1787119517.320563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.320675:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633548416 00000100:00100000:2.0:1787119517.320686:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633548416 00010000:00010000:2.0:1787119517.320728:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 17 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.320775:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5216 00000100:00100000:2.0:1787119517.320785:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633548416:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119517.320800:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.320826:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 17 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.320854:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 17 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.320878:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e394c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [32768->18446744073709551615] (req 32768->36863) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204715ff3 expref: 17 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.320897:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1787119517.320901:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1787119517.320911:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 6 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.320921:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 6 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.320930:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1787119517.320933:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1787119517.320938:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.320946:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.320984:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.320999:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a120700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653574656:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119517.321116:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 6 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.321126:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a123480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653574784:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119517.321150:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.323761:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a120700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653574656:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119517.323778:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a123480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653574784:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119517.323803:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119517.323864:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633548416:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3079us (3309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.323875:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5216 00000100:00100000:1.0:1787119517.330369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.330468:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633548544 00000100:00100000:2.0:1787119517.330479:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633548544 00002000:00100000:2.0:1787119517.330531:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (32768->40959) req@ffff92a508cff480 x1873929633548544/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.330542:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff480 with x1873929633548544 ext(32768->40959) 00002000:00010000:2.0:1787119517.330547:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff480 00000100:00100000:2.0:1787119517.330581:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10588 00000100:00100000:2.0:1787119517.330591:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633548544:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119517.330819:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633548544:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 228us (459us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119517.330827:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10588 00002000:00100000:2.0:1787119517.330834:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (32768->40959) req@ffff92a508cff480 x1873929633548544/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/8632 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.330843:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff480 with x1873929633548544 ext(32768->40959) 00002000:00010000:2.0:1787119517.330846:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cff480 00000100:00100000:0.0:1787119517.336041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.336431:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633548672 00000100:00100000:2.0:1787119517.336477:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633548672 00000100:00100000:2.0:1787119517.336533:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5129 00000100:00100000:2.0:1787119517.336543:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+7:33957:x1873929633548672:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.336561:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.336582:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716008 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.336618:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 15 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.336627:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1787119517.336632:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 0) 00010000:00010000:2.0:1787119517.336638:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.336674:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 15 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.336701:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 15 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.336715:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653574912:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119517.336803:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.340008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.340105:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633548800 00000100:00100000:3.0:1787119517.340115:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633548800 00010000:00010000:3.0:1787119517.340159:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 16 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.340207:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5217 00000100:00100000:3.0:1787119517.340218:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633548800:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119517.340233:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119517.340259:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 16 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.340298:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 16 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.340325:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 0) 00010000:00010000:3.0:1787119517.340330:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 0) 00010000:00010000:3.0:1787119517.340338:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.340348:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.340391:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.340408:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653575040:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119517.340522:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60617d300 going to sleep for 11 seconds 00010000:00010000:2.0:1787119517.342166:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e395a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716001 expref: 16 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.342190:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653574912:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119517.342225:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.342243:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119517.342326:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633548672:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5783us (6295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.342334:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5129 00000100:00100000:0.0:1787119517.344497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.344596:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633548928 00000100:00100000:1.0:1787119517.344606:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633548928 00000100:00100000:1.0:1787119517.344661:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5130 00000100:00100000:1.0:1787119517.344670:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633548928:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.344692:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.344716:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471600f expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.344751:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.344763:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 0) 00010000:00010000:1.0:1787119517.344767:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1787119517.344773:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 17 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.344810:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.344836:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 7 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.344852:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653575168:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119517.344940:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.348183:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653575168:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119517.348223:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 17 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.348246:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:0.0:1787119517.348324:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633548928:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3653us (3836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.348333:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5130 00000100:00100000:3.0:1787119517.351637:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653575040:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119517.351672:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.351934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.352065:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633549056 00000100:00100000:3.0:1787119517.352072:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633549056 00002000:00100000:3.0:1787119517.352136:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a62041ea00 x1873929633549056/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.352148:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ea00 with x1873929633549056 ext(40960->77823) 00010000:00010000:3.0:1787119517.352156:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.352186:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.352194:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041ea00 00000100:00100000:3.0:1787119517.352233:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1117 00000100:00100000:3.0:1787119517.352243:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633549056:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119517.353654:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633548800:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13427us (13645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.353668:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5217 00000100:00100000:3.0:1787119517.359166:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633549056:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6913us (7222us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119517.359185:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1117 00002000:00100000:3.0:1787119517.359199:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a62041ea00 x1873929633549056/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.359209:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ea00 with x1873929633549056 ext(40960->77823) 00010000:00010000:3.0:1787119517.359220:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.359251:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.359260:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041ea00 00000100:00100000:1.0:1787119517.362827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.362874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.362980:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633549184 00000100:00100000:2.0:1787119517.362991:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633549184 00000100:00100000:2.0:1787119517.363051:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5131 00000100:00100000:2.0:1787119517.363061:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633549184:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.363079:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.363110:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716016 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.363146:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 0) 00010000:00010000:2.0:1787119517.363155:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.363162:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1787119517.363167:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 9 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.363213:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.363228:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 9 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.363247:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119517.363319:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633549184:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 259us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.363327:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5131 00000100:00100000:3.0:1787119517.364550:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633549312 00000100:00100000:3.0:1787119517.364563:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633549312 00010000:00010000:3.0:1787119517.364601:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.364646:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5218 00000100:00100000:3.0:1787119517.364654:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2373:x1873929633549312:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119517.364668:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119517.364690:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.364716:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.364747:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3961 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716008 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.364764:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 0) 00010000:00010000:3.0:1787119517.364768:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 0) 00010000:00010000:3.0:1787119517.364777:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.364786:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.364821:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.364834:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 15 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.364847:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653575424:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119517.364929:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60617d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119517.367946:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653575424:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119517.367990:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119517.368052:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633549312:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3398us (5176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119517.368063:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5218 00000100:00100000:1.0:1787119517.369215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.369583:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633549440 00000100:00100000:3.0:1787119517.369593:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633549440 00002000:00100000:3.0:1787119517.369645:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a508cfd880 x1873929633549440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.369657:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd880 with x1873929633549440 ext(40960->45055) 00010000:00010000:3.0:1787119517.369667:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.369697:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.369706:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfd880 00000100:00100000:3.0:1787119517.369741:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1118 00000100:00100000:3.0:1787119517.369751:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633549440:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.369948:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633549440:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 198us (740us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119517.369969:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1118 00002000:00100000:3.0:1787119517.369977:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a508cfd880 x1873929633549440/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.369984:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd880 with x1873929633549440 ext(40960->45055) 00010000:00010000:3.0:1787119517.369990:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.370005:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.370018:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfd880 00000100:00100000:1.0:1787119517.373810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.373911:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633549568 00000100:00100000:2.0:1787119517.373922:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633549568 00010000:00010000:2.0:1787119517.373983:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.374028:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5219 00000100:00100000:2.0:1787119517.374038:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633549568:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119517.374054:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.374077:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.374113:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.374137:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3968 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471600f expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.374161:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 0) 00010000:00010000:2.0:1787119517.374166:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 0) 00010000:00010000:2.0:1787119517.374175:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.374185:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.374225:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.374239:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a123480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653575552:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119517.374332:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.375966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.376049:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633549696 00000100:00100000:2.0:1787119517.376058:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633549696 00000100:00100000:2.0:1787119517.376122:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5132 00000100:00100000:2.0:1787119517.376132:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633549696:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.376149:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.376169:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471601d expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.376198:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.376213:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 0) 00010000:00010000:2.0:1787119517.376217:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 0) 00010000:00010000:2.0:1787119517.376223:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 17 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.376256:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.376293:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 7 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.376308:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653575680:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119517.376389:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.380496:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a123480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653575552:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119517.380523:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119517.380565:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633549568:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6529us (6766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.380575:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5219 00000100:00100000:3.0:1787119517.383518:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653575680:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119517.383556:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.383579:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:3.0:1787119517.383650:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633549696:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7519us (7703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119517.383658:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5132 00000100:00100000:1.0:1787119517.385480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.385567:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633549824 00000100:00100000:2.0:1787119517.385575:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633549824 00010000:00010000:2.0:1787119517.385609:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 8 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.385639:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5220 00000100:00100000:2.0:1787119517.385648:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633549824:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119517.385664:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.385687:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 8 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.385711:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 8 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.385733:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e396f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716016 expref: 8 pid: 20843 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.385748:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 0) 00010000:00010000:2.0:1787119517.385753:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 0) 00010000:00010000:2.0:1787119517.385761:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.385769:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.385802:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.385817:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653575808:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119517.385898:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.389530:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653575808:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119517.389561:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119517.389621:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2373:x1873929633549824:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3973us (4189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.389633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5220 00000100:00100000:1.0:1787119517.398210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.398314:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633549952 00000100:00100000:2.0:1787119517.398324:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633549952 00000100:00100000:2.0:1787119517.398388:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5133 00000100:00100000:2.0:1787119517.398398:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+7:33957:x1873929633549952:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.398417:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.398436:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716024 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.398500:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.398509:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 0) 00010000:00010000:2.0:1787119517.398513:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 0) 00010000:00010000:2.0:1787119517.398519:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.398554:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.398579:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 15 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.398599:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653575936:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119517.398675:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.402533:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653575936:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119517.402577:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.402601:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119517.402671:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633549952:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4273us (4471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.402680:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5133 00000100:00100000:3.0:1787119517.403308:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.403405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.403565:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633550080 00000100:00100000:0.0:1787119517.403573:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633550080 00010000:00010000:0.0:1787119517.403608:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.403645:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5221 00000100:00100000:0.0:1787119517.403655:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633550080:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119517.403669:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119517.403691:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.403718:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.403742:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3976 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471601d expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.403758:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 0) 00010000:00010000:0.0:1787119517.403762:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 0) 00010000:00010000:0.0:1787119517.403771:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.403782:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.403821:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.403836:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653576064:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119517.403900:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc06000 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.403961:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633550208 00000100:00100000:2.0:1787119517.403966:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633550208 00000100:00100000:2.0:1787119517.404008:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5134 00000100:00100000:2.0:1787119517.404016:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633550208:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.404030:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.404042:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471602b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.404061:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.404068:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 0) 00010000:00010000:2.0:1787119517.404072:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 0) 00010000:00010000:2.0:1787119517.404076:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 17 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.404108:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.404124:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 7 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.404134:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653576192:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119517.404159:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.411767:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653576192:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119517.411816:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 17 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.411843:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:2.0:1787119517.411922:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633550208:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7905us (8515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.411932:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5134 00000100:00100000:0.0:1787119517.412004:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653576064:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119517.412024:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.412046:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633550080:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8392us (8741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.412056:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5221 00000100:00100000:1.0:1787119517.418013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.418168:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633550336 00000100:00100000:3.0:1787119517.418179:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633550336 00002000:00100000:3.0:1787119517.418233:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a63497a300 x1873929633550336/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.418244:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633550336 ext(40960->77823) 00010000:00010000:3.0:1787119517.418254:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.418287:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.418296:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63497a300 00000100:00100000:3.0:1787119517.418330:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1119 00000100:00100000:3.0:1787119517.418340:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633550336:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.421570:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633550336:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3219us (3554us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119517.421585:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1119 00002000:00100000:3.0:1787119517.421597:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a63497a300 x1873929633550336/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.421609:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633550336 ext(40960->77823) 00010000:00010000:3.0:1787119517.421619:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.421649:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.421659:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63497a300 00000100:00100000:3.0:1787119517.424357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.425821:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633550464 00000100:00100000:0.0:1787119517.425836:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633550464 00000100:00100000:0.0:1787119517.426041:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5135 00000100:00100000:0.0:1787119517.426053:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633550464:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.426071:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.426101:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716032 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.426132:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 0) 00010000:00010000:0.0:1787119517.426141:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.426148:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 0) 00010000:00010000:0.0:1787119517.426153:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.426192:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.426210:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.426229:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84c00, rc 0) 00000100:00100000:0.0:1787119517.426303:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633550464:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 253us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.426310:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5135 00000100:00100000:3.0:1787119517.427912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.428019:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633550592 00000100:00100000:1.0:1787119517.428027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633550592 00010000:00010000:1.0:1787119517.428064:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.428121:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5222 00000100:00100000:1.0:1787119517.428131:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2376:x1873929633550592:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119517.428146:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119517.428170:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.428198:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.428223:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e397d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716024 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.428241:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 0) 00010000:00010000:1.0:1787119517.428245:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 0) 00010000:00010000:1.0:1787119517.428255:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.428266:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.428305:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.428321:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 15 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.428336:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653576448:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.428411:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.436030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.436162:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653576448:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119517.436187:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119517.436258:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633550592:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8128us (8354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.436270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5222 00000100:00100000:3.0:1787119517.436661:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633550720 00000100:00100000:3.0:1787119517.436670:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633550720 00002000:00100000:3.0:1787119517.436713:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a6181aed80 x1873929633550720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.436725:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aed80 with x1873929633550720 ext(40960->45055) 00010000:00010000:3.0:1787119517.436735:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.436764:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.436774:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6181aed80 00000100:00100000:3.0:1787119517.436809:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1120 00000100:00100000:3.0:1787119517.436820:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633550720:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.436983:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633550720:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 165us (964us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119517.436990:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1120 00002000:00100000:3.0:1787119517.436996:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a6181aed80 x1873929633550720/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.437003:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aed80 with x1873929633550720 ext(40960->45055) 00010000:00010000:3.0:1787119517.437009:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.437022:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.437028:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6181aed80 00000100:00100000:1.0:1787119517.451664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.451758:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633550848 00000100:00100000:3.0:1787119517.451832:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633550848 00000100:00100000:3.0:1787119517.451893:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5136 00000100:00100000:3.0:1787119517.451903:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633550848:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119517.451920:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119517.451940:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716039 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.451975:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 0) 00010000:00010000:3.0:1787119517.451984:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.451990:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 0) 00010000:00010000:3.0:1787119517.451995:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 17 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.452036:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.452050:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 17 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.452062:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00000100:00100000:3.0:1787119517.452194:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633550848:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 293us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119517.452201:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5136 00000100:00100000:2.0:1787119517.453594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.453787:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633550976 00000100:00100000:0.0:1787119517.453795:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633550976 00010000:00010000:0.0:1787119517.453829:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 17 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.453865:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5223 00000100:00100000:0.0:1787119517.453875:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633550976:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119517.453889:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119517.453913:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 17 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.453938:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 17 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.453961:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3984 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471602b expref: 17 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.453978:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 0) 00010000:00010000:0.0:1787119517.453982:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 0) 00010000:00010000:0.0:1787119517.453992:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.454003:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.454039:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.454053:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 7 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.454066:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653576704:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119517.454247:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc06000 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.458157:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653576704:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119517.458198:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.458259:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633550976:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4386us (4671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.458271:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5223 00000100:00100000:2.0:1787119517.458527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.459112:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633551104 00000100:00100000:0.0:1787119517.459121:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633551104 00010000:00010000:0.0:1787119517.459156:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 8 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.459194:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5224 00000100:00100000:0.0:1787119517.459203:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633551104:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119517.459220:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119517.459245:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 8 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.459273:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 8 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.459297:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e398b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716032 expref: 8 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.459313:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 0) 00010000:00010000:0.0:1787119517.459318:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 0) 00010000:00010000:0.0:1787119517.459326:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.459336:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.459374:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.459389:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653576832:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119517.459482:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc06000 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.466912:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653576832:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119517.466941:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.467011:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2374:x1873929633551104:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7807us (8483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.467023:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5224 00000100:00100000:2.0:1787119517.470415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.470594:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633551232 00000100:00100000:0.0:1787119517.470604:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633551232 00000100:00100000:0.0:1787119517.470660:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5137 00000100:00100000:0.0:1787119517.470670:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+7:33957:x1873929633551232:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.470690:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.470710:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716040 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.470741:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.470751:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 0) 00010000:00010000:0.0:1787119517.470755:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 0) 00010000:00010000:0.0:1787119517.470760:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.470791:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.470815:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 15 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.470829:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653576960:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119517.470964:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc06000 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.486854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.487335:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633551360 00000100:00100000:0.0:1787119517.487347:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633551360 00002000:00100000:0.0:1787119517.487403:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a508ffe300 x1873929633551360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.487415:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633551360 ext(40960->45055) 00010000:00010000:0.0:1787119517.487424:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.487475:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.487484:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffe300 00000100:00100000:0.0:1787119517.487526:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1121 00000100:00100000:0.0:1787119517.487536:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633551360:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119517.487729:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633551360:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 194us (885us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119517.487736:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1121 00002000:00100000:0.0:1787119517.487743:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a508ffe300 x1873929633551360/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.487750:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633551360 ext(40960->45055) 00010000:00010000:0.0:1787119517.487755:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.487774:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.487780:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffe300 00000100:00100000:0.0:1787119517.497141:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653576960:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119517.497187:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.497209:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84c00, rc 0) 00000100:00100000:0.0:1787119517.497277:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633551232:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 26607us (26871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.497286:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5137 00000100:00100000:2.0:1787119517.500376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.500503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.500803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633551488 00000100:00100000:1.0:1787119517.500814:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633551488 00010000:00010000:1.0:1787119517.500855:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.500898:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5225 00000100:00100000:1.0:1787119517.500907:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2373:x1873929633551488:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119517.500923:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119517.500958:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.500994:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.501018:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3992 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716039 expref: 16 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.501034:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 0) 00010000:00010000:1.0:1787119517.501039:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 0) 00010000:00010000:1.0:1787119517.501048:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.501058:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.501114:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.501128:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653577088:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.501211:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.501891:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633551616 00000100:00100000:0.0:1787119517.501898:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633551616 00000100:00100000:0.0:1787119517.501943:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5138 00000100:00100000:0.0:1787119517.501961:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633551616:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.501977:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.501993:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716047 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.502015:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.502023:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 0) 00010000:00010000:0.0:1787119517.502027:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 0) 00010000:00010000:0.0:1787119517.502032:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 17 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.502057:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.502075:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 7 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.502314:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653577216:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119517.502380:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc06000 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.511152:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653577088:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.511179:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.511240:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633551488:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10332us (10874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.511251:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5225 00000100:00100000:0.0:1787119517.511609:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653577216:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119517.511644:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.511665:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85000, rc 0) 00000100:00100000:0.0:1787119517.511695:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633551616:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9745us (11192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.511703:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5138 00000100:00100000:2.0:1787119517.519571:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.519657:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633551744 00000100:00100000:3.0:1787119517.519667:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633551744 00002000:00100000:3.0:1787119517.519718:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a62a120700 x1873929633551744/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.519730:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120700 with x1873929633551744 ext(40960->77823) 00010000:00010000:3.0:1787119517.519739:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.519768:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.519777:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a120700 00000100:00100000:3.0:1787119517.519810:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1122 00000100:00100000:3.0:1787119517.519822:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633551744:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.527802:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633551744:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7971us (8230us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119517.527817:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1122 00002000:00100000:3.0:1787119517.527831:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a62a120700 x1873929633551744/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.527841:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120700 with x1873929633551744 ext(40960->77823) 00010000:00010000:3.0:1787119517.527852:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.527883:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.527891:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a120700 00000100:00100000:1.0:1787119517.531553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.531651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.531897:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633551872 00000100:00100000:0.0:1787119517.531907:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633551872 00000100:00100000:0.0:1787119517.531981:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5139 00000100:00100000:0.0:1787119517.531994:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633551872:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.532014:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.532036:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471604e expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.532071:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 0) 00010000:00010000:0.0:1787119517.532080:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.532098:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 0) 00010000:00010000:0.0:1787119517.532104:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.532144:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.532163:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.532177:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:0.0:1787119517.532237:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633551872:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 247us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.532244:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5139 00000100:00100000:2.0:1787119517.532410:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633552000 00000100:00100000:2.0:1787119517.532415:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633552000 00010000:00010000:2.0:1787119517.532473:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.532504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5226 00000100:00100000:2.0:1787119517.532511:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2376:x1873929633552000:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119517.532522:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.532544:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.532570:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.532588:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3999 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716040 expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.532600:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 0) 00010000:00010000:2.0:1787119517.532604:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 0) 00010000:00010000:2.0:1787119517.532612:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.532625:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.532650:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.532663:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 15 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.532677:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a126d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653577472:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119517.532730:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.542393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.542740:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633552128 00000100:00100000:3.0:1787119517.542751:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633552128 00010000:00010000:3.0:1787119517.542791:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.542846:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5227 00000100:00100000:3.0:1787119517.542856:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633552128:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119517.542871:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119517.542896:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.542923:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.542962:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 0) 00010000:00010000:3.0:1787119517.542968:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 0) 00010000:00010000:3.0:1787119517.542978:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 8 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.542989:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 8 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.543030:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 8 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.543045:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653577600:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119517.543144:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60617d780 going to sleep for 11 seconds 00010000:00010000:0.0:1787119517.543676:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716047 expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.543693:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a126d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653577472:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119517.543713:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.543760:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633552000:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11248us (12107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.543769:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5226 00000100:00100000:3.0:1787119517.546573:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653577600:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119517.546600:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119517.546655:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633552128:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3800us (4272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119517.546667:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5227 00000100:00100000:2.0:1787119517.551524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.551602:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633552256 00000100:00100000:0.0:1787119517.551611:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633552256 00000100:00100000:0.0:1787119517.551666:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5140 00000100:00100000:0.0:1787119517.551676:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633552256:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.551694:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.551711:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716055 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.551740:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.551750:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 0) 00010000:00010000:0.0:1787119517.551754:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 0) 00010000:00010000:0.0:1787119517.551759:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.551790:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.551813:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 7 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.551827:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653577728:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119517.551904:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc066c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.556938:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653577728:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119517.557044:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.557067:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85000, rc 0) 00000100:00100000:0.0:1787119517.557182:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633552256:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5507us (5667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.557191:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5140 00000100:00100000:2.0:1787119517.572073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.572156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.572284:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633552512 00000100:00100000:0.0:1787119517.572295:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633552512 00000100:00100000:0.0:1787119517.572358:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5141 00000100:00100000:0.0:1787119517.572367:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633552512:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.572387:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.572411:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471605c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.572463:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 0) 00010000:00010000:0.0:1787119517.572473:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.572480:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 0) 00010000:00010000:0.0:1787119517.572485:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.572525:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.572544:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.572557:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84c00, rc 0) 00000100:00100000:0.0:1787119517.572603:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633552512:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 238us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.572610:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5141 00000100:00100000:1.0:1787119517.572859:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633552384 00000100:00100000:1.0:1787119517.572864:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633552384 00010000:00010000:1.0:1787119517.572887:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 9 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.572924:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5228 00000100:00100000:1.0:1787119517.572933:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2376:x1873929633552384:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119517.572954:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119517.572979:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 9 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.573005:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 9 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.573028:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e39a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471604e expref: 9 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.573043:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 0) 00010000:00010000:1.0:1787119517.573047:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 0) 00010000:00010000:1.0:1787119517.573056:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.573066:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.573107:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.573123:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 15 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.573140:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653577984:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.573199:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.576865:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653577984:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.576891:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.576958:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633552384:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4018us (4888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.576970:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5228 00000100:00100000:3.0:1787119517.579526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.579666:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633552640 00000100:00100000:2.0:1787119517.579678:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633552640 00002000:00100000:2.0:1787119517.579730:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a519d1bb80 x1873929633552640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.579743:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1bb80 with x1873929633552640 ext(40960->45055) 00010000:00010000:2.0:1787119517.579752:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.579783:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119517.579792:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1bb80 00000100:00100000:2.0:1787119517.579828:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1123 00000100:00100000:2.0:1787119517.579838:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633552640:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119517.580054:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633552640:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 217us (537us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119517.580061:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1123 00002000:00100000:2.0:1787119517.580068:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a519d1bb80 x1873929633552640/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.580075:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1bb80 with x1873929633552640 ext(40960->45055) 00010000:00010000:2.0:1787119517.580080:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.580104:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119517.580112:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1bb80 00000100:00100000:2.0:1787119517.585299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.585345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.585491:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633552768 00000100:00100000:0.0:1787119517.585503:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633552768 00000100:00100000:0.0:1787119517.585553:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5142 00000100:00100000:0.0:1787119517.585563:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633552768:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.585580:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.585600:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716063 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.585631:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 0) 00010000:00010000:0.0:1787119517.585638:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.585646:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 0) 00010000:00010000:0.0:1787119517.585651:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 17 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.585692:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.585714:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 17 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.585726:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85800, rc 0) 00000100:00100000:0.0:1787119517.585781:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633552768:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 219us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.585788:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5142 00000100:00100000:1.0:1787119517.586299:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633552896 00000100:00100000:1.0:1787119517.586305:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633552896 00010000:00010000:1.0:1787119517.586330:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 17 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.586366:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5229 00000100:00100000:1.0:1787119517.586376:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633552896:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119517.586387:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119517.586410:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 17 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.586435:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 17 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.586490:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e39ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716055 expref: 17 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.586505:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 0) 00010000:00010000:1.0:1787119517.586509:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 0) 00010000:00010000:1.0:1787119517.586518:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.586536:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.586565:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.586580:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 7 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.586596:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653578240:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.586662:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.593403:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653578240:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.593433:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.593536:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633552896:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7160us (8188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.593548:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5229 00000100:00100000:0.0:1787119517.594582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.594658:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633553024 00000100:00100000:3.0:1787119517.594668:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633553024 00002000:00100000:3.0:1787119517.594713:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a62041fb80 x1873929633553024/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.594724:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041fb80 with x1873929633553024 ext(40960->77823) 00010000:00010000:3.0:1787119517.594733:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.594762:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.594770:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041fb80 00000100:00100000:3.0:1787119517.594800:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1124 00000100:00100000:3.0:1787119517.594811:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633553024:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.600379:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633553024:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5558us (5791us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119517.600395:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1124 00002000:00100000:1.0:1787119517.600409:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a62041fb80 x1873929633553024/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.600419:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041fb80 with x1873929633553024 ext(40960->77823) 00010000:00010000:1.0:1787119517.600430:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.600496:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 8 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119517.600505:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041fb80 00000100:00100000:3.0:1787119517.602807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.602958:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633553152 00000100:00100000:2.0:1787119517.602969:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633553152 00000100:00100000:2.0:1787119517.603206:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5143 00000100:00100000:2.0:1787119517.603215:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633553152:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.603233:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.603252:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471606a expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.603295:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 0) 00010000:00010000:2.0:1787119517.603304:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.603311:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 0) 00010000:00010000:2.0:1787119517.603317:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.603360:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.603375:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.603388:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119517.603476:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633553152:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 260us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.603484:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5143 00000100:00100000:2.0:1787119517.605884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.609178:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633553280 00000100:00100000:3.0:1787119517.609193:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633553280 00010000:00010000:2.0:1787119517.609429:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.609530:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5230 00000100:00100000:2.0:1787119517.609541:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2376:x1873929633553280:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119517.609559:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.609586:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.609615:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.609641:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e39b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471605c expref: 9 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.609662:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 0) 00010000:00010000:2.0:1787119517.609667:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 0) 00010000:00010000:2.0:1787119517.609677:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.609688:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.609729:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.609745:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 15 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.609759:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653578496:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119517.609856:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.615304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.615376:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653578496:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119517.615403:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119517.615491:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633553280:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5951us (9616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.615502:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5230 00000100:00100000:2.0:1787119517.622368:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633553408 00000100:00100000:2.0:1787119517.622389:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633553408 00010000:00010000:2.0:1787119517.624126:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.624181:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5231 00000100:00100000:2.0:1787119517.624199:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633553408:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119517.624216:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.624243:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.624269:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.624296:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e39bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716063 expref: 16 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.624314:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 0) 00010000:00010000:2.0:1787119517.624319:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 0) 00010000:00010000:2.0:1787119517.624328:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.624339:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.624383:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.624398:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653578624:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119517.624505:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.635053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.635166:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633553536 00000100:00100000:1.0:1787119517.635176:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633553536 00000100:00100000:1.0:1787119517.635232:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5144 00000100:00100000:1.0:1787119517.635243:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633553536:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.635261:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.635282:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716071 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.635316:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.635326:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 0) 00010000:00010000:1.0:1787119517.635330:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 0) 00010000:00010000:1.0:1787119517.635336:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.635375:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.635402:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 7 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.635419:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653578752:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119517.635529:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.640401:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653578752:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119517.640463:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.640487:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119517.640545:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633553536:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5304us (5502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.640554:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5144 00000100:00100000:0.0:1787119517.640556:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653578624:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119517.640567:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.640591:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633553408:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 16402us (25300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.640600:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5231 00000100:00100000:3.0:1787119517.640916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.640971:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633553664 00000100:00100000:1.0:1787119517.640987:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633553664 00010000:00010000:1.0:1787119517.641018:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 8 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.641053:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5232 00000100:00100000:1.0:1787119517.641062:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633553664:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119517.641076:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119517.641108:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 8 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.641132:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 8 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.641162:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e39c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471606a expref: 8 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.641179:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 0) 00010000:00010000:1.0:1787119517.641184:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 0) 00010000:00010000:1.0:1787119517.641192:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.641203:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.641240:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.641255:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653578880:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.641329:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.646690:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.646908:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633553792 00000100:00100000:3.0:1787119517.646917:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633553792 00002000:00100000:3.0:1787119517.646980:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a62041c000 x1873929633553792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.646992:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041c000 with x1873929633553792 ext(40960->45055) 00002000:00010000:3.0:1787119517.646998:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041c000 00000100:00100000:3.0:1787119517.647037:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10589 00000100:00100000:3.0:1787119517.647046:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633553792:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.647423:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633553792:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 376us (742us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119517.647431:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10589 00002000:00100000:3.0:1787119517.647474:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a62041c000 x1873929633553792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.647483:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041c000 with x1873929633553792 ext(40960->45055) 00002000:00010000:3.0:1787119517.647487:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041c000 00000100:00100000:1.0:1787119517.648993:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653578880:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.649022:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.649107:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2376:x1873929633553664:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8045us (8190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.649117:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5232 00000100:00100000:0.0:1787119517.650751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.650848:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633554048 00000100:00100000:2.0:1787119517.650858:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633554048 00000100:00100000:2.0:1787119517.650916:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5145 00000100:00100000:2.0:1787119517.650925:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+7:33957:x1873929633554048:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.650945:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.650971:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716078 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.651007:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.651018:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 0) 00010000:00010000:2.0:1787119517.651022:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 0) 00010000:00010000:2.0:1787119517.651028:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 8 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.651070:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.651109:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 15 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.651126:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653579008:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119517.651214:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119517.651566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.652028:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633553920 00000100:00100000:2.0:1787119517.652034:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633553920 00002000:00100000:2.0:1787119517.652070:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (45056->49151) req@ffff92a519d19880 x1873929633553920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.652081:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19880 with x1873929633553920 ext(45056->49151) 00010000:00010000:2.0:1787119517.652106:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.652126:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119517.652133:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d19880 00000100:00100000:2.0:1787119517.652163:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1125 00000100:00100000:2.0:1787119517.652172:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633553920:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119517.652486:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633553920:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 313us (919us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119517.652495:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1125 00002000:00100000:2.0:1787119517.652502:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (45056->49151) req@ffff92a519d19880 x1873929633553920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.652510:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19880 with x1873929633553920 ext(45056->49151) 00010000:00010000:2.0:1787119517.652516:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.652531:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119517.652538:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d19880 00000100:00100000:3.0:1787119517.662783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.663297:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653579008:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119517.663339:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 8 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.663361:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:0.0:1787119517.663421:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633554048:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 12497us (12677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.663433:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5145 00000100:00100000:2.0:1787119517.663555:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633554176 00000100:00100000:2.0:1787119517.663562:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633554176 00002000:00100000:2.0:1787119517.663603:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a519d1b800 x1873929633554176/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 4584/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.663613:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b800 with x1873929633554176 ext(40960->45055) 00010000:00010000:2.0:1787119517.663621:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.663650:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 16 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119517.663659:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1b800 00000100:00100000:2.0:1787119517.663694:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1126 00000100:00100000:2.0:1787119517.663704:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633554176:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119517.664201:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633554176:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 498us (1428us total) trans 4294969221 rc 0/0 00000100:00100000:2.0:1787119517.664209:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1126 00002000:00100000:2.0:1787119517.664217:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a519d1b800 x1873929633554176/t4294969221(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 4584/448 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.664225:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b800 with x1873929633554176 ext(40960->45055) 00010000:00010000:2.0:1787119517.664230:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 18 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.664247:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 18 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119517.664254:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1b800 00010000:00010000:3.0:1787119517.665541:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119517.677064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.677125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.677219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633554432 00000100:00100000:3.0:1787119517.677230:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633554432 00010000:00010000:3.0:1787119517.677273:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 18 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.677320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5233 00000100:00100000:3.0:1787119517.677329:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633554432:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119517.677345:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787119517.677364:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119515 -> 1787119516 00002000:00010000:3.0:1787119517.677367:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119515 -> 1787119516 00010000:00010000:3.0:1787119517.677373:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 18 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.677398:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 18 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.677422:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e39ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716071 expref: 18 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.677486:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 0) 00010000:00010000:3.0:1787119517.677491:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 0) 00010000:00010000:3.0:1787119517.677500:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 7 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.677511:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 7 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.677550:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 7 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.677565:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653579136:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119517.677639:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60617da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.678167:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633554304 00000100:00100000:2.0:1787119517.678172:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633554304 00000100:00100000:2.0:1787119517.678219:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5146 00000100:00100000:2.0:1787119517.678227:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633554304:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.678241:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.678255:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471607f expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.678278:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 7 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.678292:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 0) 00010000:00010000:2.0:1787119517.678295:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 0) 00010000:00010000:2.0:1787119517.678300:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 19 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.678324:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 7 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.678342:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 7 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.678354:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653579264:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119517.678401:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a602badf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119517.681006:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653579136:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119517.681034:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119517.681101:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633554432:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3771us (3974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119517.681112:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5233 00000100:00100000:2.0:1787119517.681643:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653579264:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119517.681674:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.681697:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119517.681738:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633554304:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3512us (4684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.681747:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5146 00000100:00100000:0.0:1787119517.682494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.682579:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633554560 00000100:00100000:1.0:1787119517.682589:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633554560 00002000:00100000:1.0:1787119517.682643:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a62041f800 x1873929633554560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.682654:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f800 with x1873929633554560 ext(40960->77823) 00010000:00010000:1.0:1787119517.682663:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 8 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.682696:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 8 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119517.682705:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041f800 00000100:00100000:1.0:1787119517.682740:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1127 00000100:00100000:1.0:1787119517.682749:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633554560:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.686666:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633554560:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3907us (4165us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119517.686680:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1127 00002000:00100000:1.0:1787119517.686693:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (40960->77823) req@ffff92a62041f800 x1873929633554560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.686703:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f800 with x1873929633554560 ext(40960->77823) 00010000:00010000:1.0:1787119517.686714:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 8 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.686743:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 8 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119517.686752:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041f800 00000100:00100000:3.0:1787119517.689750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.689860:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633554688 00000100:00100000:0.0:1787119517.689871:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633554688 00000100:00100000:0.0:1787119517.689936:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5147 00000100:00100000:0.0:1787119517.689946:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633554688:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.689965:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.689984:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716086 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690014:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 0) 00010000:00010000:0.0:1787119517.690019:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 0) 00010000:00010000:0.0:1787119517.690024:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 9 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690037:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 9 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690050:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84000, rc 0) 00000100:00100000:0.0:1787119517.690120:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633554688:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 176us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.690127:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5147 00000100:00100000:2.0:1787119517.690530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.690605:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633554816 00000100:00100000:0.0:1787119517.690610:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633554816 00010000:00010000:0.0:1787119517.690631:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 9 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.690663:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5234 00000100:00100000:0.0:1787119517.690671:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2376:x1873929633554816:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119517.690683:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119517.690704:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 9 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690729:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 9 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690750:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716078 expref: 9 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690765:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 0) 00010000:00010000:0.0:1787119517.690769:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 0) 00010000:00010000:0.0:1787119517.690778:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690788:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690798:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 0) 00010000:00010000:0.0:1787119517.690801:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 0) 00010000:00010000:0.0:1787119517.690805:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 8 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690814:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 8 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.690845:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 8 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.690861:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653579392:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119517.690942:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.690953:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653579520:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119517.690979:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc066c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.692739:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653579392:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119517.693848:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653579520:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119517.693881:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.693942:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633554816:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3271us (3412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.693955:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5234 00000100:00100000:3.0:1787119517.707361:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.707409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.709131:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633554944 00000100:00100000:0.0:1787119517.709146:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633554944 00002000:00100000:1.0:1787119517.710720:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (45056->49151) req@ffff92a519d1b480 x1873929633554944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.710733:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b480 with x1873929633554944 ext(45056->49151) 00002000:00010000:1.0:1787119517.710740:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b480 00000100:00100000:1.0:1787119517.710825:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633555072 00000100:00100000:1.0:1787119517.710831:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633555072 00002000:00100000:1.0:1787119517.710849:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a519d18a80 x1873929633555072/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.710858:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18a80 with x1873929633555072 ext(40960->45055) 00002000:00010000:1.0:1787119517.710862:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18a80 00000100:00100000:1.0:1787119517.710892:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10590 00000100:00100000:1.0:1787119517.710902:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633554944:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.712245:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2374:x1873929633554944:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1338us (4888us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119517.712256:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10590 00002000:00100000:1.0:1787119517.712264:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (45056->49151) req@ffff92a519d1b480 x1873929633554944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.712275:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b480 with x1873929633554944 ext(45056->49151) 00002000:00010000:1.0:1787119517.712279:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b480 00000100:00100000:1.0:1787119517.712305:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10591 00000100:00100000:1.0:1787119517.712315:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633555072:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119517.712391:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633555072:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 78us (4981us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119517.712400:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10591 00002000:00100000:1.0:1787119517.712406:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (40960->45055) req@ffff92a519d18a80 x1873929633555072/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.712414:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18a80 with x1873929633555072 ext(40960->45055) 00002000:00010000:1.0:1787119517.712418:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18a80 00000100:00100000:3.0:1787119517.723117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.723549:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633555200 00000100:00100000:1.0:1787119517.723559:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633555200 00000100:00100000:1.0:1787119517.723627:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5148 00000100:00100000:1.0:1787119517.723637:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33957:x1873929633555200:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.723656:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.723675:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471608d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.723710:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.723720:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 0) 00010000:00010000:1.0:1787119517.723724:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 0) 00010000:00010000:1.0:1787119517.723729:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.723764:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.723789:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 17 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.723806:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653579648:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119517.723895:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.728502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.728587:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633555328 00000100:00100000:3.0:1787119517.728598:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633555328 00002000:00100000:3.0:1787119517.728648:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a512845f80 x1873929633555328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.728660:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845f80 with x1873929633555328 ext(49152->53247) 00010000:00010000:3.0:1787119517.728669:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 18 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.728699:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 18 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.728708:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845f80 00000100:00100000:3.0:1787119517.728743:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1128 00000100:00100000:3.0:1787119517.728753:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633555328:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.728945:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633555328:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 193us (453us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119517.728966:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1128 00002000:00100000:3.0:1787119517.728973:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a512845f80 x1873929633555328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.728989:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845f80 with x1873929633555328 ext(49152->53247) 00010000:00010000:3.0:1787119517.728995:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 18 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.729010:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 18 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.729017:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845f80 00000100:00100000:1.0:1787119517.734785:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653579648:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119517.734826:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.734850:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431800, rc 0) 00000100:00100000:1.0:1787119517.734913:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633555200:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11276us (11833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.734923:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5148 00000100:00100000:3.0:1787119517.735540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.735584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.735845:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633555456 00000100:00100000:1.0:1787119517.735853:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633555456 00002000:00100000:1.0:1787119517.735895:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (45056->49151) req@ffff92a519d1a300 x1873929633555456/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 4584/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.735906:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a300 with x1873929633555456 ext(45056->49151) 00010000:00010000:1.0:1787119517.735913:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 18 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.735942:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 18 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119517.735963:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1a300 00000100:00100000:1.0:1787119517.735993:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1129 00000100:00100000:1.0:1787119517.736002:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633555456:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119517.736385:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633555456:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 382us (798us total) trans 4294969222 rc 0/0 00000100:00100000:1.0:1787119517.736393:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1129 00002000:00100000:1.0:1787119517.736399:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (45056->49151) req@ffff92a519d1a300 x1873929633555456/t4294969222(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 4584/448 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.736408:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a300 with x1873929633555456 ext(45056->49151) 00010000:00010000:1.0:1787119517.736414:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 20 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.736429:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 20 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119517.736467:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1a300 00000100:00100000:2.0:1787119517.736684:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633555584 00000100:00100000:2.0:1787119517.736690:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633555584 00000100:00100000:2.0:1787119517.736729:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5149 00000100:00100000:2.0:1787119517.736737:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633555584:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.736748:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.736764:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716094 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.736787:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 0) 00010000:00010000:2.0:1787119517.736793:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 0) 00010000:00010000:2.0:1787119517.736799:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.736812:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.736824:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:2.0:1787119517.736848:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:33946:x1873929633555584:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 112us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.736855:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5149 00000100:00100000:3.0:1787119517.740304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.740418:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633555712 00000100:00100000:1.0:1787119517.740429:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633555712 00010000:00010000:1.0:1787119517.740553:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 21 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.740595:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5235 00000100:00100000:1.0:1787119517.740604:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633555712:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119517.740619:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119517.740640:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 21 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.740673:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 21 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.740700:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e39d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [45056->18446744073709551615] (req 45056->49151) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471607f expref: 21 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.740719:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 0) 00010000:00010000:1.0:1787119517.740723:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 0) 00010000:00010000:1.0:1787119517.740731:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.740741:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.740750:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 0) 00010000:00010000:1.0:1787119517.740752:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 0) 00010000:00010000:1.0:1787119517.740757:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.740766:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.740800:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.740820:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653579776:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.741012:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.741022:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653579904:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.741046:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.748668:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653579776:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.748688:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653579904:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.748712:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.748776:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2374:x1873929633555712:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8171us (8482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.748788:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5235 00000100:00100000:3.0:1787119517.757125:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.757413:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633555840 00000100:00100000:2.0:1787119517.757425:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633555840 00002000:00100000:2.0:1787119517.757522:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (45056->49151) req@ffff92a519d18380 x1873929633555840/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.757533:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633555840 ext(45056->49151) 00002000:00010000:2.0:1787119517.757540:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18380 00000100:00100000:2.0:1787119517.757576:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10592 00000100:00100000:2.0:1787119517.757585:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2375:x1873929633555840:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119517.757781:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2375:x1873929633555840:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 196us (668us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119517.757788:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10592 00002000:00100000:2.0:1787119517.757794:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (45056->49151) req@ffff92a519d18380 x1873929633555840/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.757803:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633555840 ext(45056->49151) 00002000:00010000:2.0:1787119517.757806:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18380 00000100:00100000:3.0:1787119517.760787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.760893:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633555968 00000100:00100000:2.0:1787119517.760903:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633555968 00000100:00100000:2.0:1787119517.760971:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5150 00000100:00100000:2.0:1787119517.760981:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633555968:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.760998:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.761015:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471609b expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.761046:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.761056:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 0) 00010000:00010000:2.0:1787119517.761060:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 0) 00010000:00010000:2.0:1787119517.761066:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 10 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.761125:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.761151:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 19 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.761166:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653580032:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119517.761247:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a602badf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.764802:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653580032:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119517.764842:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 10 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.764867:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93000, rc 0) 00000100:00100000:2.0:1787119517.764934:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633555968:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3952us (4157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.764944:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5150 00000100:00100000:3.0:1787119517.769969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.770383:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633556096 00000100:00100000:2.0:1787119517.770394:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633556096 00002000:00100000:2.0:1787119517.770477:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a519d18e00 x1873929633556096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.770488:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18e00 with x1873929633556096 ext(49152->53247) 00010000:00010000:2.0:1787119517.770498:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.770530:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119517.770538:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d18e00 00000100:00100000:2.0:1787119517.770561:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1130 00000100:00100000:2.0:1787119517.770570:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633556096:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119517.770776:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633556096:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 205us (817us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119517.770783:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1130 00002000:00100000:2.0:1787119517.770790:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a519d18e00 x1873929633556096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119517.770799:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18e00 with x1873929633556096 ext(49152->53247) 00010000:00010000:2.0:1787119517.770804:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.770818:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119517.770825:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d18e00 00000100:00100000:3.0:1787119517.785242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.785558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633556224 00000100:00100000:0.0:1787119517.785568:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633556224 00010000:00010000:0.0:1787119517.785613:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.785667:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5236 00000100:00100000:0.0:1787119517.785677:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633556224:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119517.785692:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119517.785718:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.785744:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.785769:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e39ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716094 expref: 20 pid: 12469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.785787:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 0) 00010000:00010000:0.0:1787119517.785793:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 0) 00010000:00010000:0.0:1787119517.785802:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.785813:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.785854:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.785869:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653580160:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.799223:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.800225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.801048:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633556352 00000100:00100000:0.0:1787119517.801060:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633556352 00000100:00100000:0.0:1787119517.801133:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5151 00000100:00100000:0.0:1787119517.801142:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633556352:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.801162:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.801182:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160a2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.801213:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.801223:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 0) 00010000:00010000:0.0:1787119517.801227:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 0) 00010000:00010000:0.0:1787119517.801232:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 21 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.801264:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.801302:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 9 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.801317:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653580288:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119517.801386:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.807490:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653580160:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.807525:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.807586:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2376:x1873929633556224:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 21909us (22353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.807599:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5236 00000100:00100000:0.0:1787119517.811000:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653580288:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119517.811048:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 20 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.811072:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:0.0:1787119517.811149:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633556352:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10007us (10929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.811158:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5151 00000100:00100000:2.0:1787119517.816238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.816335:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633556480 00000100:00100000:3.0:1787119517.816347:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633556480 00002000:00100000:3.0:1787119517.816396:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a512847b80 x1873929633556480/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.816407:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847b80 with x1873929633556480 ext(49152->86015) 00010000:00010000:3.0:1787119517.816417:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 10 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.816492:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 10 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.816507:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512847b80 00000100:00100000:3.0:1787119517.816530:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1131 00000100:00100000:3.0:1787119517.816541:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2376:x1873929633556480:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119517.820412:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2376:x1873929633556480:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3861us (4174us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119517.820427:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1131 00002000:00100000:0.0:1787119517.820463:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a512847b80 x1873929633556480/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.820474:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847b80 with x1873929633556480 ext(49152->86015) 00010000:00010000:0.0:1787119517.820485:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 10 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.820515:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 10 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.820523:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512847b80 00000100:00100000:3.0:1787119517.831732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.831780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.831866:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633556608 00000100:00100000:1.0:1787119517.831876:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633556608 00000100:00100000:1.0:1787119517.831932:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5152 00000100:00100000:1.0:1787119517.831942:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633556608:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.831971:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.831990:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160a9 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.832026:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 0) 00010000:00010000:1.0:1787119517.832035:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.832043:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 0) 00010000:00010000:1.0:1787119517.832049:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.832111:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.832126:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.832140:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430400, rc 0) 00000100:00100000:1.0:1787119517.832210:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+11:33957:x1873929633556608:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 269us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.832217:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5152 00000100:00100000:0.0:1787119517.833123:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633556736 00000100:00100000:0.0:1787119517.833132:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633556736 00010000:00010000:0.0:1787119517.833166:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 11 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.833215:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5237 00000100:00100000:0.0:1787119517.833224:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+11:2374:x1873929633556736:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119517.833238:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119517.833260:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 11 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.833298:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 11 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.833321:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e39f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471609b expref: 11 pid: 20841 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.833335:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 0) 00010000:00010000:0.0:1787119517.833340:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 0) 00010000:00010000:0.0:1787119517.833348:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.833358:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.833389:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.833403:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 19 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.833416:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653580544:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119517.833545:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.836494:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653580544:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119517.836523:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.836580:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2374:x1873929633556736:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3355us (4797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.836592:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5237 00000100:00100000:3.0:1787119517.838663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.841551:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633556864 00000100:00100000:1.0:1787119517.841569:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633556864 00010000:00010000:1.0:1787119517.841626:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 20 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.841807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5238 00000100:00100000:1.0:1787119517.841818:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633556864:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119517.841833:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119517.841857:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 20 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.841883:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 20 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.841906:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e39fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a2 expref: 20 pid: 6696 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.841925:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 0) 00010000:00010000:1.0:1787119517.841930:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 0) 00010000:00010000:1.0:1787119517.841939:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.841960:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.842000:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.842015:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653580672:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.847696:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119517.855228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.855851:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653580672:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.855876:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.855954:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633556864:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 14129us (17292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.855968:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5238 00000100:00100000:3.0:1787119517.856637:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633556992 00000100:00100000:3.0:1787119517.856648:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633556992 00000100:00100000:3.0:1787119517.856703:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5153 00000100:00100000:3.0:1787119517.856714:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633556992:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119517.856732:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119517.856752:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160b0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.856784:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.856794:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 0) 00010000:00010000:3.0:1787119517.856799:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 0) 00010000:00010000:3.0:1787119517.856804:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.856838:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.856869:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 9 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.856884:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653580800:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119517.857130:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60617d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.869750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.869791:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633557120 00000100:00100000:1.0:1787119517.869801:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633557120 00002000:00100000:1.0:1787119517.869849:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a508ffd180 x1873929633557120/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.869861:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd180 with x1873929633557120 ext(49152->86015) 00010000:00010000:1.0:1787119517.869871:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 10 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.869901:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 10 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119517.869909:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffd180 00000100:00100000:1.0:1787119517.869932:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1132 00000100:00100000:1.0:1787119517.873299:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633557120:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.886639:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653580800:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119517.886676:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.886698:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0800, rc 0) 00000100:00100000:3.0:1787119517.886748:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633556992:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 30035us (31532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119517.886757:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5153 00000100:00100000:1.0:1787119517.888640:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633557120:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 18690us (18892us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119517.888654:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1132 00002000:00100000:1.0:1787119517.888667:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a508ffd180 x1873929633557120/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119517.888679:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd180 with x1873929633557120 ext(49152->86015) 00010000:00010000:1.0:1787119517.888688:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 10 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.888719:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 10 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119517.888728:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffd180 00000100:00100000:3.0:1787119517.897030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.899722:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633557248 00000100:00100000:2.0:1787119517.899738:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633557248 00000100:00100000:2.0:1787119517.900116:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5154 00000100:00100000:2.0:1787119517.900130:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633557248:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119517.900163:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119517.900182:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160b7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.900214:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 0) 00010000:00010000:2.0:1787119517.900225:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 19 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.900233:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 0) 00010000:00010000:2.0:1787119517.900239:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.900282:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 19 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.900298:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.900310:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119517.900371:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+11:33957:x1873929633557248:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 245us (3350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.900378:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5154 00000100:00100000:3.0:1787119517.900917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.901340:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633557376 00000100:00100000:2.0:1787119517.901349:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633557376 00010000:00010000:2.0:1787119517.901377:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 11 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.901407:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5239 00000100:00100000:2.0:1787119517.901415:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+11:2376:x1873929633557376:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119517.901427:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.901469:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 11 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.901493:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 11 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.901516:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3a02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160a9 expref: 11 pid: 6693 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.901533:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 0) 00010000:00010000:2.0:1787119517.901537:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 0) 00010000:00010000:2.0:1787119517.901545:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 19 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.901554:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 19 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.901587:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 19 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.901608:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 19 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.901625:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653581056:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119517.901700:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.911578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.911957:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633557504 00000100:00100000:0.0:1787119517.911969:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633557504 00002000:00100000:0.0:1787119517.912019:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a508ffdc00 x1873929633557504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.912030:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdc00 with x1873929633557504 ext(49152->53247) 00010000:00010000:0.0:1787119517.912041:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 20 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.912070:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 20 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.912089:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffdc00 00000100:00100000:0.0:1787119517.912126:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1133 00000100:00100000:0.0:1787119517.912137:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633557504:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119517.912431:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633557504:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 294us (863us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119517.912456:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1133 00002000:00100000:0.0:1787119517.912464:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a508ffdc00 x1873929633557504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:553/0 lens 488/4536 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119517.912473:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdc00 with x1873929633557504 ext(49152->53247) 00010000:00010000:0.0:1787119517.912479:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 20 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.912492:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 20 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119517.912499:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffdc00 00000100:00100000:3.0:1787119517.913199:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653581056:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119517.913226:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.913334:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2376:x1873929633557376:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11917us (12417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.913346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5239 00000100:00100000:1.0:1787119517.921428:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.921500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.921545:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633557632 00000100:00100000:1.0:1787119517.921557:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633557632 00000100:00100000:1.0:1787119517.921606:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5155 00000100:00100000:1.0:1787119517.921627:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633557632:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.921648:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.921669:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160be expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.921705:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 0) 00010000:00010000:1.0:1787119517.921714:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.921721:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 0) 00010000:00010000:1.0:1787119517.921727:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 21 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.921768:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.921783:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 21 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.921795:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119517.921851:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:33946:x1873929633557632:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 225us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.921858:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5155 00000100:00100000:1.0:1787119517.921883:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633557760 00000100:00100000:1.0:1787119517.921886:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633557760 00010000:00010000:1.0:1787119517.921902:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 21 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.921923:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5240 00000100:00100000:1.0:1787119517.921929:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2373:x1873929633557760:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119517.921937:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119517.921965:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 21 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.921990:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 21 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.922015:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3a09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b0 expref: 21 pid: 8267 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.922030:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 0) 00010000:00010000:1.0:1787119517.922034:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 0) 00010000:00010000:1.0:1787119517.922044:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.922053:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.922086:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.922101:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 9 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.922114:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508fffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653581312:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119517.922167:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119517.931008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.931045:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633557888 00000100:00100000:3.0:1787119517.931054:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633557888 00010000:00010000:3.0:1787119517.931099:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 10 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.931135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5241 00000100:00100000:3.0:1787119517.931145:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2376:x1873929633557888:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119517.931160:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119517.931180:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 10 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.931204:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 10 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.931232:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=1s v=(41 0) 00010000:00010000:3.0:1787119517.931237:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 41) 00010000:00010000:3.0:1787119517.931245:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 20 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.931256:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 20 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.931293:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 20 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.931308:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653581440:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119517.931386:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787119517.931830:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3a10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160b7 expref: 10 pid: 6695 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.931846:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508fffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653581312:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.931867:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.931898:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2373:x1873929633557760:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9969us (10398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.931907:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5240 00000001:00080000:3.0:1787119517.934974:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968929 is committed 00000001:00080000:3.0:1787119517.934990:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968928 is committed 00000100:00100000:2.0:1787119517.940660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.940924:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633558016 00000100:00100000:0.0:1787119517.940935:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633558016 00000100:00100000:0.0:1787119517.941009:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5156 00000100:00100000:0.0:1787119517.941020:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633558016:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119517.941039:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119517.941060:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160c5 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.941111:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.941128:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 41) 00010000:00010000:0.0:1787119517.941132:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 41) 00010000:00010000:0.0:1787119517.941138:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.941171:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.941197:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 19 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.941212:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653581568:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119517.941607:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.943298:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653581440:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119517.943335:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119517.943391:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+11:2376:x1873929633557888:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12235us (12874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119517.943402:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5241 00000001:00080000:2.0:1787119517.953493:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976608 is committed 00000001:00080000:2.0:1787119517.953510:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976604 is committed 00000004:00080000:2.0:1787119517.953515:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000004:00080000:2.0:1787119517.953530:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 22 committed 00000001:00080000:2.0:1787119517.953559:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976607 is committed 00000100:00100000:1.0:1787119517.953858:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787119517.953876:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653581824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787119517.953931:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119517.954015:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787119517.954025:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653581696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787119517.954060:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119517.954136:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653581568:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119517.954167:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 10 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.954187:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:0.0:1787119517.954231:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633558016:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13213us (13582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.954243:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5156 00000100:00100000:0.0:1787119517.954266:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653581824 00000100:00100000:0.0:1787119517.954273:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653581824 00000100:00100000:0.0:1787119517.954306:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653581696 00000100:00100000:0.0:1787119517.954309:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653581696 00000100:00100000:0.0:1787119517.954330:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5157 00000100:00100000:0.0:1787119517.954337:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653581824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787119517.954359:0:12469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:42 count 1 00010000:00010000:0.0:1787119517.954380:0:12469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.954394:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f6e expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.954401:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787119517.954406:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787119517.954409:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.954432:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f6e expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.954468:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f6e expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.954480:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653581952:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119517.954519:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119517.954536:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5158 00000100:00100000:0.0:1787119517.954543:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653581696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787119517.954556:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:44 count 1 00010000:00010000:0.0:1787119517.954571:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.954583:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f9f expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.954590:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787119517.954594:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787119517.954597:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.954616:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f9f expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.954625:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f9f expref: 7 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.954636:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1873929653582080:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119517.954660:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462e40 going to sleep for 11 seconds 00000100:00080000:2.0:1787119517.954830:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787119517.954834:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119517.955049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119517.955324:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633558144 00000100:00100000:0.0:1787119517.955329:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633558144 00010000:00010000:0.0:1787119517.955353:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 20 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.955394:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5242 00000100:00100000:0.0:1787119517.955402:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633558144:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119517.955413:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119517.955430:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 20 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.955569:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 20 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.955593:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3a17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160be expref: 20 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.955608:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 41) 00010000:00010000:0.0:1787119517.955612:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 41) 00010000:00010000:0.0:1787119517.955619:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 9 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.955629:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 9 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.955659:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 9 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119517.955671:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653582208:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119517.955726:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.960598:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1873929653582080:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119517.960643:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119517.960692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.960730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.960925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633558272 00000100:00100000:3.0:1787119517.960934:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633558272 00000100:00100000:2.0:1787119517.960937:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633558400 00000100:00100000:2.0:1787119517.960944:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633558400 00010000:00010000:3.0:1787119517.960984:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f6e expref: 20 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.960984:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f9f expref: 8 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.961042:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5243 00000100:00100000:3.0:1787119517.961054:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633558272:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119517.961068:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787119517.961068:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653581952:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119517.961087:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f6e expref: 20 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.961097:0:12469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.961218:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f6e expref: 20 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119517.961270:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5244 00000100:00100000:2.0:1787119517.961280:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633558400:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119517.961291:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119517.961296:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f9f expref: 8 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.961312:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f9f expref: 8 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.961338:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000574fc608/0xcaba3de8463e385e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f9f expref: 8 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.961354:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787119517.961359:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787119517.961364:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.961374:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.961398:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119517.961472:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633558400:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 193us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.961480:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5244 00010000:00010000:3.0:1787119517.964471:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e37bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.59@tcp remote: 0xa889273204715f6e expref: 20 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.964497:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787119517.964502:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787119517.964509:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.964520:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.964562:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119517.964615:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653582208:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119517.964626:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633558272:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3571us (3931us total) trans 0 rc 0/0 00010000:00010000:0.0:1787119517.964635:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119517.964641:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5243 00000100:00100000:0.0:1787119517.964662:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633558144:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9259us (9612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119517.964670:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5242 00010000:00010000:2.0:1787119517.964736:0:12469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.964748:0:12469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.964758:0:12469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.964767:0:12469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.964795:0:12469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787119517.965404:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653581824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11065us (11471us total) trans 4294969223 rc 0/0 00000100:00100000:2.0:1787119517.965414:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5157 00010000:00010000:0.0:1787119517.965572:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787119517.965580:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.965590:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d84e00 already unused, calling callback (ffffffffc163d010) 00010000:00010000:0.0:1787119517.965594:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.965603:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.965618:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.965625:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3a25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.965650:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119517.965652:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119517.965654:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119517.966523:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.966539:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.966549:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.966557:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119517.966584:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787119517.967095:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92a508fffb80/2, rc 0, transno 4294969223 00000100:00100000:3.0:1787119517.967105:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653581824:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787119517.967232:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787119517.967240:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.967250:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d85a00 already unused, calling callback (ffffffffc163d010) 00010000:00010000:2.0:1787119517.967254:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.967262:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.967281:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.967288:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363af705/0xcaba3de8463e3a2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.967308:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119517.967310:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119517.967311:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119517.967518:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1873929653581696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12974us (13455us total) trans 4294968930 rc 0/0 00000100:00100000:0.0:1787119517.967528:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5158 00000004:00080000:3.0:1787119517.967854:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92a511f57800/2, rc 0, transno 4294968930 00000100:00100000:3.0:1787119517.967862:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653581696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787119517.971858:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119517.971988:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633558656 00000100:00100000:3.0:1787119517.971999:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633558656 00000100:00100000:3.0:1787119517.972075:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5159 00000100:00100000:3.0:1787119517.972096:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633558656:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119517.972117:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119517.972138:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160cc expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.972173:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 9 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.972183:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 41) 00010000:00010000:3.0:1787119517.972188:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 41) 00010000:00010000:3.0:1787119517.972194:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.972230:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 9 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.972271:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 9 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119517.972288:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653582336:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119517.972375:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119517.992265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119517.992433:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653582336:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119517.992510:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119517.992533:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:2.0:1787119517.992584:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633558656:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 20491us (20738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119517.992594:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5159 00000100:00100000:3.0:1787119517.992817:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633558528 00000100:00100000:3.0:1787119517.992825:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633558528 00002000:00100000:3.0:1787119517.992866:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a508fff800 x1873929633558528/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/0 e 0 to 0 dl 1787119528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.992877:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff800 with x1873929633558528 ext(49152->86015) 00010000:00010000:3.0:1787119517.992884:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 10 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.992908:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 10 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.992915:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508fff800 00000100:00100000:3.0:1787119517.992944:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1134 00000100:00100000:3.0:1787119517.992952:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633558528:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119517.996018:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633558528:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3054us (3753us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119517.996032:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1134 00002000:00100000:3.0:1787119517.996045:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a508fff800 x1873929633558528/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:553/0 lens 488/440 e 0 to 0 dl 1787119528 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119517.996055:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff800 with x1873929633558528 ext(49152->86015) 00010000:00010000:3.0:1787119517.996066:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 10 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119517.996106:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 10 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119517.996115:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508fff800 00000100:00100000:0.0:1787119517.999639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119517.999738:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633558784 00000100:00100000:1.0:1787119517.999748:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633558784 00000100:00100000:1.0:1787119517.999812:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5160 00000100:00100000:1.0:1787119517.999823:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633558784:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119517.999841:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119517.999862:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160d3 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.999895:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 41) 00010000:00010000:1.0:1787119517.999905:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.999913:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 41) 00010000:00010000:1.0:1787119517.999918:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.999973:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119517.999992:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.000004:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:1.0:1787119518.000075:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+11:33957:x1873929633558784:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 252us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.000098:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5160 00000100:00100000:0.0:1787119518.001467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.001559:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633558912 00000100:00100000:2.0:1787119518.001569:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633558912 00010000:00010000:2.0:1787119518.001625:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 11 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.001664:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5245 00000100:00100000:2.0:1787119518.001674:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+11:2373:x1873929633558912:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.001689:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.001714:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 11 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.001740:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 11 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.001767:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3a1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160c5 expref: 11 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.001786:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 41) 00010000:00010000:2.0:1787119518.001792:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 41) 00010000:00010000:2.0:1787119518.001800:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.001811:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.001847:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.001863:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 18 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.001879:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653582592:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.001952:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61976d480 going to sleep for 11 seconds 00000100:00080000:0.0:1787119518.002050:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119518.011205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.011313:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653582592:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.011341:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.011402:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2373:x1873929633558912:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9728us (9973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.011415:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5245 00000100:00100000:1.0:1787119518.011656:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633559040 00000100:00100000:1.0:1787119518.011664:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633559040 00002000:00100000:1.0:1787119518.011726:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a511f57480 x1873929633559040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.011737:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633559040 ext(49152->53247) 00010000:00010000:1.0:1787119518.011745:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.011776:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.011784:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57480 00000100:00100000:1.0:1787119518.011806:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1135 00000100:00100000:1.0:1787119518.011816:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633559040:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.011995:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633559040:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 181us (801us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.012003:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1135 00002000:00100000:1.0:1787119518.012009:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a511f57480 x1873929633559040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.012017:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633559040 ext(49152->53247) 00010000:00010000:1.0:1787119518.012023:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.012037:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.012044:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57480 00000100:00080000:2.0:1787119518.012350:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119518.015794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.015849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.015931:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633559296 00000100:00100000:2.0:1787119518.015943:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633559296 00010000:00010000:2.0:1787119518.015984:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.016034:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5246 00000100:00100000:2.0:1787119518.016043:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633559296:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.016061:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.016114:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.016145:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.016172:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3a33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160cc expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.016191:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 41) 00010000:00010000:2.0:1787119518.016197:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 41) 00010000:00010000:2.0:1787119518.016205:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.016217:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.016257:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.016273:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653582720:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.016365:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61976d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.016928:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633559168 00000100:00100000:0.0:1787119518.016934:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633559168 00000100:00100000:0.0:1787119518.016976:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5161 00000100:00100000:0.0:1787119518.016985:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633559168:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119518.017001:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119518.017016:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160da expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.017038:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.017047:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 41) 00010000:00010000:0.0:1787119518.017050:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 41) 00010000:00010000:0.0:1787119518.017056:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.017102:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.017124:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 9 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.017137:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653582848:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119518.017184:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.021570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.021723:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633559424 00000100:00100000:1.0:1787119518.021733:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633559424 00010000:00010000:1.0:1787119518.021771:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 10 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.021813:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5247 00000100:00100000:1.0:1787119518.021823:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2376:x1873929633559424:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.021837:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.021858:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 10 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.021885:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 10 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.021912:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 41) 00010000:00010000:1.0:1787119518.021917:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 41) 00010000:00010000:1.0:1787119518.021927:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.021938:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.021979:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.021995:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653582976:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.022241:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.022357:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653582848:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119518.022383:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.022394:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:0.0:1787119518.022429:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633559168:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5445us (6579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.022454:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5161 00000100:00100000:1.0:1787119518.024834:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653582976:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.024862:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.024923:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2376:x1873929633559424:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3101us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.024933:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5247 00010000:00010000:2.0:1787119518.025640:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3a3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160d3 expref: 9 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.025662:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653582720:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.025681:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.025728:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633559296:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9685us (9944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.025736:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5246 00000100:00100000:0.0:1787119518.032696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.032894:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633559552 00000100:00100000:1.0:1787119518.032909:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633559552 00000100:00100000:1.0:1787119518.032978:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5162 00000100:00100000:1.0:1787119518.032989:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633559552:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.033008:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.033029:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160e1 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.033064:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.033106:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 41) 00010000:00010000:1.0:1787119518.033111:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 41) 00010000:00010000:1.0:1787119518.033118:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.033156:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.033184:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 18 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.033206:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653583104:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119518.033296:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.036778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.036869:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633559680 00000100:00100000:2.0:1787119518.036878:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633559680 00010000:00010000:2.0:1787119518.036919:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.036964:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5248 00000100:00100000:2.0:1787119518.036975:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633559680:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.036991:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.037015:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.037041:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.037068:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 41) 00010000:00010000:2.0:1787119518.037073:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 41) 00010000:00010000:2.0:1787119518.037094:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.037105:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.037146:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.037161:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653583232:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.037249:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61976d300 going to sleep for 11 seconds 00010000:00010000:1.0:1787119518.037562:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3a41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160da expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.037578:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653583104:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119518.037601:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.037612:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119518.037649:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633559552:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4662us (4964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.037657:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5162 00000100:00100000:3.0:1787119518.037822:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.037969:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633559808 00000100:00100000:2.0:1787119518.037975:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633559808 00000100:00100000:2.0:1787119518.038016:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5163 00000100:00100000:2.0:1787119518.038024:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633559808:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.038039:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.038055:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160e8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.038087:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.038096:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 41) 00010000:00010000:2.0:1787119518.038100:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 41) 00010000:00010000:2.0:1787119518.038105:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.038138:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.038160:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 9 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.038171:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653583360:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.038222:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.046824:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653583232:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.046858:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.046921:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633559680:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9947us (10152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.046934:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5248 00000100:00100000:3.0:1787119518.048276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.048368:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633559936 00000100:00100000:0.0:1787119518.048377:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633559936 00002000:00100000:0.0:1787119518.048424:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a511f54000 x1873929633559936/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.048436:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633559936 ext(49152->86015) 00010000:00010000:0.0:1787119518.048482:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.048523:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.048531:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f54000 00000100:00100000:0.0:1787119518.048564:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1136 00000100:00100000:0.0:1787119518.048574:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633559936:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.052872:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653583360:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.052906:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.052927:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92000, rc 0) 00000100:00100000:2.0:1787119518.052989:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633559808:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 14965us (15166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.052998:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5163 00000100:00100000:3.0:1787119518.061349:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633559936:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 12766us (13082us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119518.061366:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1136 00002000:00100000:3.0:1787119518.061379:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a511f54000 x1873929633559936/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.061390:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633559936 ext(49152->86015) 00010000:00010000:3.0:1787119518.061401:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.061432:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.061930:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f54000 00000100:00100000:3.0:1787119518.066675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.066777:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633560064 00000100:00100000:0.0:1787119518.066787:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633560064 00010000:00010000:0.0:1787119518.066828:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.066869:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5249 00000100:00100000:0.0:1787119518.066877:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2374:x1873929633560064:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119518.066894:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119518.066915:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.067324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.067592:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633560192 00000100:00100000:2.0:1787119518.067597:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633560192 00000100:00100000:2.0:1787119518.067640:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5164 00000100:00100000:2.0:1787119518.067646:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+11:33957:x1873929633560192:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.067661:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.067676:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160ef expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.067771:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.071089:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 41) 00010000:00010000:2.0:1787119518.071112:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.071124:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 41) 00010000:00010000:2.0:1787119518.071130:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 12 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.071194:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.071213:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 12 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.071230:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119518.072121:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+12:33957:x1873929633560192:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4468us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.072133:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5164 00010000:00010000:0.0:1787119518.074106:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3a48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e1 expref: 11 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.074133:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 41) 00010000:00010000:0.0:1787119518.074139:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 41) 00010000:00010000:0.0:1787119518.074148:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.074159:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.080591:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.080631:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 18 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.080649:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653583616:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.082093:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.091537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.091737:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633560320 00000100:00100000:0.0:1787119518.091747:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633560320 00002000:00100000:0.0:1787119518.091800:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a511f57100 x1873929633560320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.091812:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57100 with x1873929633560320 ext(49152->53247) 00010000:00010000:0.0:1787119518.091821:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.091857:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.091865:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57100 00000100:00100000:0.0:1787119518.091900:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1137 00000100:00100000:0.0:1787119518.091910:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633560320:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.092122:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633560320:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 212us (594us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119518.092130:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1137 00002000:00100000:0.0:1787119518.092137:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a511f57100 x1873929633560320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.092145:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57100 with x1873929633560320 ext(49152->53247) 00010000:00010000:0.0:1787119518.092151:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.092164:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.092172:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57100 00000100:00100000:1.0:1787119518.092639:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653583616:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.092665:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.092702:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2374:x1873929633560064:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 25825us (26036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.092710:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5249 00000100:00100000:3.0:1787119518.100559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.100606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.100741:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633560576 00000100:00100000:2.0:1787119518.100751:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633560576 00010000:00010000:2.0:1787119518.100792:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.100841:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5250 00000100:00100000:2.0:1787119518.100851:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633560576:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.100866:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.100888:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.100912:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.100935:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3a4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160e8 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.100969:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 41) 00010000:00010000:2.0:1787119518.100981:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 41) 00010000:00010000:2.0:1787119518.100990:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.101000:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.101041:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.101060:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653583744:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.101154:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.106736:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653583744:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.106764:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.106839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633560576:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5988us (6231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.106851:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5250 00000100:00100000:0.0:1787119518.107280:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633560448 00000100:00100000:0.0:1787119518.107291:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633560448 00000100:00100000:0.0:1787119518.107348:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5165 00000100:00100000:0.0:1787119518.107360:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633560448:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119518.107379:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119518.107402:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160f6 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.107434:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.107467:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 41) 00010000:00010000:0.0:1787119518.107471:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 41) 00010000:00010000:0.0:1787119518.107476:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.107510:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.107534:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 9 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.107548:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653583872:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119518.107617:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462600 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.113972:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653583872:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119518.114013:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.114035:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84400, rc 0) 00000100:00100000:0.0:1787119518.114115:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633560448:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6757us (13565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.114123:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5165 00000100:00100000:3.0:1787119518.116604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.116756:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.116869:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633560704 00000100:00100000:2.0:1787119518.116880:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633560704 00010000:00010000:2.0:1787119518.116922:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 10 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.116972:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5251 00000100:00100000:2.0:1787119518.116996:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633560704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.117013:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.117037:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 10 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.117066:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 10 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.117112:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3a56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160ef expref: 10 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.117136:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 41) 00010000:00010000:2.0:1787119518.117141:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 41) 00010000:00010000:2.0:1787119518.117150:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.117161:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.117204:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.117221:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653584000:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.117323:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.123221:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633560832 00000100:00100000:1.0:1787119518.123249:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633560832 00000100:00100000:1.0:1787119518.123333:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5166 00000100:00100000:1.0:1787119518.123344:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633560832:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.123364:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.123386:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047160fd expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.123423:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.123433:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 41) 00010000:00010000:1.0:1787119518.123457:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 41) 00010000:00010000:1.0:1787119518.123463:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.123497:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.123522:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 18 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.123543:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653584128:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119518.123637:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.134356:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653584000:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.134381:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.134474:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+11:2375:x1873929633560704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 17446us (17846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.134485:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5251 00000100:00100000:3.0:1787119518.146292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.146390:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633560960 00000100:00100000:0.0:1787119518.146402:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633560960 00002000:00100000:0.0:1787119518.146487:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a606154700 x1873929633560960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.146499:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154700 with x1873929633560960 ext(49152->53247) 00010000:00010000:0.0:1787119518.146509:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.146541:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.146550:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154700 00000100:00100000:0.0:1787119518.146588:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1138 00000100:00100000:0.0:1787119518.146598:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633560960:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.146798:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633560960:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 201us (515us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119518.146806:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1138 00002000:00100000:0.0:1787119518.146813:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a606154700 x1873929633560960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.146821:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154700 with x1873929633560960 ext(49152->53247) 00010000:00010000:0.0:1787119518.146827:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.146843:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.146851:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154700 00000100:00100000:0.0:1787119518.150395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.150472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.150545:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633561216 00000100:00100000:3.0:1787119518.150555:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633561216 00010000:00010000:3.0:1787119518.150594:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.150636:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5252 00000100:00100000:3.0:1787119518.150647:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633561216:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119518.150664:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119518.150688:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.150715:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.150743:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 41) 00010000:00010000:3.0:1787119518.150749:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 41) 00010000:00010000:3.0:1787119518.150759:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.150771:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.150809:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.150824:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653584256:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.150902:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999480 going to sleep for 11 seconds 00010000:00010000:1.0:1787119518.151227:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e3a5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160f6 expref: 19 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.151243:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653584128:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119518.151269:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.151280:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:1.0:1787119518.151319:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633560832:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 27977us (34563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.151326:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5166 00000100:00100000:1.0:1787119518.151350:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633561088 00000100:00100000:1.0:1787119518.151354:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633561088 00000100:00100000:1.0:1787119518.151389:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5167 00000100:00100000:1.0:1787119518.151397:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633561088:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.151411:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.151424:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716104 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.151483:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.151497:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 41) 00010000:00010000:1.0:1787119518.151501:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 41) 00010000:00010000:1.0:1787119518.151506:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.151528:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.151547:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 9 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.151559:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653584384:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119518.151593:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.157871:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653584384:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119518.157911:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.157932:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430a00, rc 0) 00000100:00100000:1.0:1787119518.158023:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633561088:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6625us (7636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.158032:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5167 00000100:00100000:3.0:1787119518.158847:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653584256:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.158866:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119518.158913:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633561216:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8268us (8476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.158924:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5252 00000100:00100000:0.0:1787119518.160656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.160744:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633561344 00000100:00100000:3.0:1787119518.160754:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633561344 00002000:00100000:3.0:1787119518.160798:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a62041d880 x1873929633561344/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.160809:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d880 with x1873929633561344 ext(49152->86015) 00010000:00010000:3.0:1787119518.160818:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.160847:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.160856:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041d880 00000100:00100000:3.0:1787119518.160889:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1139 00000100:00100000:3.0:1787119518.160898:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633561344:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.167402:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633561344:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6494us (6743us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119518.167417:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1139 00002000:00100000:3.0:1787119518.167430:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a62041d880 x1873929633561344/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.167487:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d880 with x1873929633561344 ext(49152->86015) 00010000:00010000:3.0:1787119518.167498:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.167527:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.167535:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041d880 00000100:00100000:1.0:1787119518.173506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.173677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.174643:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633561600 00000100:00100000:3.0:1787119518.174657:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633561600 00010000:00010000:3.0:1787119518.174705:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.174752:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5253 00000100:00100000:3.0:1787119518.174760:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633561600:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119518.174775:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119518.174797:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.174822:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.174849:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3a64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047160fd expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.174868:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 41) 00010000:00010000:3.0:1787119518.174873:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 41) 00010000:00010000:3.0:1787119518.174882:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 18 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.174894:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 18 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.174936:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 18 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.174964:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653584512:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.175063:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999480 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.178806:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653584512:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.178834:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119518.178889:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2375:x1873929633561600:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4128us (5211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.178901:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5253 00000100:00100000:2.0:1787119518.184046:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633561472 00000100:00100000:2.0:1787119518.184060:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633561472 00000100:00100000:2.0:1787119518.184416:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5168 00000100:00100000:2.0:1787119518.184426:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633561472:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.186424:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.186468:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471610b expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.186510:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 18 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.186520:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 41) 00010000:00010000:2.0:1787119518.186525:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 41) 00010000:00010000:2.0:1787119518.186530:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 10 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.186567:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 18 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.186608:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 18 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.186624:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653584640:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.186726:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.191816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.191908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.192433:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653584640:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.192488:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 10 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.192511:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:2.0:1787119518.192582:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633561472:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8156us (19085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.192596:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5168 00000100:00100000:2.0:1787119518.192628:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633561856 00000100:00100000:2.0:1787119518.192635:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633561856 00000100:00100000:2.0:1787119518.192680:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5169 00000100:00100000:2.0:1787119518.192690:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633561856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.192704:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.192720:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716112 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.192744:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 41) 00010000:00010000:2.0:1787119518.192752:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.192760:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 41) 00010000:00010000:2.0:1787119518.192765:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 20 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.192796:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.192807:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 20 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.192816:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93e00, rc 0) 00000100:00100000:2.0:1787119518.192836:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633561856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 148us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.192842:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5169 00000100:00100000:1.0:1787119518.193247:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633561728 00000100:00100000:1.0:1787119518.193252:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633561728 00010000:00010000:1.0:1787119518.193346:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 20 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.193380:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5254 00000100:00100000:1.0:1787119518.193388:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633561728:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.193399:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.193420:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 20 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.193486:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 20 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.193508:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716104 expref: 20 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.193522:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 41) 00010000:00010000:1.0:1787119518.193526:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 41) 00010000:00010000:1.0:1787119518.193534:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.193544:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.193570:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.193586:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 9 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.193599:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653584896:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.193666:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.200205:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653584896:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.200234:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.200305:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633561728:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6917us (8499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.200317:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5254 00000100:00100000:2.0:1787119518.205962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.206097:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633561984 00000100:00100000:3.0:1787119518.206106:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633561984 00010000:00010000:3.0:1787119518.206145:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 10 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.206187:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5255 00000100:00100000:3.0:1787119518.206195:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633561984:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119518.206209:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119518.206232:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 10 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.206258:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 10 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.206292:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3a72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471610b expref: 10 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.206310:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 41) 00010000:00010000:3.0:1787119518.206315:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 41) 00010000:00010000:3.0:1787119518.206323:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.206333:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.206369:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.206383:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653585024:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.206499:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999480 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.208556:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653585024:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.208753:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119518.208818:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+9:2375:x1873929633561984:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2622us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.208830:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5255 00000100:00100000:0.0:1787119518.209243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.209336:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633562112 00000100:00100000:1.0:1787119518.209344:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633562112 00002000:00100000:1.0:1787119518.209389:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a62041e300 x1873929633562112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.209400:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041e300 with x1873929633562112 ext(49152->53247) 00002000:00010000:1.0:1787119518.209406:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041e300 00000100:00100000:1.0:1787119518.209462:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10593 00000100:00100000:1.0:1787119518.209472:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633562112:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.209652:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2376:x1873929633562112:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 182us (410us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.209660:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10593 00002000:00100000:1.0:1787119518.209666:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a62041e300 x1873929633562112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.209675:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041e300 with x1873929633562112 ext(49152->53247) 00002000:00010000:1.0:1787119518.209678:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041e300 00000100:00100000:2.0:1787119518.214271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.214311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.214643:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633562368 00000100:00100000:1.0:1787119518.214653:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633562368 00000100:00100000:1.0:1787119518.214715:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5170 00000100:00100000:1.0:1787119518.214725:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+9:33957:x1873929633562368:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.214743:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.214764:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716119 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.214795:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.214805:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 41) 00010000:00010000:1.0:1787119518.214809:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 41) 00010000:00010000:1.0:1787119518.214814:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.214847:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.214872:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 18 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.214886:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653585152:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119518.214980:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466300 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.218031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.218110:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633562240 00000100:00100000:3.0:1787119518.218120:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633562240 00002000:00100000:3.0:1787119518.218164:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (53248->57343) req@ffff92a512844a80 x1873929633562240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.218176:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633562240 ext(53248->57343) 00010000:00010000:3.0:1787119518.218184:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 19 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.218211:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 19 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.218219:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844a80 00000100:00100000:3.0:1787119518.218248:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633562496 00000100:00100000:3.0:1787119518.218252:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633562496 00002000:00100000:3.0:1787119518.218278:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a512847800 x1873929633562496/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 4584/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.218285:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847800 with x1873929633562496 ext(49152->53247) 00010000:00010000:3.0:1787119518.218290:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 20 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.218301:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 20 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.218308:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512847800 00000100:00100000:3.0:1787119518.218324:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1140 00000100:00100000:3.0:1787119518.218332:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633562240:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.218545:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633562240:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 212us (4288us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.218553:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1140 00002000:00100000:3.0:1787119518.218560:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (53248->57343) req@ffff92a512844a80 x1873929633562240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.218568:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633562240 ext(53248->57343) 00010000:00010000:3.0:1787119518.218573:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 20 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.218587:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 20 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.218600:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844a80 00000100:00100000:3.0:1787119518.218617:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1141 00000100:00100000:3.0:1787119518.218624:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633562496:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119518.218897:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633562496:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 273us (876us total) trans 4294969224 rc 0/0 00000100:00100000:3.0:1787119518.218904:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1141 00002000:00100000:3.0:1787119518.218910:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a512847800 x1873929633562496/t4294969224(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 4584/448 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.218917:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847800 with x1873929633562496 ext(49152->53247) 00010000:00010000:3.0:1787119518.218922:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 21 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.218935:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 21 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.218941:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512847800 00000100:00100000:1.0:1787119518.219789:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653585152:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119518.219821:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.219840:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430a00, rc 0) 00000100:00100000:1.0:1787119518.219890:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633562368:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5167us (5577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.219898:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5170 00000100:00100000:3.0:1787119518.229714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.229764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.229872:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633562752 00000100:00100000:2.0:1787119518.229883:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633562752 00010000:00010000:2.0:1787119518.229925:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 21 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.229988:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5256 00000100:00100000:2.0:1787119518.229998:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633562752:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.230014:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.230037:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 21 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.230065:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 21 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.230102:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716112 expref: 21 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.230119:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 41) 00010000:00010000:2.0:1787119518.230123:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 41) 00010000:00010000:2.0:1787119518.230131:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.230142:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.230179:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.230193:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512845180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653585280:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.230286:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.234248:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633562624 00000100:00100000:1.0:1787119518.234277:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633562624 00000100:00100000:1.0:1787119518.234348:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5171 00000100:00100000:1.0:1787119518.234359:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:33946:x1873929633562624:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.234381:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.234402:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716120 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.234435:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.234487:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 41) 00010000:00010000:1.0:1787119518.234491:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 41) 00010000:00010000:1.0:1787119518.234497:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 22 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.234536:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.234566:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 9 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.234581:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653585408:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119518.234682:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.235023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.235126:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512845180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653585280:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119518.235144:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119518.235192:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2374:x1873929633562752:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5194us (5426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.235202:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5256 00000100:00100000:1.0:1787119518.235681:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633562880 00000100:00100000:1.0:1787119518.235688:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633562880 00002000:00100000:1.0:1787119518.235726:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a606156a00 x1873929633562880/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.235736:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156a00 with x1873929633562880 ext(49152->86015) 00010000:00010000:1.0:1787119518.235744:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.235766:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.235774:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606156a00 00000100:00100000:1.0:1787119518.235797:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1142 00000100:00100000:1.0:1787119518.235806:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633562880:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.247604:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653585408:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119518.247646:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.247678:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119518.247746:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:33946:x1873929633562624:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13388us (18042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.247756:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5171 00000100:00100000:1.0:1787119518.250332:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2375:x1873929633562880:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 14513us (15297us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119518.250349:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1142 00002000:00100000:1.0:1787119518.250363:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (49152->86015) req@ffff92a606156a00 x1873929633562880/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.250374:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156a00 with x1873929633562880 ext(49152->86015) 00010000:00010000:1.0:1787119518.250385:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.250416:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 10 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.250425:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606156a00 00000100:00100000:0.0:1787119518.256228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.256324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.256433:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633563008 00000100:00100000:2.0:1787119518.256481:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633563008 00000100:00100000:2.0:1787119518.256543:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5172 00000100:00100000:2.0:1787119518.256552:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633563008:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.256572:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.256593:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716127 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.256625:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 41) 00010000:00010000:2.0:1787119518.256631:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 41) 00010000:00010000:2.0:1787119518.256637:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.256651:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.256671:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93e00, rc 0) 00000100:00100000:2.0:1787119518.256728:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+11:33957:x1873929633563008:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 176us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.256736:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5172 00000100:00100000:1.0:1787119518.256808:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633563136 00000100:00100000:1.0:1787119518.256813:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633563136 00010000:00010000:1.0:1787119518.256834:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 11 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.256865:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5257 00000100:00100000:1.0:1787119518.256871:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+11:2376:x1873929633563136:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.256882:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.256905:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 11 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.256930:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 11 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.256951:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->18446744073709551615] (req 49152->53247) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716119 expref: 11 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.256964:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 41) 00010000:00010000:1.0:1787119518.256968:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 41) 00010000:00010000:1.0:1787119518.256985:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.256995:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.257004:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 41) 00010000:00010000:1.0:1787119518.257007:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 41) 00010000:00010000:1.0:1787119518.257011:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.257019:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.257058:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.257082:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653585536:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.257154:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.257165:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653585664:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.257190:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.259941:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653585536:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.259958:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653585664:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.259993:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.260048:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2376:x1873929633563136:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3175us (3722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.260058:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5257 00000100:00100000:0.0:1787119518.274531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.274740:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633563264 00000100:00100000:2.0:1787119518.274751:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633563264 00002000:00100000:2.0:1787119518.274805:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a62041e680 x1873929633563264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.274816:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041e680 with x1873929633563264 ext(49152->53247) 00002000:00010000:2.0:1787119518.274822:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041e680 00000100:00100000:2.0:1787119518.274855:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10594 00000100:00100000:2.0:1787119518.274865:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2376:x1873929633563264:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.275050:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+10:2376:x1873929633563264:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 186us (533us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.275057:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10594 00002000:00100000:2.0:1787119518.275063:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (49152->53247) req@ffff92a62041e680 x1873929633563264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.275081:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041e680 with x1873929633563264 ext(49152->53247) 00002000:00010000:2.0:1787119518.275085:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041e680 00000100:00100000:3.0:1787119518.278821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.279326:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633563392 00000100:00100000:2.0:1787119518.279337:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633563392 00002000:00100000:2.0:1787119518.279391:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (53248->57343) req@ffff92a606156300 x1873929633563392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.279409:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156300 with x1873929633563392 ext(53248->57343) 00002000:00010000:2.0:1787119518.279414:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156300 00000100:00100000:2.0:1787119518.279480:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10595 00000100:00100000:2.0:1787119518.279491:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633563392:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.279726:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633563392:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 236us (951us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.279734:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10595 00002000:00100000:2.0:1787119518.279741:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (53248->57343) req@ffff92a606156300 x1873929633563392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.279749:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156300 with x1873929633563392 ext(53248->57343) 00002000:00010000:2.0:1787119518.279753:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606156300 00000100:00100000:3.0:1787119518.287855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.288127:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633563520 00000100:00100000:1.0:1787119518.288137:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633563520 00000100:00100000:1.0:1787119518.288199:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5173 00000100:00100000:1.0:1787119518.288209:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+10:33957:x1873929633563520:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.288228:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.288259:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471612e expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.288299:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.288308:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 41) 00010000:00010000:1.0:1787119518.288314:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 41) 00010000:00010000:1.0:1787119518.288319:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 11 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.288351:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.288377:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 20 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.288392:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653585792:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119518.288496:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.297013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.297141:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633563648 00000100:00100000:3.0:1787119518.297155:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633563648 00002000:00100000:3.0:1787119518.297213:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a508ffc000 x1873929633563648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.297224:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc000 with x1873929633563648 ext(57344->61439) 00010000:00010000:3.0:1787119518.297235:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 21 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.297279:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 21 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.297287:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffc000 00000100:00100000:3.0:1787119518.297322:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1143 00000100:00100000:3.0:1787119518.297332:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633563648:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.297583:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633563648:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 251us (578us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.297591:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1143 00002000:00100000:3.0:1787119518.297598:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a508ffc000 x1873929633563648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.297606:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc000 with x1873929633563648 ext(57344->61439) 00010000:00010000:3.0:1787119518.297611:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 21 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.297627:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 21 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.297816:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffc000 00000100:00100000:3.0:1787119518.301774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.302919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.303619:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633563904 00000100:00100000:2.0:1787119518.303630:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633563904 00000100:00100000:2.0:1787119518.303684:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5174 00000100:00100000:2.0:1787119518.303694:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:33946:x1873929633563904:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.303713:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.303733:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716135 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.303768:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 41) 00010000:00010000:2.0:1787119518.303773:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 41) 00010000:00010000:2.0:1787119518.303778:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 22 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.303794:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 22 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.303807:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:2.0:1787119518.303865:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:33946:x1873929633563904:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 172us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.303872:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5174 00000100:00100000:1.0:1787119518.304010:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653585792:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119518.304037:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 11 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.304048:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430a00, rc 0) 00000100:00100000:1.0:1787119518.304093:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+11:33957:x1873929633563520:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 15885us (16249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.304103:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5173 00000100:00100000:0.0:1787119518.305100:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633563776 00000100:00100000:0.0:1787119518.305109:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633563776 00002000:00100000:0.0:1787119518.305152:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (53248->57343) req@ffff92a606157800 x1873929633563776/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 4584/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.305163:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157800 with x1873929633563776 ext(53248->57343) 00010000:00010000:0.0:1787119518.305171:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 22 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.305198:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 22 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.305206:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157800 00000100:00100000:0.0:1787119518.305226:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1144 00000100:00100000:0.0:1787119518.305235:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633563776:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119518.305779:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633563776:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 541us (4012us total) trans 4294969225 rc 0/0 00000100:00100000:0.0:1787119518.305787:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1144 00002000:00100000:0.0:1787119518.305795:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (53248->57343) req@ffff92a606157800 x1873929633563776/t4294969225(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 4584/448 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.305804:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157800 with x1873929633563776 ext(53248->57343) 00010000:00010000:0.0:1787119518.305810:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 24 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.305827:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 24 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.305834:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157800 00000100:00100000:2.0:1787119518.313920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.314030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633564032 00000100:00100000:3.0:1787119518.314041:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633564032 00010000:00010000:3.0:1787119518.314091:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 24 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.314135:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5258 00000100:00100000:3.0:1787119518.314145:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2374:x1873929633564032:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119518.314160:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119518.314183:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 24 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.314210:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 24 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.314235:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3a87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [53248->18446744073709551615] (req 53248->57343) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716120 expref: 24 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.314252:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 41) 00010000:00010000:3.0:1787119518.314266:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 41) 00010000:00010000:3.0:1787119518.314275:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.314291:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.314301:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 41) 00010000:00010000:3.0:1787119518.314303:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 41) 00010000:00010000:3.0:1787119518.314308:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 23 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.314316:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 23 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.314352:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 23 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.314367:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653585920:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.314516:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.314527:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653586048:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.314551:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.319801:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653585920:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.319818:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653586048:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.319841:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.319902:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2374:x1873929633564032:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5756us (5988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.319913:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5258 00000100:00100000:1.0:1787119518.322135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.323055:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633564160 00000100:00100000:0.0:1787119518.323069:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633564160 00002000:00100000:0.0:1787119518.323136:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (53248->57343) req@ffff92a508ffed80 x1873929633564160/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.323154:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffed80 with x1873929633564160 ext(53248->57343) 00002000:00010000:0.0:1787119518.323159:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffed80 00000100:00100000:0.0:1787119518.323196:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10596 00000100:00100000:0.0:1787119518.323206:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+11:2375:x1873929633564160:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.323425:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+11:2375:x1873929633564160:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 219us (1300us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119518.323433:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10596 00002000:00100000:0.0:1787119518.323480:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (53248->57343) req@ffff92a508ffed80 x1873929633564160/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.323488:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffed80 with x1873929633564160 ext(53248->57343) 00002000:00010000:0.0:1787119518.323492:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffed80 00000100:00100000:3.0:1787119518.326327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.326642:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633564288 00000100:00100000:1.0:1787119518.326652:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633564288 00000100:00100000:1.0:1787119518.326714:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5175 00000100:00100000:1.0:1787119518.326723:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+11:33957:x1873929633564288:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.326740:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.326760:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471613c expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.326793:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 22 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.326803:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 41) 00010000:00010000:1.0:1787119518.326808:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 41) 00010000:00010000:1.0:1787119518.326813:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.326848:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 22 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.326877:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 22 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.326892:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653586176:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119518.326994:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.330277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.330385:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653586176:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119518.330425:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.330482:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:3.0:1787119518.330549:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+12:33957:x1873929633564288:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3827us (4234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.330559:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5175 00000100:00100000:0.0:1787119518.330752:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633564416 00000100:00100000:0.0:1787119518.330760:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633564416 00010000:00010000:0.0:1787119518.330794:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 23 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.330832:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5259 00000100:00100000:0.0:1787119518.330841:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633564416:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119518.330856:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119518.330878:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 23 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.330903:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 23 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.330927:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3a9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716135 expref: 23 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.330948:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 41) 00010000:00010000:0.0:1787119518.330953:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 41) 00010000:00010000:0.0:1787119518.330961:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.330971:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.331005:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.331019:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653586304:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119518.331095:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.332095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.332165:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633564544 00000100:00100000:3.0:1787119518.332171:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633564544 00000100:00100000:3.0:1787119518.332217:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5176 00000100:00100000:3.0:1787119518.332227:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:33946:x1873929633564544:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119518.332243:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119518.332259:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716143 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.332293:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.332303:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 41) 00010000:00010000:3.0:1787119518.332307:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 41) 00010000:00010000:3.0:1787119518.332312:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 24 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.332340:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.332361:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 11 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.332375:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653586432:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119518.332466:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.334658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.334792:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633564672 00000100:00100000:2.0:1787119518.334801:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633564672 00002000:00100000:2.0:1787119518.334847:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (57344->94207) req@ffff92a606155880 x1873929633564672/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.334858:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155880 with x1873929633564672 ext(57344->94207) 00010000:00010000:2.0:1787119518.334866:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.334892:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.334901:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606155880 00000100:00100000:2.0:1787119518.334942:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1145 00000100:00100000:2.0:1787119518.334952:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2373:x1873929633564672:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.337524:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2373:x1873929633564672:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2563us (2876us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119518.337538:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1145 00002000:00100000:2.0:1787119518.337550:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (57344->94207) req@ffff92a606155880 x1873929633564672/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.337560:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155880 with x1873929633564672 ext(57344->94207) 00010000:00010000:2.0:1787119518.337570:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.337597:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.337607:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606155880 00000100:00100000:2.0:1787119518.337672:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653586432:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.337700:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 24 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.337718:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:2.0:1787119518.337740:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:33946:x1873929633564544:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5515us (5651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.337747:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5176 00000100:00100000:0.0:1787119518.338413:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653586304:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119518.338429:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.338598:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633564416:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7757us (8339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.338608:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5259 00000100:00100000:1.0:1787119518.347372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.347422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.347553:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633564800 00000100:00100000:2.0:1787119518.347563:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633564800 00010000:00010000:2.0:1787119518.347605:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.347645:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5260 00000100:00100000:2.0:1787119518.347655:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2376:x1873929633564800:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.347670:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.347696:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.347722:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.347747:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3aa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471613c expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.347769:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 41) 00010000:00010000:2.0:1787119518.347775:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 41) 00010000:00010000:2.0:1787119518.347783:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.347794:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.347832:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.347853:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512845880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653586560:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.347947:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.348061:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633564928 00000100:00100000:3.0:1787119518.348066:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633564928 00000100:00100000:3.0:1787119518.348116:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5177 00000100:00100000:3.0:1787119518.348124:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+12:33957:x1873929633564928:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119518.348140:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119518.348153:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471614a expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.348172:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.348180:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 41) 00010000:00010000:3.0:1787119518.348184:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 41) 00010000:00010000:3.0:1787119518.348188:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.348210:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.348226:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 22 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.348243:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653586688:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119518.348345:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.359773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.361275:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653586688:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119518.361317:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.361340:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0800, rc 0) 00000100:00100000:0.0:1787119518.361401:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+13:33957:x1873929633564928:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13278us (13977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.361410:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5177 00000100:00100000:1.0:1787119518.362133:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633565056 00000100:00100000:1.0:1787119518.362147:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633565056 00002000:00100000:1.0:1787119518.362194:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a606157480 x1873929633565056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.362205:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157480 with x1873929633565056 ext(57344->61439) 00010000:00010000:1.0:1787119518.362213:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.362242:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.362250:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157480 00000100:00100000:1.0:1787119518.362294:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1146 00000100:00100000:1.0:1787119518.362305:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633565056:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.362551:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633565056:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 246us (2786us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.362559:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1146 00002000:00100000:1.0:1787119518.362565:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a606157480 x1873929633565056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.362574:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157480 with x1873929633565056 ext(57344->61439) 00010000:00010000:1.0:1787119518.362579:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.362593:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.362601:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157480 00000100:00100000:2.0:1787119518.362879:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512845880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653586560:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.362900:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.362940:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2376:x1873929633564800:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 15285us (15578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.362949:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5260 00000100:00100000:3.0:1787119518.370329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.370693:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633565184 00000100:00100000:1.0:1787119518.370705:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633565184 00000100:00100000:1.0:1787119518.370773:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5178 00000100:00100000:1.0:1787119518.370784:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:33946:x1873929633565184:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.370803:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.370823:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716151 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.370858:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 41) 00010000:00010000:1.0:1787119518.370868:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.370881:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 41) 00010000:00010000:1.0:1787119518.370887:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 24 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.370933:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.370949:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 24 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.370962:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:1.0:1787119518.371016:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:33946:x1873929633565184:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 234us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.371023:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5178 00000100:00100000:3.0:1787119518.371638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.373430:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633565312 00000100:00100000:1.0:1787119518.373480:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633565312 00010000:00010000:1.0:1787119518.373527:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 24 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.373570:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5261 00000100:00100000:1.0:1787119518.373580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633565312:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.373597:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.373621:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 24 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.373962:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 24 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.373989:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3aaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716143 expref: 24 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.374008:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 41) 00010000:00010000:1.0:1787119518.374012:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 41) 00010000:00010000:1.0:1787119518.374021:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.374032:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.374135:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.374153:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 11 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.374168:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512845880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653586944:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.374265:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.397712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.398555:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633565440 00000100:00100000:0.0:1787119518.398568:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633565440 00010000:00010000:0.0:1787119518.398621:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 12 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.398826:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512845880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653586944:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.398848:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119518.398914:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633565312:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 25334us (27276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.398923:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5261 00000100:00100000:3.0:1787119518.398989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5262 00000100:00100000:3.0:1787119518.399000:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2375:x1873929633565440:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119518.399015:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119518.399039:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 12 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.399067:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 12 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.399104:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3ab1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471614a expref: 12 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.399121:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 41) 00010000:00010000:3.0:1787119518.399127:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 41) 00010000:00010000:3.0:1787119518.399135:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.399145:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.399184:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.399199:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653587072:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.399248:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.404611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.404711:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633565568 00000100:00100000:2.0:1787119518.404723:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633565568 00000100:00100000:2.0:1787119518.404785:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5179 00000100:00100000:2.0:1787119518.404795:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+12:33957:x1873929633565568:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.404815:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.404837:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716158 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.404872:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.404881:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 41) 00010000:00010000:2.0:1787119518.404885:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 41) 00010000:00010000:2.0:1787119518.404890:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.404926:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.404961:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 22 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.404976:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653587200:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.405056:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.408010:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653587200:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.408052:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.408083:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:2.0:1787119518.408136:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+13:33957:x1873929633565568:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3341us (3533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.408149:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5179 00000100:00100000:3.0:1787119518.408584:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653587072:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.408598:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119518.408624:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2375:x1873929633565440:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9627us (10923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.408633:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5262 00000100:00100000:2.0:1787119518.420238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.420491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.420577:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633565824 00000100:00100000:3.0:1787119518.420586:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633565824 00000100:00100000:3.0:1787119518.420647:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5180 00000100:00100000:3.0:1787119518.420657:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:33946:x1873929633565824:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119518.420678:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119518.420698:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471615f expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.420736:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 41) 00010000:00010000:3.0:1787119518.420745:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.420753:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 41) 00010000:00010000:3.0:1787119518.420758:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 24 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.420798:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.420813:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 24 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.420825:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119518.420878:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:33946:x1873929633565824:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 222us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.420885:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5180 00000100:00100000:1.0:1787119518.424018:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633565696 00000100:00100000:1.0:1787119518.424035:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633565696 00010000:00010000:1.0:1787119518.424329:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 24 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.424433:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5263 00000100:00100000:1.0:1787119518.424445:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633565696:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.424462:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.424487:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 24 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.424554:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 24 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.424580:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3ab8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716151 expref: 24 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.424596:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 41) 00010000:00010000:1.0:1787119518.424601:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 41) 00010000:00010000:1.0:1787119518.424610:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.424620:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.424663:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.424680:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 11 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.424697:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653587456:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.424784:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.427951:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653587456:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.427985:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.428037:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633565696:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3593us (7809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.428049:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5263 00000100:00100000:0.0:1787119518.432031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.432219:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633565952 00000100:00100000:3.0:1787119518.432229:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633565952 00002000:00100000:3.0:1787119518.432289:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (57344->94207) req@ffff92a62041ce00 x1873929633565952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.432300:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ce00 with x1873929633565952 ext(57344->94207) 00010000:00010000:3.0:1787119518.432310:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.432342:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.432350:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041ce00 00000100:00100000:3.0:1787119518.432384:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1147 00000100:00100000:3.0:1787119518.432394:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2376:x1873929633565952:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.436663:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2376:x1873929633565952:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4255us (4626us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119518.436679:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1147 00002000:00100000:1.0:1787119518.436695:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (57344->94207) req@ffff92a62041ce00 x1873929633565952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.436705:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ce00 with x1873929633565952 ext(57344->94207) 00010000:00010000:1.0:1787119518.436715:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.436750:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.436759:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041ce00 00000100:00100000:3.0:1787119518.440314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.440363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.440475:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633566208 00000100:00100000:1.0:1787119518.440486:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633566208 00010000:00010000:1.0:1787119518.440528:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.440571:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5264 00000100:00100000:1.0:1787119518.440581:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2376:x1873929633566208:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.440600:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.440627:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.440655:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.440682:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3abf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716158 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.440699:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 41) 00010000:00010000:1.0:1787119518.440704:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 41) 00010000:00010000:1.0:1787119518.440713:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.440723:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.440760:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.440774:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653587584:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.440878:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.441174:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633566080 00000100:00100000:0.0:1787119518.441179:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633566080 00000100:00100000:0.0:1787119518.441220:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5181 00000100:00100000:0.0:1787119518.441228:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+12:33957:x1873929633566080:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119518.441242:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119518.441255:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716166 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.441275:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.441283:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 41) 00010000:00010000:0.0:1787119518.441287:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 41) 00010000:00010000:0.0:1787119518.441291:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.441315:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.441338:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 22 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.441350:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653587712:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119518.441385:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.447140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.447280:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633566336 00000100:00100000:2.0:1787119518.447290:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633566336 00002000:00100000:2.0:1787119518.447339:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a606154a80 x1873929633566336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.447351:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154a80 with x1873929633566336 ext(57344->61439) 00010000:00010000:2.0:1787119518.447362:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.447395:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.447403:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154a80 00000100:00100000:2.0:1787119518.447435:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1148 00000100:00100000:2.0:1787119518.447472:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633566336:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.447665:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633566336:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 193us (534us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.447673:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1148 00002000:00100000:2.0:1787119518.447679:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a606154a80 x1873929633566336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.447688:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154a80 with x1873929633566336 ext(57344->61439) 00010000:00010000:2.0:1787119518.447693:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.447709:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.447715:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154a80 00000100:00100000:1.0:1787119518.447817:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653587584:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.447840:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.447880:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2376:x1873929633566208:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7300us (7516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.447893:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5264 00000100:00100000:0.0:1787119518.448855:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653587712:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119518.448882:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.448901:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85000, rc 0) 00000100:00100000:0.0:1787119518.448953:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+12:33957:x1873929633566080:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7726us (8652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.448961:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5181 00000100:00100000:2.0:1787119518.453050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.453107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.453202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633566464 00000100:00100000:3.0:1787119518.453212:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633566464 00010000:00010000:3.0:1787119518.453256:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.453297:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5265 00000100:00100000:3.0:1787119518.453306:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633566464:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119518.453320:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119518.453344:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.453369:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.453392:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3ac6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471615f expref: 23 pid: 20841 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.453410:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 41) 00010000:00010000:3.0:1787119518.453415:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 41) 00010000:00010000:3.0:1787119518.453422:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.453431:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.453527:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.453545:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653587840:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.453636:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999600 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.454030:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633566592 00000100:00100000:0.0:1787119518.454036:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633566592 00000100:00100000:0.0:1787119518.454087:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5182 00000100:00100000:0.0:1787119518.454096:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:33946:x1873929633566592:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119518.454110:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119518.454125:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471616d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.454148:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.454161:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 41) 00010000:00010000:0.0:1787119518.454164:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 41) 00010000:00010000:0.0:1787119518.454169:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 24 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.454194:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.454213:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 11 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.454225:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653587968:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119518.454256:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.456969:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653587968:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119518.457017:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 24 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.457040:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85a00, rc 0) 00000100:00100000:0.0:1787119518.457109:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:33946:x1873929633566592:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3014us (4001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.457118:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5182 00000100:00100000:3.0:1787119518.460386:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653587840:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.460416:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119518.460508:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633566464:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7202us (7469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.460519:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5265 00000100:00100000:2.0:1787119518.466229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.467054:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633566720 00000100:00100000:1.0:1787119518.467066:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633566720 00010000:00010000:1.0:1787119518.467120:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 12 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.467216:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5266 00000100:00100000:1.0:1787119518.467226:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2373:x1873929633566720:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.467245:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.467282:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 12 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.467315:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 12 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.467341:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3acd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716166 expref: 12 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.467361:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 41) 00010000:00010000:1.0:1787119518.467367:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 41) 00010000:00010000:1.0:1787119518.467376:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 22 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.467386:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 22 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.467432:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 22 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.467502:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653588096:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.467599:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.470827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.470985:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633566848 00000100:00100000:3.0:1787119518.470995:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633566848 00002000:00100000:3.0:1787119518.471049:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a62041f480 x1873929633566848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.471061:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f480 with x1873929633566848 ext(57344->61439) 00002000:00010000:3.0:1787119518.471077:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041f480 00000100:00100000:3.0:1787119518.471115:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10597 00000100:00100000:3.0:1787119518.471125:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633566848:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.471334:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633566848:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 210us (518us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.471341:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10597 00002000:00100000:3.0:1787119518.471348:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a62041f480 x1873929633566848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.471355:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f480 with x1873929633566848 ext(57344->61439) 00002000:00010000:3.0:1787119518.471358:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041f480 00000100:00100000:1.0:1787119518.472743:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653588096:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.472769:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.472817:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+11:2373:x1873929633566720:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5592us (6609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.472828:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5266 00000100:00100000:0.0:1787119518.477017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.477063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.477156:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633566976 00000100:00100000:2.0:1787119518.477167:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633566976 00000100:00100000:2.0:1787119518.477234:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5183 00000100:00100000:2.0:1787119518.477244:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+11:33957:x1873929633566976:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.477272:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.477293:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716174 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.477330:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 22 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.477340:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 41) 00010000:00010000:2.0:1787119518.477344:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 41) 00010000:00010000:2.0:1787119518.477350:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.477383:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 22 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.477413:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 22 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.477428:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653588224:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.477545:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.477607:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633567104 00000100:00100000:3.0:1787119518.477612:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633567104 00002000:00100000:3.0:1787119518.477644:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (61440->65535) req@ffff92a519cd6a00 x1873929633567104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.477654:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633567104 ext(61440->65535) 00010000:00010000:3.0:1787119518.477661:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 23 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.477675:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 23 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.477682:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519cd6a00 00000100:00100000:3.0:1787119518.477710:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1149 00000100:00100000:3.0:1787119518.477718:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633567104:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.477883:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633567104:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 165us (819us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.477891:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1149 00002000:00100000:3.0:1787119518.477897:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (61440->65535) req@ffff92a519cd6a00 x1873929633567104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.477906:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633567104 ext(61440->65535) 00010000:00010000:3.0:1787119518.477911:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 23 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.477926:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 23 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.477933:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519cd6a00 00000100:00100000:2.0:1787119518.480307:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653588224:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.480344:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.480366:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119518.480426:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+12:33957:x1873929633566976:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3183us (3418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.480434:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5183 00000100:00100000:2.0:1787119518.482576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.482668:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633567232 00000100:00100000:1.0:1787119518.482678:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633567232 00002000:00100000:1.0:1787119518.482725:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a512844700 x1873929633567232/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 4584/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.482736:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844700 with x1873929633567232 ext(57344->61439) 00010000:00010000:1.0:1787119518.482745:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 23 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.482774:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 23 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.482782:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844700 00000100:00100000:1.0:1787119518.482821:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1150 00000100:00100000:1.0:1787119518.482830:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633567232:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119518.483238:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633567232:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 408us (670us total) trans 4294969226 rc 0/0 00000100:00100000:1.0:1787119518.483246:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1150 00002000:00100000:1.0:1787119518.483253:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a512844700 x1873929633567232/t4294969226(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 4584/448 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.483374:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844700 with x1873929633567232 ext(57344->61439) 00010000:00010000:1.0:1787119518.483382:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 25 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.483400:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 25 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.483407:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844700 00000100:00100000:1.0:1787119518.487578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.487626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.487724:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633567360 00000100:00100000:0.0:1787119518.487734:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633567360 00010000:00010000:0.0:1787119518.487777:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 25 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.487823:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5267 00000100:00100000:0.0:1787119518.487833:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633567360:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119518.487851:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787119518.487872:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119516 -> 1787119517 00002000:00010000:0.0:1787119518.487876:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119516 -> 1787119517 00010000:00010000:0.0:1787119518.487882:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 25 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.487910:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 25 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.487947:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ad4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471616d expref: 25 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.487966:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 41) 00010000:00010000:0.0:1787119518.487971:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 41) 00010000:00010000:0.0:1787119518.487989:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.488001:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.488038:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.488052:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653588352:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119518.488154:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.488411:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633567488 00000100:00100000:2.0:1787119518.488416:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633567488 00000100:00100000:2.0:1787119518.488492:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5184 00000100:00100000:2.0:1787119518.488502:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:33946:x1873929633567488:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.488516:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.488531:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471617b expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.488552:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.488560:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 41) 00010000:00010000:2.0:1787119518.488564:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 41) 00010000:00010000:2.0:1787119518.488569:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.488593:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.488611:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 11 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.488623:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653588480:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.488663:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.494743:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653588352:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119518.494771:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119518.494833:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633567360:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6999us (7204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.494844:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5267 00000100:00100000:2.0:1787119518.495004:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653588480:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.495028:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.495048:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:2.0:1787119518.495088:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:33946:x1873929633567488:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6588us (7521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.495096:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5184 00000100:00100000:0.0:1787119518.496651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.496729:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633567616 00000100:00100000:3.0:1787119518.496738:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633567616 00002000:00100000:3.0:1787119518.496782:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (57344->94207) req@ffff92a519cd6680 x1873929633567616/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.496793:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6680 with x1873929633567616 ext(57344->94207) 00010000:00010000:3.0:1787119518.496802:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.496832:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.496840:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519cd6680 00000100:00100000:3.0:1787119518.496874:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1151 00000100:00100000:3.0:1787119518.496884:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2375:x1873929633567616:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.501561:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2375:x1873929633567616:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4659us (4897us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119518.501578:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1151 00002000:00100000:3.0:1787119518.501594:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (57344->94207) req@ffff92a519cd6680 x1873929633567616/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.501606:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6680 with x1873929633567616 ext(57344->94207) 00010000:00010000:3.0:1787119518.501620:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.501656:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 12 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.501665:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519cd6680 00000100:00100000:3.0:1787119518.504424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.504543:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633567744 00000100:00100000:0.0:1787119518.504552:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633567744 00000100:00100000:0.0:1787119518.504611:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5185 00000100:00100000:0.0:1787119518.504622:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+12:33957:x1873929633567744:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119518.504641:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119518.504662:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716182 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.504695:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 41) 00010000:00010000:0.0:1787119518.504700:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 41) 00010000:00010000:0.0:1787119518.504707:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.504727:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.504742:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85a00, rc 0) 00000100:00100000:0.0:1787119518.504806:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+13:33957:x1873929633567744:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 186us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.504814:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5185 00000100:00100000:1.0:1787119518.507290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.507426:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633567872 00000100:00100000:3.0:1787119518.507476:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633567872 00010000:00010000:3.0:1787119518.507523:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 13 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.507569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5268 00000100:00100000:3.0:1787119518.507580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2376:x1873929633567872:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119518.507598:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119518.507624:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 13 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.507653:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 13 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.507677:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3adb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->18446744073709551615] (req 57344->61439) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716174 expref: 13 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.507695:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 41) 00010000:00010000:3.0:1787119518.507699:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 41) 00010000:00010000:3.0:1787119518.507708:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 24 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.507719:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 24 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.507729:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 41) 00010000:00010000:3.0:1787119518.507734:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 41) 00010000:00010000:3.0:1787119518.507740:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.507749:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.507789:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.507811:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653588608:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.507906:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 24 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.507915:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653588736:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.508079:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.511011:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653588608:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.512215:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653588736:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.512242:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119518.512314:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2376:x1873929633567872:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4734us (5033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.512325:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5268 00000100:00100000:1.0:1787119518.529031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.529084:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.529172:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633568128 00000100:00100000:3.0:1787119518.529183:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633568128 00002000:00100000:3.0:1787119518.529232:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (61440->65535) req@ffff92a508ffd500 x1873929633568128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.529243:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd500 with x1873929633568128 ext(61440->65535) 00002000:00010000:3.0:1787119518.529249:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd500 00000100:00100000:3.0:1787119518.529288:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633568000 00000100:00100000:3.0:1787119518.529292:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633568000 00002000:00100000:3.0:1787119518.529306:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a508ffdf80 x1873929633568000/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.529321:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdf80 with x1873929633568000 ext(57344->61439) 00002000:00010000:3.0:1787119518.529324:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffdf80 00000100:00100000:3.0:1787119518.529350:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10598 00000100:00100000:3.0:1787119518.529360:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2374:x1873929633568128:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.529585:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2374:x1873929633568128:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 226us (563us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.529592:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10598 00002000:00100000:3.0:1787119518.529598:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (61440->65535) req@ffff92a508ffd500 x1873929633568128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.529607:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd500 with x1873929633568128 ext(61440->65535) 00002000:00010000:3.0:1787119518.529611:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd500 00000100:00100000:3.0:1787119518.529626:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10599 00000100:00100000:3.0:1787119518.529633:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2375:x1873929633568000:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.529699:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+12:2375:x1873929633568000:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 65us (614us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.529706:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10599 00002000:00100000:3.0:1787119518.529712:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (57344->61439) req@ffff92a508ffdf80 x1873929633568000/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.529720:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdf80 with x1873929633568000 ext(57344->61439) 00002000:00010000:3.0:1787119518.529723:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffdf80 00000100:00100000:0.0:1787119518.534907:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.534964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.535135:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633568256 00000100:00100000:1.0:1787119518.535146:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633568256 00002000:00100000:1.0:1787119518.535197:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (65536->69631) req@ffff92a634979180 x1873929633568256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.535208:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979180 with x1873929633568256 ext(65536->69631) 00002000:00010000:1.0:1787119518.535213:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979180 00000100:00100000:1.0:1787119518.535246:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10600 00000100:00100000:1.0:1787119518.535268:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633568256:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.535536:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633568256:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 281us (638us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.535544:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10600 00002000:00100000:1.0:1787119518.535551:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (65536->69631) req@ffff92a634979180 x1873929633568256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.535560:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979180 with x1873929633568256 ext(65536->69631) 00002000:00010000:1.0:1787119518.535564:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979180 00000100:00100000:2.0:1787119518.535792:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633568384 00000100:00100000:2.0:1787119518.535797:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633568384 00000100:00100000:2.0:1787119518.535841:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5186 00000100:00100000:2.0:1787119518.535849:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+12:33957:x1873929633568384:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.535861:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.535879:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716189 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.535907:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 24 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.535916:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 41) 00010000:00010000:2.0:1787119518.535920:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 41) 00010000:00010000:2.0:1787119518.535925:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.535970:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 24 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.535995:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 24 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.536010:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653588864:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.536089:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.539844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.539966:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633568512 00000100:00100000:3.0:1787119518.539975:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633568512 00002000:00100000:3.0:1787119518.540021:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a634978000 x1873929633568512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.540032:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634978000 with x1873929633568512 ext(69632->73727) 00010000:00010000:3.0:1787119518.540041:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 25 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.540081:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 25 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.540090:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634978000 00000100:00100000:3.0:1787119518.540125:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1152 00000100:00100000:3.0:1787119518.540135:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633568512:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.540378:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633568512:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 244us (543us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.540387:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1152 00002000:00100000:3.0:1787119518.540393:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a634978000 x1873929633568512/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.540402:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634978000 with x1873929633568512 ext(69632->73727) 00010000:00010000:3.0:1787119518.540408:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 25 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.540423:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 25 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.540468:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634978000 00000100:00100000:2.0:1787119518.540946:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653588864:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.540975:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.540996:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92400, rc 0) 00000100:00100000:2.0:1787119518.541035:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+13:33957:x1873929633568384:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5185us (6070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.541042:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5186 00000100:00100000:0.0:1787119518.545090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.545184:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633568640 00000100:00100000:1.0:1787119518.545195:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633568640 00002000:00100000:1.0:1787119518.545247:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (61440->69631) req@ffff92a6181adc00 x1873929633568640/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 8680/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.545269:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adc00 with x1873929633568640 ext(61440->69631) 00010000:00010000:1.0:1787119518.545279:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 25 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.545311:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 25 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.545320:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6181adc00 00000100:00100000:1.0:1787119518.545353:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1153 00000100:00100000:1.0:1787119518.545364:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633568640:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119518.545872:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633568640:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 508us (803us total) trans 4294969227 rc 0/0 00000100:00100000:1.0:1787119518.545882:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1153 00002000:00100000:1.0:1787119518.545889:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (61440->69631) req@ffff92a6181adc00 x1873929633568640/t4294969227(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 8680/448 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.545899:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adc00 with x1873929633568640 ext(61440->69631) 00010000:00010000:1.0:1787119518.545913:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 27 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.545929:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 27 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.545936:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6181adc00 00000100:00100000:1.0:1787119518.549816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.550360:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633568768 00000100:00100000:2.0:1787119518.550371:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633568768 00000100:00100000:2.0:1787119518.550475:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5187 00000100:00100000:2.0:1787119518.550486:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633568768:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.550504:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.550523:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716190 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.550555:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 41) 00010000:00010000:2.0:1787119518.550560:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 41) 00010000:00010000:2.0:1787119518.550567:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.550580:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.550596:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:2.0:1787119518.550652:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633568768:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 167us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.550658:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5187 00000100:00100000:0.0:1787119518.552828:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.552919:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633568896 00000100:00100000:1.0:1787119518.552928:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633568896 00010000:00010000:1.0:1787119518.552975:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 28 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.553017:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5269 00000100:00100000:1.0:1787119518.553026:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633568896:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.553039:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.553059:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 28 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.553093:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 28 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.553118:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3ae2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [61440->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471617b expref: 28 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.553138:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 41) 00010000:00010000:1.0:1787119518.553142:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 41) 00010000:00010000:1.0:1787119518.553150:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.553159:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.553168:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 41) 00010000:00010000:1.0:1787119518.553170:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 41) 00010000:00010000:1.0:1787119518.553175:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.553183:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.553214:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.553227:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508fff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653588992:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.553321:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.553332:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653589120:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.553351:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.555413:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508fff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653588992:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119518.558981:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.559265:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653589120:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.559294:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.559355:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633568896:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6328us (6534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.559365:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5269 00000100:00100000:2.0:1787119518.559721:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633569024 00000100:00100000:2.0:1787119518.559729:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633569024 00002000:00100000:2.0:1787119518.559769:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (61440->69631) req@ffff92a6181ad880 x1873929633569024/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.559780:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ad880 with x1873929633569024 ext(61440->69631) 00002000:00010000:2.0:1787119518.559784:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ad880 00000100:00100000:2.0:1787119518.559813:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10601 00000100:00100000:2.0:1787119518.559821:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2374:x1873929633569024:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.560020:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2374:x1873929633569024:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 199us (1049us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119518.560027:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10601 00002000:00100000:2.0:1787119518.560033:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (61440->69631) req@ffff92a6181ad880 x1873929633569024/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/8632 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.560041:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ad880 with x1873929633569024 ext(61440->69631) 00002000:00010000:2.0:1787119518.560044:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181ad880 00000100:00100000:0.0:1787119518.564339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.564549:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633569152 00000100:00100000:2.0:1787119518.564560:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633569152 00000100:00100000:2.0:1787119518.564615:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5188 00000100:00100000:2.0:1787119518.564624:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+13:33957:x1873929633569152:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.564641:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.564660:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716197 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.564697:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 26 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.564712:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 41) 00010000:00010000:2.0:1787119518.564716:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 41) 00010000:00010000:2.0:1787119518.564721:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.564756:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 26 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.564780:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 26 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.564795:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653589248:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.564877:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.567596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.567690:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633569280 00000100:00100000:1.0:1787119518.567700:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633569280 00010000:00010000:1.0:1787119518.567738:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 27 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.567783:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5270 00000100:00100000:1.0:1787119518.567793:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633569280:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.567810:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.567833:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 27 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.567861:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 27 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.567889:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 41) 00010000:00010000:1.0:1787119518.567895:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 41) 00010000:00010000:1.0:1787119518.567904:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.567914:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.567964:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.567990:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653589376:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.568092:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466a80 going to sleep for 11 seconds 00010000:00010000:2.0:1787119518.569183:0:20843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3af7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716190 expref: 27 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.569203:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653589248:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.569231:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.569243:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92000, rc 0) 00000100:00100000:2.0:1787119518.569300:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+14:33957:x1873929633569152:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4676us (4971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.569311:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5188 00000100:00100000:0.0:1787119518.570901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.570997:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633569408 00000100:00100000:3.0:1787119518.571007:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633569408 00000100:00100000:3.0:1787119518.571059:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5189 00000100:00100000:3.0:1787119518.571078:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633569408:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119518.571096:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119518.571115:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471619e expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.571148:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.571157:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 41) 00010000:00010000:3.0:1787119518.571162:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 41) 00010000:00010000:3.0:1787119518.571167:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.571199:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.571225:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 13 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.571239:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653589504:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119518.571326:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.574847:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653589504:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.574886:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.574906:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:2.0:1787119518.574978:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633569408:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3910us (4084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.574988:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5189 00000100:00100000:1.0:1787119518.575230:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653589376:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.575245:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.575293:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633569280:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7501us (7706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.575303:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5270 00000100:00100000:3.0:1787119518.578770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.578867:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633569536 00000100:00100000:2.0:1787119518.578878:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633569536 00002000:00100000:2.0:1787119518.578928:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (69632->106495) req@ffff92a51282fb80 x1873929633569536/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.578952:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282fb80 with x1873929633569536 ext(69632->106495) 00010000:00010000:2.0:1787119518.578962:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.578995:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.579004:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282fb80 00000100:00100000:2.0:1787119518.579040:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1154 00000100:00100000:2.0:1787119518.579050:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2375:x1873929633569536:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.584547:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2375:x1873929633569536:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5487us (5777us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119518.584562:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1154 00002000:00100000:2.0:1787119518.584576:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (69632->106495) req@ffff92a51282fb80 x1873929633569536/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.584589:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282fb80 with x1873929633569536 ext(69632->106495) 00010000:00010000:2.0:1787119518.584600:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.584631:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.584641:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282fb80 00000100:00100000:3.0:1787119518.587319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.587421:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633569664 00000100:00100000:2.0:1787119518.587432:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633569664 00000100:00100000:2.0:1787119518.587519:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5190 00000100:00100000:2.0:1787119518.587529:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+14:33957:x1873929633569664:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.587546:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.587567:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161a5 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.587597:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 41) 00010000:00010000:2.0:1787119518.587606:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.587614:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 41) 00010000:00010000:2.0:1787119518.587620:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.587660:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.587674:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 15 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.587686:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:2.0:1787119518.587746:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+15:33957:x1873929633569664:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 218us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.587754:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5190 00000100:00100000:3.0:1787119518.590163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.590359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633569792 00000100:00100000:2.0:1787119518.590368:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633569792 00010000:00010000:2.0:1787119518.590405:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 15 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.590485:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5271 00000100:00100000:2.0:1787119518.590495:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+15:2376:x1873929633569792:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.590510:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.590533:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 15 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.590557:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 15 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.590588:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3afe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716197 expref: 15 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.590607:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 41) 00010000:00010000:2.0:1787119518.590613:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 41) 00010000:00010000:2.0:1787119518.590621:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.590631:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.590671:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.590686:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 26 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.590699:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653589760:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.590781:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.593806:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653589760:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.593834:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.593893:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2376:x1873929633569792:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3399us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.593905:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5271 00000100:00100000:3.0:1787119518.595400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.595581:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633569920 00000100:00100000:2.0:1787119518.595591:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633569920 00002000:00100000:2.0:1787119518.595637:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a51282e680 x1873929633569920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.595649:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e680 with x1873929633569920 ext(69632->73727) 00010000:00010000:2.0:1787119518.595659:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 27 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.595688:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 27 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.595696:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282e680 00000100:00100000:2.0:1787119518.595728:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1155 00000100:00100000:2.0:1787119518.595737:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633569920:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.595942:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633569920:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 205us (549us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.595950:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1155 00002000:00100000:2.0:1787119518.595957:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a51282e680 x1873929633569920/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.595965:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e680 with x1873929633569920 ext(69632->73727) 00010000:00010000:2.0:1787119518.595970:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 27 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.595996:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 27 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.596008:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282e680 00000100:00100000:3.0:1787119518.599307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.599400:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633570048 00000100:00100000:2.0:1787119518.599410:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633570048 00000100:00100000:2.0:1787119518.599490:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5191 00000100:00100000:2.0:1787119518.599501:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633570048:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.599518:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.599539:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161ac expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.599572:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 41) 00010000:00010000:2.0:1787119518.599581:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.599588:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 41) 00010000:00010000:2.0:1787119518.599593:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 28 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.599633:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.599648:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 28 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.599662:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92e00, rc 0) 00000100:00100000:2.0:1787119518.599722:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633570048:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 223us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.599730:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5191 00000100:00100000:1.0:1787119518.602554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.602650:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633570176 00000100:00100000:2.0:1787119518.602660:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633570176 00010000:00010000:2.0:1787119518.602699:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 28 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.602742:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5272 00000100:00100000:2.0:1787119518.602751:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2376:x1873929633570176:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.602766:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.602789:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 28 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.602816:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 28 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.602841:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471619e expref: 28 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.602858:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 41) 00010000:00010000:2.0:1787119518.602863:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 41) 00010000:00010000:2.0:1787119518.602872:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.602882:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.602927:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.602956:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 13 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.602971:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653590016:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.603057:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.606435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.606695:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653590016:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.606724:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.606792:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633570176:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4041us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.606804:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5272 00000100:00100000:0.0:1787119518.607061:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633570304 00000100:00100000:0.0:1787119518.607078:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633570304 00010000:00010000:0.0:1787119518.607113:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 14 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.607153:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5273 00000100:00100000:0.0:1787119518.607163:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2375:x1873929633570304:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119518.607179:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119518.607203:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 14 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.607231:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 14 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.607260:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161a5 expref: 14 pid: 6695 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.607275:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 41) 00010000:00010000:0.0:1787119518.607280:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 41) 00010000:00010000:0.0:1787119518.607290:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 26 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.607301:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 26 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.607338:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 26 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.607354:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653590144:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119518.607417:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.610990:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653590144:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119518.611021:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119518.611096:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2375:x1873929633570304:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3932us (4668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.611106:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5273 00000100:00100000:1.0:1787119518.621015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.622239:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633570432 00000100:00100000:2.0:1787119518.622318:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633570432 00000100:00100000:2.0:1787119518.622465:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5192 00000100:00100000:2.0:1787119518.622476:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+13:33957:x1873929633570432:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.622499:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.622523:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161b3 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.622560:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 26 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.622575:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 41) 00010000:00010000:2.0:1787119518.622579:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 41) 00010000:00010000:2.0:1787119518.622585:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.622621:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 26 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.622649:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 26 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.622663:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653590272:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.622831:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.624181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.626189:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653590272:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119518.626225:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.626248:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92000, rc 0) 00000100:00100000:1.0:1787119518.626356:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633570560 00000100:00100000:1.0:1787119518.626364:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633570560 00002000:00100000:1.0:1787119518.626407:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a508cfc000 x1873929633570560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.626417:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc000 with x1873929633570560 ext(69632->73727) 00010000:00010000:1.0:1787119518.626424:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 27 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.626475:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 27 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.626483:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfc000 00000100:00100000:1.0:1787119518.626510:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1156 00000100:00100000:1.0:1787119518.626519:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633570560:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.626858:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+14:33957:x1873929633570432:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4383us (5851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.626865:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5192 00000100:00100000:1.0:1787119518.626944:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633570560:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 425us (2769us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.626951:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1156 00002000:00100000:1.0:1787119518.626958:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a508cfc000 x1873929633570560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.626967:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc000 with x1873929633570560 ext(69632->73727) 00010000:00010000:1.0:1787119518.626973:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 27 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.626989:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 27 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.626997:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfc000 00000100:00100000:3.0:1787119518.631179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.631267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.631344:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633570816 00000100:00100000:1.0:1787119518.631354:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633570816 00010000:00010000:1.0:1787119518.631390:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 27 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.631435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5274 00000100:00100000:1.0:1787119518.631459:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2373:x1873929633570816:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.631473:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.631493:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 27 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.631518:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 27 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.631543:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ac expref: 27 pid: 8267 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.631559:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 41) 00010000:00010000:1.0:1787119518.631564:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 41) 00010000:00010000:1.0:1787119518.631572:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.631582:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.631619:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.631634:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653590400:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.631705:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.632275:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633570688 00000100:00100000:2.0:1787119518.632281:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633570688 00000100:00100000:2.0:1787119518.632327:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5193 00000100:00100000:2.0:1787119518.632336:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633570688:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.632350:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.632364:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161ba expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.632386:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.632400:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 41) 00010000:00010000:2.0:1787119518.632404:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 41) 00010000:00010000:2.0:1787119518.632409:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.632433:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.632479:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 13 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.632491:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512845c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653590528:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.632529:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.637195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.637302:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512845c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653590528:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119518.637334:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.637356:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:3.0:1787119518.637417:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633570688:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5081us (6248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.637425:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5193 00000100:00100000:0.0:1787119518.638771:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633570944 00000100:00100000:0.0:1787119518.638780:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633570944 00002000:00100000:0.0:1787119518.638827:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (69632->106495) req@ffff92a512845880 x1873929633570944/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.638838:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845880 with x1873929633570944 ext(69632->106495) 00010000:00010000:0.0:1787119518.638846:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.638874:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.638882:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845880 00000100:00100000:0.0:1787119518.638917:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1157 00000100:00100000:0.0:1787119518.638927:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2376:x1873929633570944:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.642629:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2376:x1873929633570944:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3689us (5430us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119518.642649:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1157 00002000:00100000:0.0:1787119518.642663:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (69632->106495) req@ffff92a512845880 x1873929633570944/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.642675:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845880 with x1873929633570944 ext(69632->106495) 00010000:00010000:0.0:1787119518.642686:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.642717:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.642725:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845880 00000100:00100000:1.0:1787119518.642841:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653590400:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.642864:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.642890:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2373:x1873929633570816:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11432us (11632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.642898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5274 00000100:00100000:3.0:1787119518.646059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.646840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.647099:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633571200 00000100:00100000:1.0:1787119518.647108:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633571200 00010000:00010000:1.0:1787119518.647149:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.647193:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5275 00000100:00100000:1.0:1787119518.647204:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2375:x1873929633571200:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.647220:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.647243:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.647277:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.647303:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161b3 expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.647320:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 41) 00010000:00010000:1.0:1787119518.647325:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 41) 00010000:00010000:1.0:1787119518.647334:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.647344:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.647384:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.647399:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653590656:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.647515:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.650126:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653590656:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.650153:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.650210:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2375:x1873929633571200:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3006us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.650221:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5275 00000100:00100000:0.0:1787119518.651504:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633571072 00000100:00100000:0.0:1787119518.651516:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633571072 00000100:00100000:1.0:1787119518.651642:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5194 00000100:00100000:1.0:1787119518.651652:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+13:33957:x1873929633571072:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.651672:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.651691:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161c1 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.651722:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.651738:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 41) 00010000:00010000:1.0:1787119518.651743:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 41) 00010000:00010000:1.0:1787119518.651748:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.651780:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.651805:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 26 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.651820:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653590784:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119518.651900:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.656828:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.657125:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653590784:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.657161:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.657183:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:2.0:1787119518.657249:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+14:33957:x1873929633571072:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5597us (11200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.657266:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5194 00000100:00100000:0.0:1787119518.658627:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633571328 00000100:00100000:0.0:1787119518.658638:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633571328 00010000:00010000:0.0:1787119518.658680:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 27 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.658765:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5276 00000100:00100000:0.0:1787119518.658775:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633571328:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119518.658790:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119518.658813:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 27 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.658840:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 27 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.658864:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3b21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161ba expref: 27 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.658879:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 41) 00010000:00010000:0.0:1787119518.658883:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 41) 00010000:00010000:0.0:1787119518.658891:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.658901:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.658951:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.658966:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653590912:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119518.659058:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.661634:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653590912:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119518.661658:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119518.661705:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633571328:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2930us (4887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.661716:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5276 00000100:00100000:1.0:1787119518.663642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.663726:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633571456 00000100:00100000:0.0:1787119518.663737:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633571456 00000100:00100000:0.0:1787119518.663791:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5195 00000100:00100000:0.0:1787119518.663801:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:33946:x1873929633571456:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119518.663819:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119518.663838:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161c8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.663869:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.663880:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 41) 00010000:00010000:0.0:1787119518.663884:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 41) 00010000:00010000:0.0:1787119518.663888:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.663924:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.663964:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 13 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.663989:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653591040:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119518.664086:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.666349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.666623:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633571584 00000100:00100000:2.0:1787119518.666632:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633571584 00010000:00010000:2.0:1787119518.666670:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 14 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.666716:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5277 00000100:00100000:2.0:1787119518.666727:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2373:x1873929633571584:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.666742:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.666766:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 14 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.666791:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 14 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.666817:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 41) 00010000:00010000:2.0:1787119518.666822:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 41) 00010000:00010000:2.0:1787119518.666830:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.666841:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.666877:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.666891:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512845180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653591168:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119518.667113:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3b28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c1 expref: 14 pid: 12469 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.667128:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653591040:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119518.667153:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.667163:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:2.0:1787119518.667309:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.667748:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633571456:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3947us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.667757:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5195 00000100:00100000:2.0:1787119518.671594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.671668:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633571712 00000100:00100000:3.0:1787119518.671679:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633571712 00002000:00100000:3.0:1787119518.671728:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a512845c00 x1873929633571712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.671740:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845c00 with x1873929633571712 ext(69632->73727) 00002000:00010000:3.0:1787119518.671746:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845c00 00000100:00100000:3.0:1787119518.671778:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10602 00000100:00100000:3.0:1787119518.671789:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633571712:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.673136:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633571712:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1341us (1545us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.673149:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10602 00002000:00100000:3.0:1787119518.673159:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a512845c00 x1873929633571712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.673169:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845c00 with x1873929633571712 ext(69632->73727) 00002000:00010000:3.0:1787119518.673174:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845c00 00000100:00100000:1.0:1787119518.673571:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512845180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653591168:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.673594:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119518.674353:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+13:2373:x1873929633571584:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7626us (8014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.674365:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5277 00000100:00100000:3.0:1787119518.674507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.677613:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633571840 00000100:00100000:1.0:1787119518.677628:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633571840 00000100:00100000:1.0:1787119518.677693:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5196 00000100:00100000:1.0:1787119518.677703:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+13:33957:x1873929633571840:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.677722:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.677742:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161cf expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.677775:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.677784:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 41) 00010000:00010000:1.0:1787119518.677789:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 41) 00010000:00010000:1.0:1787119518.677794:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.677832:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.677857:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 26 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.677874:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653591296:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119518.677968:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466300 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.678553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.682560:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633571968 00000100:00100000:3.0:1787119518.682577:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633571968 00002000:00100000:3.0:1787119518.682736:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (73728->77823) req@ffff92a512844380 x1873929633571968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.682749:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844380 with x1873929633571968 ext(73728->77823) 00010000:00010000:3.0:1787119518.682760:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 27 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.683552:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 27 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.683565:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844380 00000100:00100000:3.0:1787119518.683600:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1158 00000100:00100000:3.0:1787119518.683613:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633571968:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.684016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.684115:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653591296:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119518.684147:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.684182:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:1.0:1787119518.684212:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+14:33957:x1873929633571840:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6511us (9705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.684220:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5196 00000100:00100000:0.0:1787119518.684970:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633572096 00000100:00100000:0.0:1787119518.684980:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633572096 00002000:00100000:0.0:1787119518.685016:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a511f56a00 x1873929633572096/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 4584/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.685027:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56a00 with x1873929633572096 ext(69632->73727) 00010000:00010000:0.0:1787119518.685035:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 28 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.685059:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 28 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.685080:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f56a00 00000100:00100000:0.0:1787119518.685113:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1159 00000100:00100000:0.0:1787119518.685121:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633572096:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119518.685436:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2375:x1873929633572096:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 316us (1422us total) trans 4294969228 rc 0/0 00000100:00100000:0.0:1787119518.685467:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1159 00002000:00100000:0.0:1787119518.685474:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a511f56a00 x1873929633572096/t4294969228(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 4584/448 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.685481:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56a00 with x1873929633572096 ext(69632->73727) 00010000:00010000:0.0:1787119518.685487:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 30 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.685500:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 30 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.685506:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f56a00 00000100:00100000:3.0:1787119518.687736:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633571968:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4115us (9172us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.687750:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1158 00002000:00100000:3.0:1787119518.687764:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (73728->77823) req@ffff92a512844380 x1873929633571968/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.687773:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844380 with x1873929633571968 ext(73728->77823) 00010000:00010000:3.0:1787119518.687783:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 29 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.687814:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 29 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.687822:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844380 00010000:00010000:0.0:1787119518.690022:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119518.691773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.691832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.691942:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633572224 00000100:00100000:3.0:1787119518.691954:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633572224 00010000:00010000:3.0:1787119518.692013:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 29 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.692051:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5278 00000100:00100000:3.0:1787119518.692060:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633572224:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119518.692090:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119518.692115:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 29 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.692142:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 29 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.692171:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3b2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161c8 expref: 29 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.692188:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 41) 00010000:00010000:3.0:1787119518.692193:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 41) 00010000:00010000:3.0:1787119518.692202:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.692213:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.692251:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.692279:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653591424:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119518.692662:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633572352 00000100:00100000:0.0:1787119518.692668:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633572352 00000100:00100000:0.0:1787119518.692711:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5197 00000100:00100000:0.0:1787119518.692724:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633572352:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119518.692740:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119518.692755:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161d6 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.692777:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.692783:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 41) 00010000:00010000:0.0:1787119518.692786:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 41) 00010000:00010000:0.0:1787119518.692790:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 30 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.692817:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.692833:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 13 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.692844:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653591552:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119518.693134:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.694484:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119518.699704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.699800:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633572480 00000100:00100000:0.0:1787119518.699811:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633572480 00002000:00100000:0.0:1787119518.699860:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (69632->106495) req@ffff92a508ffea00 x1873929633572480/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.699873:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffea00 with x1873929633572480 ext(69632->106495) 00010000:00010000:0.0:1787119518.699882:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.699913:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.699922:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffea00 00000100:00100000:0.0:1787119518.699967:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1160 00000100:00100000:0.0:1787119518.699978:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2376:x1873929633572480:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.700671:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653591424:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.700698:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.700727:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2375:x1873929633572224:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8667us (8965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.700736:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5278 00000100:00100000:2.0:1787119518.703858:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653591552:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.703897:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 29 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.703920:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:2.0:1787119518.703988:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633572352:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11268us (12155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.703997:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5197 00000100:00100000:1.0:1787119518.705848:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2376:x1873929633572480:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5863us (6145us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119518.705862:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1160 00002000:00100000:1.0:1787119518.705875:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (69632->106495) req@ffff92a508ffea00 x1873929633572480/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.705886:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffea00 with x1873929633572480 ext(69632->106495) 00010000:00010000:1.0:1787119518.705897:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.705924:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119518.705942:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffea00 00000100:00100000:1.0:1787119518.709521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.709572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.709675:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633572736 00000100:00100000:3.0:1787119518.709686:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633572736 00010000:00010000:3.0:1787119518.709729:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.709762:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5279 00000100:00100000:3.0:1787119518.709771:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2375:x1873929633572736:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119518.709787:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119518.709811:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.709837:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.709861:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3b36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161cf expref: 14 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.709878:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 41) 00010000:00010000:3.0:1787119518.709883:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 41) 00010000:00010000:3.0:1787119518.709891:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.709901:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.709950:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.709965:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653591680:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.710054:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.710174:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633572608 00000100:00100000:2.0:1787119518.710179:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633572608 00000100:00100000:2.0:1787119518.710218:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5198 00000100:00100000:2.0:1787119518.710225:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+14:33957:x1873929633572608:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.710238:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.710251:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161dd expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.710267:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 41) 00010000:00010000:2.0:1787119518.710271:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 41) 00010000:00010000:2.0:1787119518.710277:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161dd expref: 15 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.710288:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161dd expref: 15 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.710297:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92000, rc 0) 00000100:00100000:2.0:1787119518.710325:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+15:33957:x1873929633572608:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 101us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.710332:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5198 00000100:00100000:3.0:1787119518.714181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.714332:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653591680:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119518.714357:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119518.714415:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2375:x1873929633572736:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4644us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.714426:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5279 00000100:00100000:2.0:1787119518.715205:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633572864 00000100:00100000:2.0:1787119518.715214:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633572864 00002000:00100000:2.0:1787119518.715267:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (73728->77823) req@ffff92a51282c380 x1873929633572864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.715279:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c380 with x1873929633572864 ext(73728->77823) 00002000:00010000:2.0:1787119518.715283:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c380 00000100:00100000:2.0:1787119518.715314:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10603 00000100:00100000:2.0:1787119518.715322:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633572864:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.715525:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633572864:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 203us (1354us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.715532:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10603 00002000:00100000:2.0:1787119518.715538:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (73728->77823) req@ffff92a51282c380 x1873929633572864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.715547:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c380 with x1873929633572864 ext(73728->77823) 00002000:00010000:2.0:1787119518.715550:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c380 00000100:00100000:3.0:1787119518.718983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.719098:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633572992 00000100:00100000:1.0:1787119518.719109:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633572992 00002000:00100000:1.0:1787119518.719156:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (77824->81919) req@ffff92a51282ca80 x1873929633572992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.719168:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ca80 with x1873929633572992 ext(77824->81919) 00002000:00010000:1.0:1787119518.719173:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ca80 00000100:00100000:1.0:1787119518.719210:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10604 00000100:00100000:1.0:1787119518.719219:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633572992:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.719428:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633572992:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 209us (461us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.719473:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10604 00002000:00100000:1.0:1787119518.719481:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (77824->81919) req@ffff92a51282ca80 x1873929633572992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.719490:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ca80 with x1873929633572992 ext(77824->81919) 00002000:00010000:1.0:1787119518.719493:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ca80 00000100:00100000:0.0:1787119518.723353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.723498:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633573120 00000100:00100000:1.0:1787119518.723509:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633573120 00002000:00100000:1.0:1787119518.723557:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff92a508cfed80 x1873929633573120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.723570:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633573120 ext(81920->86015) 00002000:00010000:1.0:1787119518.723576:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfed80 00000100:00100000:1.0:1787119518.723609:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10605 00000100:00100000:1.0:1787119518.723619:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633573120:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.723911:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633573120:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 292us (566us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.723922:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10605 00002000:00100000:1.0:1787119518.723934:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff92a508cfed80 x1873929633573120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.723943:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633573120 ext(81920->86015) 00002000:00010000:1.0:1787119518.723947:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508cfed80 00000100:00100000:1.0:1787119518.726912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.729148:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633573248 00000100:00100000:0.0:1787119518.729164:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633573248 00002000:00100000:0.0:1787119518.729224:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a519d19c00 x1873929633573248/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.729235:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19c00 with x1873929633573248 ext(69632->73727) 00002000:00010000:0.0:1787119518.729241:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19c00 00000100:00100000:0.0:1787119518.729291:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10606 00000100:00100000:0.0:1787119518.729301:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2376:x1873929633573248:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.729548:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+14:2376:x1873929633573248:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 247us (2645us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119518.729556:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10606 00002000:00100000:0.0:1787119518.729563:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (69632->73727) req@ffff92a519d19c00 x1873929633573248/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.729572:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19c00 with x1873929633573248 ext(69632->73727) 00002000:00010000:0.0:1787119518.729575:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19c00 00000100:00100000:3.0:1787119518.730677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.733583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.733681:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633573504 00000100:00100000:0.0:1787119518.733692:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633573504 00000100:00100000:0.0:1787119518.733755:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5199 00000100:00100000:0.0:1787119518.733765:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+14:33957:x1873929633573504:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119518.733787:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119518.733807:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161e4 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.733842:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.733852:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 41) 00010000:00010000:0.0:1787119518.733857:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 41) 00010000:00010000:0.0:1787119518.733862:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 15 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.733897:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.733925:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 28 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.733951:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653591808:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119518.734055:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.735967:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633573376 00000100:00100000:2.0:1787119518.735984:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633573376 00002000:00100000:2.0:1787119518.736044:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (86016->90111) req@ffff92a51282ea00 x1873929633573376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.736056:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ea00 with x1873929633573376 ext(86016->90111) 00010000:00010000:2.0:1787119518.736076:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 29 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.736105:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 29 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.736113:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282ea00 00000100:00100000:2.0:1787119518.736137:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1161 00000100:00100000:2.0:1787119518.736146:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633573376:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.736358:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633573376:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 213us (5686us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.736367:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1161 00002000:00100000:2.0:1787119518.736374:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (86016->90111) req@ffff92a51282ea00 x1873929633573376/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.736382:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ea00 with x1873929633573376 ext(86016->90111) 00010000:00010000:2.0:1787119518.736388:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 29 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.736402:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 29 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.736410:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282ea00 00000100:00100000:3.0:1787119518.738332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.738482:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653591808:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119518.738516:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 15 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.738537:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85000, rc 0) 00000100:00100000:0.0:1787119518.738591:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+15:33957:x1873929633573504:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4827us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.738600:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5199 00000100:00100000:3.0:1787119518.740663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.740752:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633573760 00000100:00100000:1.0:1787119518.740761:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633573760 00000100:00100000:1.0:1787119518.740817:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5200 00000100:00100000:1.0:1787119518.740827:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633573760:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119518.740845:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119518.740865:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161eb expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.740895:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 41) 00010000:00010000:1.0:1787119518.740900:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 41) 00010000:00010000:1.0:1787119518.740907:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 30 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.740920:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 30 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.740944:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119518.741003:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633573760:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 178us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119518.741010:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5200 00000100:00100000:2.0:1787119518.742416:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633573632 00000100:00100000:2.0:1787119518.742428:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633573632 00002000:00100000:2.0:1787119518.742486:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (73728->86015) req@ffff92a51282dc00 x1873929633573632/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 12776/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.742497:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282dc00 with x1873929633573632 ext(73728->86015) 00010000:00010000:2.0:1787119518.742506:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 30 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.742535:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 30 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.742543:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282dc00 00000100:00100000:2.0:1787119518.742622:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1162 00000100:00100000:2.0:1787119518.742631:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2375:x1873929633573632:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119518.743056:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2375:x1873929633573632:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 425us (4731us total) trans 4294969229 rc 0/0 00000100:00100000:2.0:1787119518.743076:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1162 00002000:00100000:2.0:1787119518.743084:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (73728->86015) req@ffff92a51282dc00 x1873929633573632/t4294969229(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 12776/448 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.743092:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282dc00 with x1873929633573632 ext(73728->86015) 00010000:00010000:2.0:1787119518.743098:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 32 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.743114:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 32 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.743121:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282dc00 00000100:00100000:0.0:1787119518.745679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.745771:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633573888 00000100:00100000:1.0:1787119518.745780:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633573888 00010000:00010000:1.0:1787119518.745823:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 32 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.745865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5280 00000100:00100000:1.0:1787119518.745874:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2375:x1873929633573888:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119518.745892:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119518.745916:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 32 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.745952:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 32 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.745989:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3b3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [73728->18446744073709551615] (req 73728->77823) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161d6 expref: 32 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.746007:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 41) 00010000:00010000:1.0:1787119518.746012:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 41) 00010000:00010000:1.0:1787119518.746021:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 14 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.746031:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 14 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.746047:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 41) 00010000:00010000:1.0:1787119518.746051:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 41) 00010000:00010000:1.0:1787119518.746056:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 31 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.746074:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 31 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119518.746113:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 31 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.746129:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653591936:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119518.746220:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 14 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119518.746231:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653592064:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119518.746256:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.750592:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653591936:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.750607:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653592064:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.750632:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.750683:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2375:x1873929633573888:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4809us (5013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.750695:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5280 00000100:00100000:0.0:1787119518.752361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.752473:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633574016 00000100:00100000:2.0:1787119518.752482:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633574016 00002000:00100000:2.0:1787119518.752526:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (73728->86015) req@ffff92a6068bf480 x1873929633574016/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.752537:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633574016 ext(73728->86015) 00002000:00010000:2.0:1787119518.752543:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf480 00000100:00100000:2.0:1787119518.752572:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10607 00000100:00100000:2.0:1787119518.752581:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+15:2375:x1873929633574016:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.752808:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+15:2375:x1873929633574016:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 227us (453us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119518.752815:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10607 00002000:00100000:2.0:1787119518.752821:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (73728->86015) req@ffff92a6068bf480 x1873929633574016/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/12728 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.752835:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633574016 ext(73728->86015) 00002000:00010000:2.0:1787119518.752838:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf480 00000100:00100000:0.0:1787119518.757430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.757834:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633574144 00000100:00100000:2.0:1787119518.757845:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633574144 00000100:00100000:2.0:1787119518.757903:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5201 00000100:00100000:2.0:1787119518.757913:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+15:33957:x1873929633574144:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.757941:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.757961:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161f2 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.757992:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 30 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.758001:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 41) 00010000:00010000:2.0:1787119518.758005:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 41) 00010000:00010000:2.0:1787119518.758010:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.758043:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 30 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.758080:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 30 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.758097:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653592192:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.758183:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.760703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.760805:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633574272 00000100:00100000:0.0:1787119518.760814:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633574272 00010000:00010000:0.0:1787119518.760853:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 31 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.760899:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5281 00000100:00100000:0.0:1787119518.760909:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2376:x1873929633574272:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119518.760925:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119518.760960:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 31 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.760995:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 31 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.761023:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 41) 00010000:00010000:0.0:1787119518.761028:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 41) 00010000:00010000:0.0:1787119518.761037:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.761047:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.761100:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.761115:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653592320:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119518.761195:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787119518.761807:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3b52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161eb expref: 31 pid: 20843 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.761824:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653592192:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.761850:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.761861:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92e00, rc 0) 00000100:00100000:2.0:1787119518.761909:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+16:33957:x1873929633574144:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3997us (4491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.761917:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5201 00000100:00100000:3.0:1787119518.767354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.767397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.767543:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653592320:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119518.767572:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119518.767634:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2376:x1873929633574272:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6726us (6940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.767646:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5281 00000100:00100000:1.0:1787119518.767747:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633574400 00000100:00100000:1.0:1787119518.767755:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633574400 00002000:00100000:1.0:1787119518.767800:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (86016->122879) req@ffff92a51282ed80 x1873929633574400/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.767811:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ed80 with x1873929633574400 ext(86016->122879) 00002000:00010000:1.0:1787119518.767816:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ed80 00000100:00100000:1.0:1787119518.767846:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10608 00000100:00100000:1.0:1787119518.767855:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2376:x1873929633574400:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.770646:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2376:x1873929633574400:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2780us (3289us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119518.770660:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10608 00002000:00100000:1.0:1787119518.770674:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (86016->122879) req@ffff92a51282ed80 x1873929633574400/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.770685:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ed80 with x1873929633574400 ext(86016->122879) 00002000:00010000:1.0:1787119518.770691:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ed80 00000100:00100000:2.0:1787119518.771721:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633574528 00000100:00100000:2.0:1787119518.771730:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633574528 00000100:00100000:2.0:1787119518.771782:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5202 00000100:00100000:2.0:1787119518.771792:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633574528:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119518.771808:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.771826:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047161f9 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.771860:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.771870:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 41) 00010000:00010000:2.0:1787119518.771875:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 41) 00010000:00010000:2.0:1787119518.771881:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.771913:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.772101:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 15 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.772117:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653592448:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119518.772230:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.777306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.777411:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633574656 00000100:00100000:2.0:1787119518.777423:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633574656 00002000:00100000:2.0:1787119518.777508:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (122880->159743) req@ffff92a606157b80 x1873929633574656/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.777521:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157b80 with x1873929633574656 ext(122880->159743) 00010000:00010000:2.0:1787119518.777532:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 16 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.777561:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 16 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.777570:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157b80 00000100:00100000:2.0:1787119518.777594:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1163 00000100:00100000:2.0:1787119518.777605:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2373:x1873929633574656:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.780387:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2373:x1873929633574656:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2773us (3079us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119518.780403:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1163 00002000:00100000:2.0:1787119518.780414:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (122880->159743) req@ffff92a606157b80 x1873929633574656/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.780425:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157b80 with x1873929633574656 ext(122880->159743) 00010000:00010000:2.0:1787119518.780434:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 16 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.780549:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 16 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.780559:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157b80 00000100:00100000:2.0:1787119518.782962:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653592448:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119518.783003:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.783026:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93000, rc 0) 00000100:00100000:2.0:1787119518.783099:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:33946:x1873929633574528:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11306us (15699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.783108:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5202 00000100:00100000:0.0:1787119518.785580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.785679:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633574784 00000100:00100000:3.0:1787119518.785689:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633574784 00000100:00100000:3.0:1787119518.785749:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5203 00000100:00100000:3.0:1787119518.785759:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+16:33957:x1873929633574784:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119518.785777:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119518.785795:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716200 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.785826:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 41) 00010000:00010000:3.0:1787119518.785832:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 41) 00010000:00010000:3.0:1787119518.785838:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.785852:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.785865:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:3.0:1787119518.785921:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+17:33957:x1873929633574784:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 164us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.785935:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5203 00000100:00100000:3.0:1787119518.788212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.788323:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633574912 00000100:00100000:0.0:1787119518.788333:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633574912 00002000:00100000:0.0:1787119518.788383:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (0->122879) req@ffff92a63dfba300 x1873929633574912/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.788395:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfba300 with x1873929633574912 ext(0->122879) 00010000:00010000:0.0:1787119518.788414:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 17 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.788479:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 17 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.788489:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dfba300 00000100:00100000:0.0:1787119518.788521:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1164 00000100:00100000:0.0:1787119518.788530:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+17:2376:x1873929633574912:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119518.793030:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+19:2376:x1873929633574912:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 4489us (4815us total) trans 4294969230 rc 0/0 00000100:00100000:0.0:1787119518.793045:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1164 00002000:00100000:0.0:1787119518.793059:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (0->122879) req@ffff92a63dfba300 x1873929633574912/t4294969230(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/448 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.793081:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfba300 with x1873929633574912 ext(0->122879) 00010000:00010000:0.0:1787119518.793102:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.793136:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119518.793146:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dfba300 00000100:00100000:3.0:1787119518.796990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.797178:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633575040 00000100:00100000:0.0:1787119518.797190:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633575040 00010000:00010000:0.0:1787119518.797233:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.797287:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5282 00000100:00100000:0.0:1787119518.797296:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+19:2375:x1873929633575040:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119518.797312:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119518.797336:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.797370:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.797397:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3b59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [86016->18446744073709551615] (req 86016->90111) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f2 expref: 19 pid: 6693 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.797415:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 41) 00010000:00010000:0.0:1787119518.797420:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 41) 00010000:00010000:0.0:1787119518.797430:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.797481:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.797491:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 41) 00010000:00010000:0.0:1787119518.797494:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 41) 00010000:00010000:0.0:1787119518.797500:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.797509:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119518.797544:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.797564:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653592576:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119518.797646:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119518.797657:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653592704:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119518.797688:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119518.802670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.802940:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653592576:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119518.802956:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653592704:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119518.802977:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119518.803043:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633575040:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5746us (6063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.803056:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5282 00000100:00100000:1.0:1787119518.803702:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633575168 00000100:00100000:1.0:1787119518.803711:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633575168 00002000:00100000:1.0:1787119518.803760:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (86016->90111) req@ffff92a62a121500 x1873929633575168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.803771:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121500 with x1873929633575168 ext(86016->90111) 00002000:00010000:1.0:1787119518.803776:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121500 00000100:00100000:1.0:1787119518.803806:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10609 00000100:00100000:1.0:1787119518.803815:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2375:x1873929633575168:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.804016:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2375:x1873929633575168:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 201us (1357us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.804023:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10609 00002000:00100000:1.0:1787119518.804029:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (86016->90111) req@ffff92a62a121500 x1873929633575168/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.804037:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121500 with x1873929633575168 ext(86016->90111) 00002000:00010000:1.0:1787119518.804041:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121500 00000100:00100000:0.0:1787119518.817003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.817078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.817211:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633575296 00000100:00100000:2.0:1787119518.817221:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633575296 00002000:00100000:2.0:1787119518.817282:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (90112->94207) req@ffff92a62a123800 x1873929633575296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.817295:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123800 with x1873929633575296 ext(90112->94207) 00002000:00010000:2.0:1787119518.817301:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123800 00000100:00100000:2.0:1787119518.817330:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633575424 00000100:00100000:2.0:1787119518.817334:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633575424 00002000:00100000:2.0:1787119518.817349:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (122880->126975) req@ffff92a62a121f80 x1873929633575424/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.817357:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121f80 with x1873929633575424 ext(122880->126975) 00002000:00010000:2.0:1787119518.817360:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121f80 00000100:00100000:2.0:1787119518.817384:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10610 00000100:00100000:2.0:1787119518.817392:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2374:x1873929633575296:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.817612:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2374:x1873929633575296:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 220us (621us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.817620:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10610 00002000:00100000:2.0:1787119518.817627:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (90112->94207) req@ffff92a62a123800 x1873929633575296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.817634:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123800 with x1873929633575296 ext(90112->94207) 00002000:00010000:2.0:1787119518.817637:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123800 00000100:00100000:2.0:1787119518.817654:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10611 00000100:00100000:2.0:1787119518.817661:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633575424:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.817733:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633575424:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 71us (653us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.817740:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10611 00002000:00100000:2.0:1787119518.817746:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (122880->126975) req@ffff92a62a121f80 x1873929633575424/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.817754:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121f80 with x1873929633575424 ext(122880->126975) 00002000:00010000:2.0:1787119518.817758:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121f80 00000100:00100000:2.0:1787119518.822249:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.822409:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633575552 00000100:00100000:1.0:1787119518.822420:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633575552 00002000:00100000:1.0:1787119518.822517:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (126976->131071) req@ffff92a512844e00 x1873929633575552/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.822527:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844e00 with x1873929633575552 ext(126976->131071) 00002000:00010000:1.0:1787119518.822532:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844e00 00000100:00100000:1.0:1787119518.822566:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10612 00000100:00100000:1.0:1787119518.822575:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633575552:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.822763:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633575552:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 189us (526us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.822771:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10612 00002000:00100000:1.0:1787119518.822778:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (126976->131071) req@ffff92a512844e00 x1873929633575552/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.822787:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844e00 with x1873929633575552 ext(126976->131071) 00002000:00010000:1.0:1787119518.822790:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844e00 00000100:00100000:0.0:1787119518.826174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.826290:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633575680 00000100:00100000:1.0:1787119518.826301:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633575680 00002000:00100000:1.0:1787119518.826364:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (94208->98303) req@ffff92a62a121880 x1873929633575680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.826376:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121880 with x1873929633575680 ext(94208->98303) 00002000:00010000:1.0:1787119518.826382:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121880 00000100:00100000:1.0:1787119518.826409:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10613 00000100:00100000:1.0:1787119518.826419:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2375:x1873929633575680:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.826661:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2375:x1873929633575680:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 242us (499us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.826669:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10613 00002000:00100000:1.0:1787119518.826676:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (94208->98303) req@ffff92a62a121880 x1873929633575680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.826684:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121880 with x1873929633575680 ext(94208->98303) 00002000:00010000:1.0:1787119518.826688:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a121880 00000100:00100000:0.0:1787119518.830274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.830378:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633575808 00000100:00100000:1.0:1787119518.830389:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633575808 00002000:00100000:1.0:1787119518.830476:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (131072->135167) req@ffff92a62a123480 x1873929633575808/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.830489:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123480 with x1873929633575808 ext(131072->135167) 00002000:00010000:1.0:1787119518.830495:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123480 00000100:00100000:1.0:1787119518.830529:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10614 00000100:00100000:1.0:1787119518.830538:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633575808:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.830769:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633575808:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 231us (516us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.830777:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10614 00002000:00100000:1.0:1787119518.830783:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (131072->135167) req@ffff92a62a123480 x1873929633575808/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.830792:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123480 with x1873929633575808 ext(131072->135167) 00002000:00010000:1.0:1787119518.830796:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123480 00000100:00100000:2.0:1787119518.839178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.839381:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633575936 00000100:00100000:3.0:1787119518.839394:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633575936 00002000:00100000:3.0:1787119518.839489:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (135168->139263) req@ffff92a512846a00 x1873929633575936/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.839500:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633575936 ext(135168->139263) 00002000:00010000:3.0:1787119518.839506:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846a00 00000100:00100000:3.0:1787119518.839544:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10615 00000100:00100000:3.0:1787119518.839555:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633575936:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.839792:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633575936:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 238us (625us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119518.839799:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10615 00002000:00100000:3.0:1787119518.839806:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (135168->139263) req@ffff92a512846a00 x1873929633575936/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.839814:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633575936 ext(135168->139263) 00002000:00010000:3.0:1787119518.839818:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846a00 00000100:00100000:0.0:1787119518.841342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.841872:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633576064 00000100:00100000:1.0:1787119518.841884:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633576064 00002000:00100000:1.0:1787119518.841930:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (98304->102399) req@ffff92a62a123b80 x1873929633576064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.841941:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123b80 with x1873929633576064 ext(98304->102399) 00002000:00010000:1.0:1787119518.841946:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123b80 00000100:00100000:1.0:1787119518.841980:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10616 00000100:00100000:1.0:1787119518.841989:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2376:x1873929633576064:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.842191:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2376:x1873929633576064:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 201us (856us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.842199:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10616 00002000:00100000:1.0:1787119518.842205:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (98304->102399) req@ffff92a62a123b80 x1873929633576064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.842214:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123b80 with x1873929633576064 ext(98304->102399) 00002000:00010000:1.0:1787119518.842218:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a123b80 00000100:00100000:0.0:1787119518.852899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.853013:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633576192 00000100:00100000:2.0:1787119518.853023:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633576192 00002000:00100000:2.0:1787119518.853245:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (139264->143359) req@ffff92a62a122300 x1873929633576192/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.853259:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a122300 with x1873929633576192 ext(139264->143359) 00002000:00010000:2.0:1787119518.853266:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a122300 00000100:00100000:2.0:1787119518.853303:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10617 00000100:00100000:2.0:1787119518.853312:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633576192:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.853601:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633576192:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 289us (711us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.853610:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10617 00002000:00100000:2.0:1787119518.853618:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (139264->143359) req@ffff92a62a122300 x1873929633576192/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.853626:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a122300 with x1873929633576192 ext(139264->143359) 00002000:00010000:2.0:1787119518.853630:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a122300 00000100:00100000:2.0:1787119518.857048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.860828:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633576320 00000100:00100000:3.0:1787119518.860846:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633576320 00002000:00100000:3.0:1787119518.860909:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (102400->106495) req@ffff92a512847100 x1873929633576320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.860922:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847100 with x1873929633576320 ext(102400->106495) 00002000:00010000:3.0:1787119518.861371:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847100 00000100:00100000:1.0:1787119518.861539:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10618 00000100:00100000:1.0:1787119518.861555:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2375:x1873929633576320:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.861763:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2375:x1873929633576320:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 214us (4726us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.861772:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10618 00002000:00100000:1.0:1787119518.861779:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (102400->106495) req@ffff92a512847100 x1873929633576320/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.861787:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847100 with x1873929633576320 ext(102400->106495) 00002000:00010000:1.0:1787119518.861790:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847100 00000100:00100000:1.0:1787119518.868162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.868206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.868492:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633576448 00000100:00100000:2.0:1787119518.868502:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633576448 00002000:00100000:2.0:1787119518.868552:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff92a519d19500 x1873929633576448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.868564:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19500 with x1873929633576448 ext(143360->147455) 00002000:00010000:2.0:1787119518.868569:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19500 00000100:00100000:2.0:1787119518.868596:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633576576 00000100:00100000:2.0:1787119518.868599:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633576576 00000100:00100000:0.0:1787119518.868605:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10619 00002000:00100000:2.0:1787119518.868616:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (106496->110591) req@ffff92a519d1aa00 x1873929633576576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787119518.868616:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633576448:12345-192.168.201.59@tcp:3:kworker.0 00002000:00100000:2.0:1787119518.868624:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1aa00 with x1873929633576576 ext(106496->110591) 00002000:00010000:2.0:1787119518.868627:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1aa00 00000100:00100000:2.0:1787119518.868664:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10620 00000100:00100000:2.0:1787119518.868670:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2374:x1873929633576576:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.868965:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633576448:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 351us (814us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119518.868973:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10619 00002000:00100000:0.0:1787119518.868980:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff92a519d19500 x1873929633576448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.868987:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19500 with x1873929633576448 ext(143360->147455) 00002000:00010000:0.0:1787119518.868991:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19500 00000100:00100000:0.0:1787119518.874224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.874307:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633576704 00000100:00100000:1.0:1787119518.874319:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633576704 00002000:00100000:1.0:1787119518.874372:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff92a62a122d80 x1873929633576704/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.874383:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a122d80 with x1873929633576704 ext(147456->151551) 00002000:00010000:1.0:1787119518.874388:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a122d80 00000100:00100000:1.0:1787119518.874422:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10621 00000100:00100000:1.0:1787119518.874433:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633576704:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.874934:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633576704:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 501us (723us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.874943:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10621 00002000:00100000:1.0:1787119518.874949:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff92a62a122d80 x1873929633576704/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.874958:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a122d80 with x1873929633576704 ext(147456->151551) 00002000:00010000:1.0:1787119518.874962:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a122d80 00000100:00100000:2.0:1787119518.876838:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2374:x1873929633576576:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 8154us (8618us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.876853:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10620 00002000:00100000:2.0:1787119518.876866:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (106496->110591) req@ffff92a519d1aa00 x1873929633576576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.876876:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1aa00 with x1873929633576576 ext(106496->110591) 00002000:00010000:2.0:1787119518.876882:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1aa00 00000100:00100000:3.0:1787119518.879336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.880494:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633576832 00000100:00100000:1.0:1787119518.880507:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633576832 00002000:00100000:1.0:1787119518.880561:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (110592->114687) req@ffff92a63dfbb480 x1873929633576832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.880573:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb480 with x1873929633576832 ext(110592->114687) 00002000:00010000:1.0:1787119518.880579:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb480 00000100:00100000:1.0:1787119518.880616:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10622 00000100:00100000:1.0:1787119518.880628:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2373:x1873929633576832:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.880733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.881001:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2373:x1873929633576832:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 373us (1674us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.881011:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10622 00002000:00100000:1.0:1787119518.881019:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (110592->114687) req@ffff92a63dfbb480 x1873929633576832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.881027:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb480 with x1873929633576832 ext(110592->114687) 00002000:00010000:1.0:1787119518.881031:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb480 00000100:00100000:1.0:1787119518.881049:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633576960 00000100:00100000:1.0:1787119518.881053:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633576960 00002000:00100000:1.0:1787119518.881083:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (151552->188415) req@ffff92a62a126300 x1873929633576960/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.881149:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126300 with x1873929633576960 ext(151552->188415) 00002000:00010000:1.0:1787119518.881153:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126300 00000100:00100000:1.0:1787119518.881173:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10623 00000100:00100000:1.0:1787119518.881180:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633576960:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.881993:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653592832:0@lo:400:kworker.0 00000100:00100000:2.0:1787119518.882052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119518.882129:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787119518.882136:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653593216:0@lo:400:kworker.0 00000100:00100000:2.0:1787119518.882165:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119518.882196:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653592960:0@lo:400:kworker.0 00000100:00100000:2.0:1787119518.882221:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119518.882238:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787119518.882244:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653593088:0@lo:400:kworker.0 00000100:00100000:2.0:1787119518.882273:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119518.882298:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653593216 00000100:00100000:0.0:1787119518.882304:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653593216 00000100:00100000:2.0:1787119518.882308:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653592832 00000100:00100000:2.0:1787119518.882310:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653592832 00000100:00100000:0.0:1787119518.882338:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653592960 00000100:00100000:2.0:1787119518.882340:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1787119518.882340:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653592960 00000100:00100000:2.0:1787119518.882347:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653592832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119518.882354:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653593088 00000100:00100000:0.0:1787119518.882356:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653593088 00000100:00100000:0.0:1787119518.882374:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1787119518.882381:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653593216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119518.882388:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653592832:12345-0@lo:400:kworker.0 Request processed in 42us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.882394:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1787119518.882413:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653593216:12345-0@lo:400:kworker.0 Request processed in 34us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.882419:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1787119518.882431:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1787119518.882436:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653592960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119518.882459:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653593216:0@lo:400:kworker.0 00000100:00100000:2.0:1787119518.882471:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653592832:0@lo:400:kworker.0 00000100:00100000:0.0:1787119518.882494:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653592960:12345-0@lo:400:kworker.0 Request processed in 58us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.882501:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1787119518.882512:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1787119518.882518:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653593088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119518.882546:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653593088:12345-0@lo:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119518.882552:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00080000:0.0:1787119518.882568:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119518.882589:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653593088:0@lo:400:kworker.0 00000100:00100000:0.0:1787119518.882599:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653592960:0@lo:400:kworker.0 00000100:00100000:1.0:1787119518.882723:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787119518.882733:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653593344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787119518.883057:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119518.883359:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653593344 00000100:00100000:2.0:1787119518.883364:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653593344 00000100:00100000:2.0:1787119518.883405:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787119518.883413:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873929653593344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787119518.883463:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 320143360 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1787119518.883504:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873929653593344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.883510:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787119518.883964:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653593344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119518.896886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.896954:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633577088 00000100:00100000:0.0:1787119518.896969:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633577088 00002000:00100000:0.0:1787119518.897027:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (114688->122879) req@ffff92a62a127800 x1873929633577088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.897039:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127800 with x1873929633577088 ext(114688->122879) 00002000:00010000:0.0:1787119518.897046:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127800 00000100:00100000:0.0:1787119518.897092:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10624 00000100:00100000:0.0:1787119518.897102:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2373:x1873929633577088:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.897339:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2373:x1873929633577088:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 238us (2225us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1787119518.897346:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10624 00002000:00100000:0.0:1787119518.897353:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (114688->122879) req@ffff92a62a127800 x1873929633577088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/8632 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.897361:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127800 with x1873929633577088 ext(114688->122879) 00002000:00010000:0.0:1787119518.897364:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127800 00000100:00100000:1.0:1787119518.900665:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633576960:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 19474us (19921us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119518.900680:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10623 00002000:00100000:1.0:1787119518.900695:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (151552->188415) req@ffff92a62a126300 x1873929633576960/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.900706:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126300 with x1873929633576960 ext(151552->188415) 00002000:00010000:1.0:1787119518.900713:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126300 00000100:00100000:2.0:1787119518.901474:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787119518.901494:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653593472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119518.901558:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119518.902079:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653593472 00000100:00100000:3.0:1787119518.902091:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653593472 00000100:00100000:3.0:1787119518.902137:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787119518.902146:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1873929653593472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119518.902169:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 853344256 pending 37486592 free 3828350976 avail 3826253824 00000100:00100000:3.0:1787119518.902218:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1873929653593472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.902226:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787119518.902280:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653593472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119518.905267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.905386:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633577216 00000100:00100000:3.0:1787119518.905396:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633577216 00000100:00100000:3.0:1787119518.905483:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5204 00000100:00100000:3.0:1787119518.905494:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:33946:x1873929633577216:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119518.905517:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119518.905536:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716207 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.905573:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.905584:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 41) 00010000:00010000:3.0:1787119518.905591:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 41) 00010000:00010000:3.0:1787119518.905597:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 32 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.905632:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.905671:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 17 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.905685:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfbad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653593600:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119518.905768:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.916541:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfbad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653593600:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119518.916584:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 32 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.916609:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1e00, rc 0) 00000100:00100000:3.0:1787119518.916685:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:33946:x1873929633577216:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11191us (11427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.916694:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5204 00000100:00100000:3.0:1787119518.927340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.927381:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633577344 00000100:00100000:3.0:1787119518.927392:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633577344 00000100:00100000:3.0:1787119518.930351:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5205 00000100:00100000:3.0:1787119518.930372:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33957:x1873929633577344:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119518.930399:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119518.930419:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471620e expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.930478:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(53 41) 00010000:00010000:3.0:1787119518.930485:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 41) 00010000:00010000:3.0:1787119518.930491:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.930505:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.930519:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1a00, rc 0) 00000100:00100000:3.0:1787119518.930592:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33957:x1873929633577344:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 227us (3265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.930599:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5205 00000100:00100000:1.0:1787119518.936374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.937091:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633577472 00000100:00100000:3.0:1787119518.937102:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633577472 00002000:00100000:3.0:1787119518.937154:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (122880->163839) req@ffff92a519d1ad80 x1873929633577472/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.937165:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1ad80 with x1873929633577472 ext(122880->163839) 00010000:00010000:3.0:1787119518.937174:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 19 pid: 6696 timeout: 1144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.937203:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 19 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.937218:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1ad80 00000100:00100000:3.0:1787119518.937248:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1165 00000100:00100000:3.0:1787119518.937258:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+19:2375:x1873929633577472:12345-192.168.201.59@tcp:4:kworker.0 00000100:00100000:3.0:1787119518.944783:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2375:x1873929633577472:12345-192.168.201.59@tcp:4:kworker.0 Request processed in 7517us (8410us total) trans 4294969231 rc 0/0 00000100:00100000:3.0:1787119518.944797:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1165 00002000:00100000:3.0:1787119518.944809:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (122880->163839) req@ffff92a519d1ad80 x1873929633577472/t4294969231(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/448 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 0/0 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.944821:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1ad80 with x1873929633577472 ext(122880->163839) 00010000:00010000:3.0:1787119518.944831:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 21 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.944860:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 21 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119518.944869:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1ad80 00000100:00100000:3.0:1787119518.948054:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.948158:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633577600 00000100:00100000:2.0:1787119518.948170:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633577600 00010000:00010000:2.0:1787119518.948215:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 21 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.948266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5283 00000100:00100000:2.0:1787119518.948278:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2375:x1873929633577600:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.948295:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787119518.948315:0:5835:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb blocks from disk: 1 -> 263 00010000:00010000:2.0:1787119518.948322:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 21 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.948349:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 21 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.948378:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3b67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [122880->18446744073709551615] (req 122880->126975) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716200 expref: 21 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.948397:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 41) 00010000:00010000:2.0:1787119518.948402:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 41) 00010000:00010000:2.0:1787119518.948411:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.948422:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.948431:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 41) 00010000:00010000:2.0:1787119518.948435:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 41) 00010000:00010000:2.0:1787119518.948473:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.948482:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.948521:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.948537:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634967800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653593728:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.948629:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.948653:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653593856:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.948679:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.954032:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653593856:192.168.201.59@tcp:105: 00000001:00080000:1.0:1787119518.961657:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969230 is committed 00000001:00080000:1.0:1787119518.961677:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969228 is committed 00000001:00080000:1.0:1787119518.961728:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969229 is committed 00000001:00080000:1.0:1787119518.961736:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969223 is committed 00000100:00100000:0.0:1787119518.962326:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.962399:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633577728 00000100:00100000:3.0:1787119518.962407:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633577728 00002000:00100000:3.0:1787119518.962479:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (122880->159743) req@ffff92a62a127480 x1873929633577728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119518.962491:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127480 with x1873929633577728 ext(122880->159743) 00002000:00010000:3.0:1787119518.962496:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127480 00000100:00100000:3.0:1787119518.962527:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10625 00000100:00100000:3.0:1787119518.962536:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633577728:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.964832:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634967800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653593728:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.964865:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.964931:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633577600:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 16647us (16880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.964943:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5283 00000100:00100000:3.0:1787119518.968184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119518.968288:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633577856 00000100:00100000:1.0:1787119518.968298:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633577856 00002000:00100000:1.0:1787119518.968347:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (163840->167935) req@ffff92a63dfbb800 x1873929633577856/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.968359:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb800 with x1873929633577856 ext(163840->167935) 00002000:00010000:1.0:1787119518.968365:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb800 00000100:00100000:1.0:1787119518.968399:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10626 00000100:00100000:1.0:1787119518.968408:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633577856:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119518.968698:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633577856:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 290us (523us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119518.968707:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10626 00002000:00100000:1.0:1787119518.968714:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (163840->167935) req@ffff92a63dfbb800 x1873929633577856/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119518.968722:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb800 with x1873929633577856 ext(163840->167935) 00002000:00010000:1.0:1787119518.968725:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfbb800 00000100:00100000:2.0:1787119518.969964:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633577728:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7421us (7635us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119518.969975:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10625 00002000:00100000:2.0:1787119518.969986:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (122880->159743) req@ffff92a62a127480 x1873929633577728/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/440 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.969995:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127480 with x1873929633577728 ext(122880->159743) 00002000:00010000:2.0:1787119518.970000:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127480 00000100:00100000:2.0:1787119518.972574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.972889:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633577984 00000100:00100000:0.0:1787119518.972899:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633577984 00002000:00100000:0.0:1787119518.972963:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (167936->172031) req@ffff92a634967800 x1873929633577984/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.972975:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967800 with x1873929633577984 ext(167936->172031) 00002000:00010000:0.0:1787119518.972981:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634967800 00000100:00100000:0.0:1787119518.973083:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10627 00000100:00100000:0.0:1787119518.973095:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633577984:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119518.973363:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633577984:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 270us (799us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119518.973371:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10627 00002000:00100000:0.0:1787119518.973378:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (167936->172031) req@ffff92a634967800 x1873929633577984/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119518.973387:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967800 with x1873929633577984 ext(167936->172031) 00002000:00010000:0.0:1787119518.973391:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634967800 00000100:00100000:0.0:1787119518.977081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.977179:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633578112 00000100:00100000:2.0:1787119518.977190:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633578112 00002000:00100000:2.0:1787119518.977236:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (159744->163839) req@ffff92a62a124700 x1873929633578112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.977248:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124700 with x1873929633578112 ext(159744->163839) 00002000:00010000:2.0:1787119518.977254:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a124700 00000100:00100000:2.0:1787119518.977289:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10628 00000100:00100000:2.0:1787119518.977301:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633578112:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.977517:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633578112:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 218us (457us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.977524:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10628 00002000:00100000:2.0:1787119518.977531:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (159744->163839) req@ffff92a62a124700 x1873929633578112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.977539:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a124700 with x1873929633578112 ext(159744->163839) 00002000:00010000:2.0:1787119518.977542:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a124700 00000100:00100000:3.0:1787119518.978625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.978693:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633578240 00000100:00100000:2.0:1787119518.978701:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633578240 00002000:00100000:2.0:1787119518.978738:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (172032->176127) req@ffff92a63dfb9f80 x1873929633578240/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.978767:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633578240 ext(172032->176127) 00002000:00010000:2.0:1787119518.978772:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000100:00100000:2.0:1787119518.978802:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10629 00000100:00100000:2.0:1787119518.978810:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633578240:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119518.979018:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633578240:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 208us (396us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119518.979025:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10629 00002000:00100000:2.0:1787119518.979031:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (172032->176127) req@ffff92a63dfb9f80 x1873929633578240/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.979044:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9f80 with x1873929633578240 ext(172032->176127) 00002000:00010000:2.0:1787119518.979048:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9f80 00000100:00100000:0.0:1787119518.983684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.983837:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633578496 00000100:00100000:2.0:1787119518.983850:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633578496 00000100:00100000:0.0:1787119518.983856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:2.0:1787119518.983898:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a62a126d80 x1873929633578496/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.983909:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126d80 with x1873929633578496 ext(176128->180223) 00002000:00010000:2.0:1787119518.983914:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126d80 00000100:00100000:2.0:1787119518.983946:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10630 00000100:00100000:2.0:1787119518.983956:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633578496:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119518.984112:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633578368 00000100:00100000:3.0:1787119518.984117:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633578368 00000100:00100000:3.0:1787119518.984188:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5206 00000100:00100000:3.0:1787119518.984197:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:33946:x1873929633578368:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119518.984207:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119518.984224:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716215 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.984251:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.984260:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 41) 00010000:00010000:3.0:1787119518.984265:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 41) 00000100:00100000:2.0:1787119518.984270:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633578496:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 311us (593us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1787119518.984274:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.984285:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10630 00002000:00100000:2.0:1787119518.984294:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a62a126d80 x1873929633578496/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.984304:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126d80 with x1873929633578496 ext(176128->180223) 00010000:00010000:2.0:1787119518.984311:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.984313:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.984335:0:19246:0:(ldlm_lockd.c:595:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 18 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.984343:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a126d80 00010000:00010000:3.0:1787119518.984351:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 18 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119518.984372:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653593984:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119518.985693:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119518.989219:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653593984:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119518.989254:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 9 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.989276:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0800, rc 0) 00000100:00100000:3.0:1787119518.989337:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:33946:x1873929633578368:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5137us (5477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.989346:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5206 00000100:00100000:1.0:1787119518.990689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119518.990707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119518.990794:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633578752 00000100:00100000:3.0:1787119518.990802:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633578752 00000100:00100000:2.0:1787119518.991027:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633578624 00000100:00100000:2.0:1787119518.991033:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633578624 00000100:00100000:3.0:1787119518.991058:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5207 00002000:00100000:2.0:1787119518.991082:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (163840->176127) req@ffff92a519d1b100 x1873929633578624/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 12776/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787119518.991084:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33957:x1873929633578752:12345-192.168.201.59@tcp:101:mmap_sanity.0 00002000:00100000:2.0:1787119518.991099:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b100 with x1873929633578624 ext(163840->176127) 00010000:00010000:3.0:1787119518.991102:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119518.991111:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 19 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.991120:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471621c expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.991145:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 20 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.991150:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 41) 00002000:00010000:2.0:1787119518.991159:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1b100 00010000:00010000:3.0:1787119518.991160:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 41) 00010000:00010000:3.0:1787119518.991171:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119518.991185:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.991195:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1166 00010000:00010000:3.0:1787119518.991198:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:2.0:1787119518.991206:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2376:x1873929633578624:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119518.991247:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+20:33957:x1873929633578752:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 166us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119518.991254:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5207 00000100:00100000:2.0:1787119518.992139:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2376:x1873929633578624:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 932us (1453us total) trans 4294969232 rc 0/0 00000100:00100000:2.0:1787119518.992148:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1166 00002000:00100000:2.0:1787119518.992156:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (163840->176127) req@ffff92a519d1b100 x1873929633578624/t4294969232(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:554/0 lens 12776/448 e 0 to 0 dl 1787119529 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119518.992166:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b100 with x1873929633578624 ext(163840->176127) 00010000:00010000:2.0:1787119518.992173:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 21 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.992195:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 21 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119518.992203:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1b100 00000100:00100000:0.0:1787119518.995262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119518.995364:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633578880 00000100:00100000:2.0:1787119518.995373:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633578880 00010000:00010000:2.0:1787119518.995408:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 21 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.995479:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5284 00000100:00100000:2.0:1787119518.995488:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2374:x1873929633578880:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119518.995506:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119518.995526:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 21 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.995550:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 21 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.995579:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3b75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [163840->18446744073709551615] (req 163840->167935) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471620e expref: 21 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.995595:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 41) 00010000:00010000:2.0:1787119518.995600:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 41) 00010000:00010000:2.0:1787119518.995608:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 8 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.995627:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 8 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.995636:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 41) 00010000:00010000:2.0:1787119518.995639:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 41) 00010000:00010000:2.0:1787119518.995643:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.995652:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119518.995688:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.995703:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653594112:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.995778:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 8 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119518.995788:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653594240:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.995808:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119518.998228:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653594112:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119518.998244:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653594240:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119518.998267:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119518.998660:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2374:x1873929633578880:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3171us (3406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119518.998671:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5284 00000100:00100000:3.0:1787119518.999755:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.000034:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633579008 00000100:00100000:0.0:1787119519.000043:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633579008 00002000:00100000:0.0:1787119519.000103:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (163840->176127) req@ffff92a63dfb9500 x1873929633579008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/0 e 0 to 0 dl 1787119529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.000113:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9500 with x1873929633579008 ext(163840->176127) 00002000:00010000:0.0:1787119519.000120:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9500 00000100:00100000:0.0:1787119519.000194:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10631 00000100:00100000:0.0:1787119519.000205:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633579008:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.000540:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633579008:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 336us (790us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1787119519.000552:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10631 00002000:00100000:0.0:1787119519.000560:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (163840->176127) req@ffff92a63dfb9500 x1873929633579008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:554/0 lens 488/12728 e 0 to 0 dl 1787119529 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.000570:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9500 with x1873929633579008 ext(163840->176127) 00002000:00010000:0.0:1787119519.000574:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9500 00000100:00100000:0.0:1787119519.009288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.013096:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633579136 00000100:00100000:3.0:1787119519.013114:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633579136 00000100:00100000:0.0:1787119519.013370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.013919:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633579264 00000100:00100000:1.0:1787119519.013923:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633579264 00002000:00100000:1.0:1787119519.013962:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a50512ed80 x1873929633579264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.014027:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ed80 with x1873929633579264 ext(176128->180223) 00002000:00010000:1.0:1787119519.014032:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ed80 00000100:00100000:1.0:1787119519.014065:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10632 00000100:00100000:1.0:1787119519.014076:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2376:x1873929633579264:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119519.014284:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2376:x1873929633579264:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 209us (916us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119519.014293:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10632 00002000:00100000:1.0:1787119519.014300:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a50512ed80 x1873929633579264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.014309:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ed80 with x1873929633579264 ext(176128->180223) 00002000:00010000:1.0:1787119519.014313:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ed80 00000100:00100000:2.0:1787119519.016909:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5208 00000100:00100000:2.0:1787119519.016922:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:33946:x1873929633579136:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.016941:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.016961:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716223 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.016996:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 19 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.017007:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 41) 00010000:00010000:2.0:1787119519.017011:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 41) 00010000:00010000:2.0:1787119519.017017:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.017053:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 19 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.017089:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 19 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.017105:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653594368:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.017186:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.018725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.018882:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633579392 00000100:00100000:2.0:1787119519.018892:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633579392 00002000:00100000:2.0:1787119519.018936:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a50512c700 x1873929633579392/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.018946:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c700 with x1873929633579392 ext(180224->184319) 00010000:00010000:2.0:1787119519.018954:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.018991:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.019001:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c700 00000100:00100000:2.0:1787119519.019036:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1167 00000100:00100000:2.0:1787119519.019045:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2373:x1873929633579392:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.019255:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2373:x1873929633579392:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 210us (537us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.019263:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1167 00002000:00100000:2.0:1787119519.019270:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a50512c700 x1873929633579392/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.019278:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c700 with x1873929633579392 ext(180224->184319) 00010000:00010000:2.0:1787119519.019283:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.019296:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.019303:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c700 00000100:00100000:3.0:1787119519.020675:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653594368:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.020711:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.020733:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:3.0:1787119519.020785:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:33946:x1873929633579136:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3864us (11507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.020792:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5208 00000100:00100000:3.0:1787119519.021249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.021346:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633579520 00000100:00100000:0.0:1787119519.021351:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633579520 00002000:00100000:0.0:1787119519.021383:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a63dfb8700 x1873929633579520/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 4584/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.021390:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633579520 ext(176128->180223) 00010000:00010000:0.0:1787119519.021395:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.021416:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 20 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.021421:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dfb8700 00000100:00100000:0.0:1787119519.021468:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1168 00000100:00100000:0.0:1787119519.021476:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2375:x1873929633579520:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119519.021813:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633579520:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 337us (563us total) trans 4294969233 rc 0/0 00000100:00100000:0.0:1787119519.021823:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1168 00002000:00100000:0.0:1787119519.021830:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a63dfb8700 x1873929633579520/t4294969233(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 4584/448 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.021848:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb8700 with x1873929633579520 ext(176128->180223) 00010000:00010000:0.0:1787119519.021853:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 22 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.021863:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 22 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.021868:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dfb8700 00000100:00100000:0.0:1787119519.028400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.028521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.028599:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633579776 00000100:00100000:1.0:1787119519.028609:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633579776 00010000:00010000:1.0:1787119519.028650:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 22 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.028697:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5285 00000100:00100000:1.0:1787119519.028707:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2374:x1873929633579776:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.028723:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.028746:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 22 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.028773:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 22 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.028799:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3b83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471621c expref: 22 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.028818:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 41) 00010000:00010000:1.0:1787119519.028823:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 41) 00010000:00010000:1.0:1787119519.028831:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.028854:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.028890:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.028905:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653594496:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.028997:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.029364:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633579648 00000100:00100000:3.0:1787119519.029369:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633579648 00000100:00100000:3.0:1787119519.029476:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5209 00000100:00100000:3.0:1787119519.029486:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633579648:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.029498:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.029509:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471622a expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.029529:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.029534:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 41) 00010000:00010000:3.0:1787119519.029537:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 41) 00010000:00010000:3.0:1787119519.029539:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 23 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.029554:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.029566:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 9 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.029574:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653594624:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119519.029609:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.033024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.033147:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653594496:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.033174:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.033230:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2374:x1873929633579776:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4523us (4708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.033245:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5285 00000100:00100000:3.0:1787119519.033682:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653594624:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.033706:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 22 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.033730:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119519.033769:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633579648:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4285us (5379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.033780:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5209 00000100:00100000:2.0:1787119519.036722:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633579904 00000100:00100000:2.0:1787119519.036738:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633579904 00002000:00100000:2.0:1787119519.036799:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (176128->212991) req@ffff92a50512d180 x1873929633579904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.036811:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d180 with x1873929633579904 ext(176128->212991) 00010000:00010000:2.0:1787119519.036821:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.036939:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.036949:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512d180 00000100:00100000:2.0:1787119519.037227:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1169 00000100:00100000:2.0:1787119519.037239:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633579904:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119519.041390:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633579904:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4144us (8367us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119519.041404:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1169 00002000:00100000:3.0:1787119519.041417:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (176128->212991) req@ffff92a50512d180 x1873929633579904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.041428:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d180 with x1873929633579904 ext(176128->212991) 00010000:00010000:3.0:1787119519.041456:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.041486:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.041494:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512d180 00000100:00100000:2.0:1787119519.049184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.049279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.049391:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633580160 00000100:00100000:1.0:1787119519.049402:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633580160 00010000:00010000:1.0:1787119519.049480:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.049530:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5286 00000100:00100000:1.0:1787119519.049540:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633580160:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.049557:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.049582:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.049610:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.049638:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3b8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [176128->18446744073709551615] (req 176128->180223) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716223 expref: 10 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.049656:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 41) 00010000:00010000:1.0:1787119519.049662:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 41) 00010000:00010000:1.0:1787119519.049671:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.049682:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.049724:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.049739:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653594752:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.049822:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.054517:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633580032 00000100:00100000:3.0:1787119519.054533:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633580032 00000100:00100000:3.0:1787119519.054690:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653594752:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.054717:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.054733:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5210 00000100:00100000:2.0:1787119519.054746:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:33946:x1873929633580032:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.054764:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.054787:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716231 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.054816:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 41) 00010000:00010000:2.0:1787119519.054821:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 41) 00000100:00100000:3.0:1787119519.054828:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633580160:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5286us (5546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.054839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5286 00010000:00010000:2.0:1787119519.054845:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716231 expref: 11 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.054863:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716231 expref: 10 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.054873:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93200, rc 0) 00000100:00100000:2.0:1787119519.054893:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:33946:x1873929633580032:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 151us (5720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.054897:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5210 00000100:00100000:0.0:1787119519.065002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.065555:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633580288 00000100:00100000:2.0:1787119519.065566:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633580288 00002000:00100000:2.0:1787119519.065625:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a50512fb80 x1873929633580288/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.065636:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512fb80 with x1873929633580288 ext(180224->184319) 00002000:00010000:2.0:1787119519.065643:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512fb80 00000100:00100000:2.0:1787119519.065675:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10633 00000100:00100000:2.0:1787119519.065685:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2373:x1873929633580288:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.065896:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2373:x1873929633580288:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 212us (902us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.065904:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10633 00002000:00100000:2.0:1787119519.065910:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a50512fb80 x1873929633580288/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.065919:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512fb80 with x1873929633580288 ext(180224->184319) 00002000:00010000:2.0:1787119519.065922:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512fb80 00000100:00100000:1.0:1787119519.070536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.070603:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633580416 00000100:00100000:2.0:1787119519.070625:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633580416 00002000:00100000:2.0:1787119519.070717:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (184320->188415) req@ffff92a519d18000 x1873929633580416/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.070731:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18000 with x1873929633580416 ext(184320->188415) 00002000:00010000:2.0:1787119519.070737:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18000 00000100:00100000:2.0:1787119519.070771:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10634 00000100:00100000:2.0:1787119519.070780:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2374:x1873929633580416:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.071032:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2374:x1873929633580416:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 252us (505us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.071041:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10634 00002000:00100000:2.0:1787119519.071050:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (184320->188415) req@ffff92a519d18000 x1873929633580416/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.071072:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18000 with x1873929633580416 ext(184320->188415) 00002000:00010000:2.0:1787119519.071076:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18000 00000100:00100000:1.0:1787119519.071544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.072954:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633580544 00000100:00100000:0.0:1787119519.072967:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633580544 00002000:00100000:0.0:1787119519.073016:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a519d19180 x1873929633580544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.073028:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19180 with x1873929633580544 ext(176128->180223) 00002000:00010000:0.0:1787119519.073034:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19180 00000100:00100000:0.0:1787119519.073081:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10635 00000100:00100000:0.0:1787119519.073090:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633580544:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.073270:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633580544:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 180us (1728us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119519.073278:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10635 00002000:00100000:0.0:1787119519.073285:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a519d19180 x1873929633580544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.073294:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19180 with x1873929633580544 ext(176128->180223) 00002000:00010000:0.0:1787119519.073297:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19180 00000100:00100000:3.0:1787119519.076506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.076681:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633580672 00000100:00100000:1.0:1787119519.076690:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633580672 00000100:00100000:1.0:1787119519.076757:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5211 00000100:00100000:1.0:1787119519.076767:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:33946:x1873929633580672:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.076786:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.076809:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716238 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.076849:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.076859:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 41) 00010000:00010000:1.0:1787119519.076863:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 41) 00010000:00010000:1.0:1787119519.076868:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.076900:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.076933:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 21 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.076948:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653594880:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119519.077043:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.079758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.079952:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653594880:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.079989:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.080013:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:3.0:1787119519.080084:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:33946:x1873929633580672:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3318us (3592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.080094:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5211 00000100:00100000:0.0:1787119519.080152:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633580800 00000100:00100000:0.0:1787119519.080161:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633580800 00002000:00100000:0.0:1787119519.080203:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a5098a5500 x1873929633580800/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 4584/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.080214:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633580800 ext(180224->184319) 00010000:00010000:0.0:1787119519.080221:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 22 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.080251:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 22 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.080259:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5500 00000100:00100000:0.0:1787119519.080342:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1170 00000100:00100000:0.0:1787119519.080353:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633580800:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119519.080756:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2375:x1873929633580800:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 403us (1006us total) trans 4294969234 rc 0/0 00000100:00100000:0.0:1787119519.080763:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1170 00002000:00100000:0.0:1787119519.080770:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a5098a5500 x1873929633580800/t4294969234(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 4584/448 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.080789:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633580800 ext(180224->184319) 00010000:00010000:0.0:1787119519.080797:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 24 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.080814:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 24 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.080821:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5500 00000100:00100000:1.0:1787119519.083902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.083978:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633580928 00000100:00100000:2.0:1787119519.083987:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633580928 00010000:00010000:2.0:1787119519.084022:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 24 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.084072:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5287 00000100:00100000:2.0:1787119519.084082:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2373:x1873929633580928:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119519.084097:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119519.084119:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 24 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.084146:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 24 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.084172:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3b91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471622a expref: 24 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.084189:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 41) 00010000:00010000:2.0:1787119519.084194:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 41) 00010000:00010000:2.0:1787119519.084202:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 10 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.084213:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 10 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.084251:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 10 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.084272:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634966300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653595008:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119519.084358:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.085960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.086089:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633581056 00000100:00100000:3.0:1787119519.086098:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633581056 00000100:00100000:3.0:1787119519.086153:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5212 00000100:00100000:3.0:1787119519.086163:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+24:33957:x1873929633581056:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.086178:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.086194:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471623f expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.086225:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 10 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.086235:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 41) 00010000:00010000:3.0:1787119519.086239:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 41) 00010000:00010000:3.0:1787119519.086244:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.086287:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 10 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.086311:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 10 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.086325:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653595136:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119519.086435:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.091414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.091459:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634966300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653595008:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.091486:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.091548:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2373:x1873929633580928:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7464us (7653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.091548:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653595136:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.091566:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5287 00010000:00010000:1.0:1787119519.091579:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.091601:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:1.0:1787119519.091628:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+24:33957:x1873929633581056:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5468us (5677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.091636:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5212 00000100:00100000:3.0:1787119519.091868:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633581184 00000100:00100000:3.0:1787119519.091877:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633581184 00002000:00100000:3.0:1787119519.091929:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (180224->217087) req@ffff92a5098a4380 x1873929633581184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.091940:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4380 with x1873929633581184 ext(180224->217087) 00010000:00010000:3.0:1787119519.091949:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.091976:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.091984:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4380 00000100:00100000:3.0:1787119519.092010:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1171 00000100:00100000:3.0:1787119519.092020:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633581184:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.096018:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633581184:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3989us (4604us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119519.096033:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1171 00002000:00100000:0.0:1787119519.096046:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (180224->217087) req@ffff92a5098a4380 x1873929633581184/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.096067:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4380 with x1873929633581184 ext(180224->217087) 00010000:00010000:0.0:1787119519.096079:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.096112:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.096121:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4380 00000100:00100000:3.0:1787119519.101579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.101631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.101730:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633581440 00000100:00100000:1.0:1787119519.101739:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633581440 00010000:00010000:1.0:1787119519.101781:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.101825:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5288 00000100:00100000:1.0:1787119519.101835:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633581440:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.101851:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.101875:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.101901:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.101925:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3b9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->18446744073709551615] (req 180224->184319) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716238 expref: 11 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.101944:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 41) 00010000:00010000:1.0:1787119519.101950:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 41) 00010000:00010000:1.0:1787119519.101959:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.101971:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.102018:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.102034:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653595264:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.102124:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.102186:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633581312 00000100:00100000:0.0:1787119519.102191:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633581312 00000100:00100000:0.0:1787119519.102232:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5213 00000100:00100000:0.0:1787119519.102239:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:33946:x1873929633581312:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.102262:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.102276:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716246 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.102294:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 41) 00010000:00010000:0.0:1787119519.102298:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 41) 00010000:00010000:0.0:1787119519.102305:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716246 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.102318:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716246 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.102328:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85800, rc 0) 00000100:00100000:0.0:1787119519.102358:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633581312:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 119us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.102365:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5213 00000100:00100000:3.0:1787119519.109769:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653595264:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.109799:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.109864:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633581440:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8030us (8230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.109877:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5288 00000100:00100000:2.0:1787119519.122747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.123035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.123100:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633581568 00000100:00100000:2.0:1787119519.123110:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633581568 00002000:00100000:2.0:1787119519.123160:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a634966300 x1873929633581568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.123172:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966300 with x1873929633581568 ext(180224->184319) 00002000:00010000:2.0:1787119519.123178:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966300 00000100:00100000:2.0:1787119519.123211:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633581696 00000100:00100000:2.0:1787119519.123214:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633581696 00002000:00100000:2.0:1787119519.123230:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (184320->188415) req@ffff92a63dfb9c00 x1873929633581696/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.123239:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9c00 with x1873929633581696 ext(184320->188415) 00002000:00010000:2.0:1787119519.123242:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9c00 00000100:00100000:2.0:1787119519.123267:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10636 00000100:00100000:2.0:1787119519.123278:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633581568:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119519.123288:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10637 00000100:00100000:1.0:1787119519.123301:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2373:x1873929633581696:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119519.123618:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2373:x1873929633581696:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 319us (582us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119519.123626:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10637 00002000:00100000:1.0:1787119519.123634:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (184320->188415) req@ffff92a63dfb9c00 x1873929633581696/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.123643:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfb9c00 with x1873929633581696 ext(184320->188415) 00002000:00010000:1.0:1787119519.123647:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dfb9c00 00000100:00100000:2.0:1787119519.124830:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633581568:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1547us (2088us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.124961:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10636 00002000:00100000:2.0:1787119519.124981:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a634966300 x1873929633581568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.124989:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966300 with x1873929633581568 ext(180224->184319) 00002000:00010000:2.0:1787119519.124994:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634966300 00000100:00100000:2.0:1787119519.130094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.130135:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.130207:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633581824 00000100:00100000:3.0:1787119519.130220:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633581824 00002000:00100000:3.0:1787119519.130277:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (188416->192511) req@ffff92a634967b80 x1873929633581824/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.130288:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967b80 with x1873929633581824 ext(188416->192511) 00002000:00010000:3.0:1787119519.130294:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634967b80 00000100:00100000:3.0:1787119519.130331:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10638 00000100:00100000:3.0:1787119519.130341:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2375:x1873929633581824:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119519.130581:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2375:x1873929633581824:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 241us (497us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119519.130589:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10638 00002000:00100000:3.0:1787119519.130596:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (188416->192511) req@ffff92a634967b80 x1873929633581824/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.130605:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967b80 with x1873929633581824 ext(188416->192511) 00002000:00010000:3.0:1787119519.130608:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634967b80 00000100:00100000:1.0:1787119519.130716:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633581952 00000100:00100000:1.0:1787119519.130721:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633581952 00000100:00100000:1.0:1787119519.130759:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5214 00000100:00100000:1.0:1787119519.130766:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:33946:x1873929633581952:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.130776:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.130794:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471624d expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.130823:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.130834:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 41) 00010000:00010000:1.0:1787119519.130838:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 41) 00010000:00010000:1.0:1787119519.130844:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.130877:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.130909:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 23 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.130931:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653595392:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119519.131002:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.134695:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653595392:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119519.134733:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.134755:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430400, rc 0) 00000100:00100000:1.0:1787119519.134822:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633581952:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4055us (4685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.134831:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5214 00000100:00100000:2.0:1787119519.135799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.136284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.136369:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633582080 00000100:00100000:0.0:1787119519.136379:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633582080 00002000:00100000:0.0:1787119519.136423:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a634967100 x1873929633582080/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.136436:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967100 with x1873929633582080 ext(192512->196607) 00010000:00010000:0.0:1787119519.136551:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 24 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.136581:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 24 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.136590:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634967100 00000100:00100000:0.0:1787119519.136651:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633582208 00000100:00100000:0.0:1787119519.136655:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633582208 00002000:00100000:0.0:1787119519.136673:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (184320->192511) req@ffff92a634965180 x1873929633582208/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 8680/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.136682:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965180 with x1873929633582208 ext(184320->192511) 00010000:00010000:0.0:1787119519.136687:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 25 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.136695:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1172 00010000:00010000:0.0:1787119519.136708:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 25 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.136716:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634965180 00000100:00100000:0.0:1787119519.136736:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1173 00000100:00100000:0.0:1787119519.136754:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2375:x1873929633582208:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119519.136781:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2375:x1873929633582080:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.136964:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2375:x1873929633582080:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 255us (1166us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.136973:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1172 00002000:00100000:2.0:1787119519.136981:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a634967100 x1873929633582080/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.136990:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967100 with x1873929633582080 ext(192512->196607) 00010000:00010000:2.0:1787119519.136997:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 25 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.137014:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 25 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.137022:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634967100 00000100:00100000:0.0:1787119519.137140:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633582208:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 396us (857us total) trans 4294969235 rc 0/0 00000100:00100000:0.0:1787119519.137148:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1173 00002000:00100000:0.0:1787119519.137154:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (184320->192511) req@ffff92a634965180 x1873929633582208/t4294969235(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 8680/448 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.137162:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634965180 with x1873929633582208 ext(184320->192511) 00010000:00010000:0.0:1787119519.137167:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 26 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.137183:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 26 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.137190:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634965180 00000100:00100000:2.0:1787119519.141384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.141477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.141618:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633582336 00000100:00100000:3.0:1787119519.141629:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633582336 00000100:00100000:3.0:1787119519.141680:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5215 00000100:00100000:3.0:1787119519.141691:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633582336:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.141709:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.141729:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716254 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.141770:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 41) 00010000:00010000:3.0:1787119519.141775:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 41) 00010000:00010000:3.0:1787119519.141783:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.141792:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633582464 00010000:00010000:3.0:1787119519.141798:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.141799:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633582464 00010000:00010000:3.0:1787119519.141815:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00010000:00010000:1.0:1787119519.141825:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 28 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.141879:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633582336:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 189us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.141887:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5215 00000100:00100000:1.0:1787119519.142096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5289 00000100:00100000:1.0:1787119519.142105:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633582464:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.142118:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.142144:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 27 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.142178:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 27 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.142200:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3ba6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471623f expref: 27 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.142215:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 41) 00010000:00010000:1.0:1787119519.142220:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 41) 00010000:00010000:1.0:1787119519.142228:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.142239:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.142247:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 41) 00010000:00010000:1.0:1787119519.142250:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 41) 00010000:00010000:1.0:1787119519.142256:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.142265:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.142298:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.142320:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653595520:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.142383:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 11 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.142395:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653595648:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.142479:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.148845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.149007:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633582592 00000100:00100000:1.0:1787119519.149019:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633582592 00002000:00100000:1.0:1787119519.149084:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (184320->192511) req@ffff92a512844000 x1873929633582592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.149096:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633582592 ext(184320->192511) 00002000:00010000:1.0:1787119519.149102:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844000 00000100:00100000:1.0:1787119519.149133:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10639 00000100:00100000:1.0:1787119519.149143:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633582592:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119519.149383:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633582592:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 240us (560us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1787119519.149392:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10639 00002000:00100000:1.0:1787119519.149399:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (184320->192511) req@ffff92a512844000 x1873929633582592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/8632 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.149408:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633582592 ext(184320->192511) 00002000:00010000:1.0:1787119519.149411:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844000 00000100:00100000:0.0:1787119519.151585:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653595520:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.151603:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653595648:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.151721:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.152122:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633582464:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10016us (10680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.152134:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5289 00000100:00100000:2.0:1787119519.153226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.153278:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633582720 00000100:00100000:1.0:1787119519.153288:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633582720 00000100:00100000:1.0:1787119519.153348:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5216 00000100:00100000:1.0:1787119519.153359:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633582720:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.153378:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.153398:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471625b expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.153434:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.153482:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 41) 00010000:00010000:1.0:1787119519.153487:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 41) 00010000:00010000:1.0:1787119519.153494:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 13 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.153531:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.153559:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 25 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.153576:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653595776:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119519.153671:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a618558240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.156723:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653595776:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119519.156775:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 13 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.156815:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:2.0:1787119519.156854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.156946:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633582848 00000100:00100000:0.0:1787119519.156954:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633582848 00002000:00100000:0.0:1787119519.157009:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a512845180 x1873929633582848/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.157020:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845180 with x1873929633582848 ext(192512->196607) 00010000:00010000:0.0:1787119519.157028:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.157066:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.157075:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845180 00000100:00100000:0.0:1787119519.157108:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1174 00000100:00100000:0.0:1787119519.157243:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633582848:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.157469:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633582848:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 228us (615us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119519.157527:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633582720:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4170us (4306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.157534:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5216 00000100:00100000:3.0:1787119519.160434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.161053:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633582976 00000100:00100000:1.0:1787119519.161078:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633582976 00000100:00100000:1.0:1787119519.161149:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5217 00000100:00100000:1.0:1787119519.161159:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633582976:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.161179:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.161201:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716262 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.161240:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 41) 00010000:00010000:1.0:1787119519.161359:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.161368:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 41) 00010000:00010000:1.0:1787119519.161373:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.161418:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.161435:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.161478:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119519.161545:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633582976:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 387us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.161552:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5217 00000100:00100000:3.0:1787119519.162159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.162512:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633583104 00000100:00100000:1.0:1787119519.162519:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633583104 00010000:00010000:1.0:1787119519.162550:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 28 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.162592:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5290 00000100:00100000:1.0:1787119519.162601:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2374:x1873929633583104:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.162614:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.162636:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 28 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.162664:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 28 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.162688:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3bbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716254 expref: 28 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.162703:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 41) 00010000:00010000:1.0:1787119519.162707:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 41) 00010000:00010000:1.0:1787119519.162714:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.162725:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.162755:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.162771:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 12 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.162784:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653596032:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.162853:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a618558240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.165534:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1174 00002000:00100000:0.0:1787119519.165560:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a512845180 x1873929633582848/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.165573:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845180 with x1873929633582848 ext(192512->196607) 00002000:00010000:0.0:1787119519.165588:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845180 00000100:00100000:2.0:1787119519.166284:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653596032:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.166308:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.166361:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2374:x1873929633583104:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3761us (4203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.166370:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5290 00000100:00100000:1.0:1787119519.167204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.168178:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633583232 00000100:00100000:0.0:1787119519.168189:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633583232 00002000:00100000:0.0:1787119519.168239:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a5098a5180 x1873929633583232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.168250:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5180 with x1873929633583232 ext(192512->229375) 00010000:00010000:0.0:1787119519.168259:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.168290:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.168298:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5180 00000100:00100000:0.0:1787119519.168327:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1175 00000100:00100000:0.0:1787119519.168337:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633583232:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.175595:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633583232:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7248us (8383us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119519.175613:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1175 00002000:00100000:0.0:1787119519.175627:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a5098a5180 x1873929633583232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.175639:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5180 with x1873929633583232 ext(192512->229375) 00010000:00010000:0.0:1787119519.175649:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.175680:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.175689:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5180 00000100:00100000:1.0:1787119519.179770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.179882:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633583360 00000100:00100000:2.0:1787119519.179893:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633583360 00000100:00100000:2.0:1787119519.179961:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5218 00000100:00100000:2.0:1787119519.179971:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633583360:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.179996:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.180017:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716269 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.180046:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 41) 00010000:00010000:2.0:1787119519.180055:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.180073:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 41) 00010000:00010000:2.0:1787119519.180078:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.180119:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.180134:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.180147:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119519.180201:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633583360:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 231us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.180208:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5218 00000100:00100000:1.0:1787119519.181113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.181200:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633583488 00000100:00100000:2.0:1787119519.181205:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633583488 00010000:00010000:2.0:1787119519.181230:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 14 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.181311:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5291 00000100:00100000:2.0:1787119519.181320:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633583488:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119519.181332:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119519.181356:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 14 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.181381:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 14 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.181402:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3bc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471625b expref: 14 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.181421:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 41) 00010000:00010000:2.0:1787119519.181425:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 41) 00010000:00010000:2.0:1787119519.181433:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.181479:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.181511:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.181525:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 25 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.181538:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653596288:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119519.181599:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.185155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.185243:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653596288:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.185278:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.185368:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633583616 00000100:00100000:0.0:1787119519.185377:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633583616 00010000:00010000:0.0:1787119519.185421:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 26 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.185492:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5292 00000100:00100000:0.0:1787119519.185503:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2373:x1873929633583616:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.185519:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.185545:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 26 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.185573:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 26 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.185605:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3bc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716262 expref: 26 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.185621:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 41) 00010000:00010000:0.0:1787119519.185626:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 41) 00010000:00010000:0.0:1787119519.185636:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.185647:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.185683:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.185698:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653596416:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.186510:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633583488:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5183us (5391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.186521:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5291 00000100:00100000:0.0:1787119519.186634:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.189606:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653596416:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.189640:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.189733:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2373:x1873929633583616:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4231us (4587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.189745:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5292 00000100:00100000:1.0:1787119519.199607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.199683:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633583744 00000100:00100000:3.0:1787119519.199692:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633583744 00000100:00100000:3.0:1787119519.199737:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5219 00000100:00100000:3.0:1787119519.199747:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633583744:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.199767:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.199787:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716270 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.199822:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.199830:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 41) 00010000:00010000:3.0:1787119519.199834:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 41) 00010000:00010000:3.0:1787119519.199837:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.199867:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.199888:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 12 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.199900:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653596544:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119519.199993:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.203325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.203499:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653596544:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119519.203530:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.203551:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1a00, rc 0) 00000100:00100000:1.0:1787119519.203605:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633583744:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3861us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.203612:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5219 00000100:00100000:3.0:1787119519.203881:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633583872 00000100:00100000:3.0:1787119519.203888:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633583872 00002000:00100000:3.0:1787119519.203934:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a50512c000 x1873929633583872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.203941:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c000 with x1873929633583872 ext(192512->229375) 00010000:00010000:3.0:1787119519.203947:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.203975:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.203982:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c000 00000100:00100000:3.0:1787119519.204011:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1176 00000100:00100000:3.0:1787119519.204021:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633583872:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119519.207363:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633583872:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3335us (4038us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119519.207373:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1176 00002000:00100000:3.0:1787119519.207383:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a50512c000 x1873929633583872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.207391:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c000 with x1873929633583872 ext(192512->229375) 00010000:00010000:3.0:1787119519.207400:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.207424:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.207429:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c000 00000100:00100000:2.0:1787119519.214311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.214401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.214588:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633584000 00000100:00100000:3.0:1787119519.214600:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633584000 00000100:00100000:3.0:1787119519.214661:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5220 00000100:00100000:3.0:1787119519.214672:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633584000:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.214690:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.214708:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716277 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.214736:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633584128 00000100:00100000:1.0:1787119519.214740:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633584128 00010000:00010000:3.0:1787119519.214749:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 41) 00010000:00010000:3.0:1787119519.214758:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.214760:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 15 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.214767:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 41) 00010000:00010000:3.0:1787119519.214772:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.214791:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5293 00000100:00100000:1.0:1787119519.214797:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633584128:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.214806:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.214811:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.214826:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.214826:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 15 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.214914:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 15 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.214931:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00010000:00010000:1.0:1787119519.214942:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3bd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716269 expref: 15 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.214955:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 41) 00010000:00010000:1.0:1787119519.214958:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 41) 00010000:00010000:1.0:1787119519.214965:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.214973:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.214997:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.214998:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633584000:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 328us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.215005:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5220 00010000:00010000:1.0:1787119519.215012:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 25 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.215026:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653596800:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.215087:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a618558240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.216925:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653596800:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.216949:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.217002:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633584128:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2204us (2698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.217014:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5293 00000100:00100000:2.0:1787119519.218372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.218570:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633584256 00000100:00100000:1.0:1787119519.218579:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633584256 00002000:00100000:1.0:1787119519.218622:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a506156a00 x1873929633584256/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.218632:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156a00 with x1873929633584256 ext(192512->196607) 00010000:00010000:1.0:1787119519.218641:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.218666:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119519.218674:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a506156a00 00000100:00100000:1.0:1787119519.218958:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1177 00000100:00100000:1.0:1787119519.218983:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633584256:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119519.219222:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633584256:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 254us (858us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119519.219230:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1177 00002000:00100000:1.0:1787119519.219236:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a506156a00 x1873929633584256/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.219244:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156a00 with x1873929633584256 ext(192512->196607) 00010000:00010000:1.0:1787119519.219250:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.219266:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119519.219273:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a506156a00 00000100:00100000:2.0:1787119519.225328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.225632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.225704:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633584512 00000100:00100000:0.0:1787119519.225713:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633584512 00010000:00010000:0.0:1787119519.225766:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.225814:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5294 00000100:00100000:0.0:1787119519.225825:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2374:x1873929633584512:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.225842:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.225865:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.225893:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.225921:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3bd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716270 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.225939:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 41) 00010000:00010000:0.0:1787119519.225945:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 41) 00010000:00010000:0.0:1787119519.225954:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.225976:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.226018:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.226050:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653596928:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.226292:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.227333:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633584384 00000100:00100000:3.0:1787119519.227343:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633584384 00000100:00100000:2.0:1787119519.227601:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5221 00000100:00100000:2.0:1787119519.227612:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633584384:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.227632:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.227650:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471627e expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.227679:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.227689:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 41) 00010000:00010000:2.0:1787119519.227693:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 41) 00010000:00010000:2.0:1787119519.227698:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.227732:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.227766:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 12 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.227780:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506156300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653597056:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.227854:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.228909:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653596928:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.228943:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.229006:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2374:x1873929633584512:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3182us (3373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.229017:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5294 00000100:00100000:2.0:1787119519.230822:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506156300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653597056:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119519.230858:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.230880:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119519.230945:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633584384:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3335us (5627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.230953:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5221 00000100:00100000:2.0:1787119519.236107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.236184:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633584640 00000100:00100000:0.0:1787119519.236193:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633584640 00010000:00010000:0.0:1787119519.236233:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.236274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5295 00000100:00100000:0.0:1787119519.236283:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633584640:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.236297:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.236319:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.236343:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.236369:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716277 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.236385:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 41) 00010000:00010000:0.0:1787119519.236390:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 41) 00010000:00010000:0.0:1787119519.236399:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.236415:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.236498:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.236513:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653597184:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.236591:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.240474:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653597184:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.240513:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.240575:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633584640:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4292us (4478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.240587:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5295 00000100:00100000:2.0:1787119519.244537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.244630:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633584768 00000100:00100000:0.0:1787119519.244640:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633584768 00000100:00100000:0.0:1787119519.244706:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5222 00000100:00100000:0.0:1787119519.244717:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633584768:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.244752:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.244778:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716285 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.244816:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.244826:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 41) 00010000:00010000:0.0:1787119519.244831:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 41) 00010000:00010000:0.0:1787119519.244836:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.244878:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.244906:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 25 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.244933:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653597312:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.245148:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.247807:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653597312:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.247857:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.247882:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:0.0:1787119519.247958:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633584768:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3242us (3431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.248167:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5222 00000100:00100000:3.0:1787119519.248708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.251459:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633584896 00000100:00100000:1.0:1787119519.251475:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633584896 00010000:00010000:1.0:1787119519.251520:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.251645:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5296 00000100:00100000:1.0:1787119519.251657:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633584896:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.251672:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.251696:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.251820:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.251850:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3be5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471627e expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.251867:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 41) 00010000:00010000:1.0:1787119519.251872:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 41) 00010000:00010000:1.0:1787119519.251880:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.251891:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.251944:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.251960:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653597440:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.252117:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a618558240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.257734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.257825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.257851:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633585152 00000100:00100000:2.0:1787119519.257859:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633585152 00002000:00100000:2.0:1787119519.257902:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a506156680 x1873929633585152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.257912:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156680 with x1873929633585152 ext(192512->229375) 00002000:00010000:2.0:1787119519.257918:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a506156680 00000100:00100000:2.0:1787119519.257950:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10640 00000100:00100000:2.0:1787119519.257959:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633585152:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.258141:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653597440:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.258178:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.258233:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2375:x1873929633584896:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6578us (9527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.258241:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5296 00000100:00100000:3.0:1787119519.258514:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633585024 00000100:00100000:3.0:1787119519.258518:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633585024 00000100:00100000:3.0:1787119519.258554:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5223 00000100:00100000:3.0:1787119519.258561:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633585024:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.258574:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.258591:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471628c expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.258621:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.258632:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 41) 00010000:00010000:3.0:1787119519.258637:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 41) 00010000:00010000:3.0:1787119519.258643:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.258673:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.258699:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.258712:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653597568:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119519.258781:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.263283:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633585152:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5315us (5447us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119519.263297:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10640 00002000:00100000:1.0:1787119519.263309:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a506156680 x1873929633585152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.263326:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506156680 with x1873929633585152 ext(192512->229375) 00010000:00010000:1.0:1787119519.263338:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.263367:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119519.263375:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a506156680 00000100:00100000:0.0:1787119519.264523:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653597568:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.264558:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.264579:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:0.0:1787119519.264669:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633585024:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6108us (6945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.264677:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5223 00000100:00100000:3.0:1787119519.267718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.267796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.268290:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633585408 00000100:00100000:1.0:1787119519.268300:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633585408 00000100:00100000:1.0:1787119519.268362:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5224 00000100:00100000:1.0:1787119519.268371:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633585408:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.268388:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.268405:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716293 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.268434:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 41) 00010000:00010000:1.0:1787119519.268478:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.268485:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 41) 00010000:00010000:1.0:1787119519.268491:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 14 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.268532:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.268547:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 14 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.268560:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119519.268620:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633585408:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 249us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.268626:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5224 00000100:00100000:0.0:1787119519.268816:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633585280 00000100:00100000:0.0:1787119519.268821:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633585280 00010000:00010000:0.0:1787119519.268842:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.268875:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5297 00000100:00100000:0.0:1787119519.268882:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633585280:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.268891:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.268912:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.268937:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.268959:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3bec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716285 expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.268983:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 41) 00010000:00010000:0.0:1787119519.268987:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 41) 00010000:00010000:0.0:1787119519.268995:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.269005:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.269033:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.269048:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 25 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.269073:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653597824:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.269649:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.270990:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653597824:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.271021:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.271079:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633585280:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2196us (3368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.271090:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5297 00000100:00100000:3.0:1787119519.272541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.272582:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633585536 00000100:00100000:0.0:1787119519.272596:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633585536 00002000:00100000:0.0:1787119519.272650:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63dfbb100 x1873929633585536/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.272662:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb100 with x1873929633585536 ext(192512->196607) 00010000:00010000:0.0:1787119519.272670:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.272697:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.272704:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dfbb100 00000100:00100000:0.0:1787119519.272853:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1178 00000100:00100000:0.0:1787119519.272863:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633585536:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.273076:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633585536:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 214us (539us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119519.273085:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1178 00002000:00100000:0.0:1787119519.273092:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63dfbb100 x1873929633585536/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.273101:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dfbb100 with x1873929633585536 ext(192512->196607) 00010000:00010000:0.0:1787119519.273106:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.273121:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.273128:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dfbb100 00000100:00100000:3.0:1787119519.276549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.278923:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633585664 00000100:00100000:2.0:1787119519.278942:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633585664 00000100:00100000:2.0:1787119519.279030:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5225 00000100:00100000:2.0:1787119519.279042:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633585664:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.279073:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.279102:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471629a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.279136:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 41) 00010000:00010000:2.0:1787119519.279146:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.279158:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 41) 00010000:00010000:2.0:1787119519.279164:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.279211:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.279226:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.279239:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:2.0:1787119519.279302:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633585664:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 261us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.279309:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5225 00000100:00100000:3.0:1787119519.281633:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.281820:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633585792 00000100:00100000:0.0:1787119519.281829:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633585792 00010000:00010000:0.0:1787119519.281859:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.281892:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5298 00000100:00100000:0.0:1787119519.281898:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2374:x1873929633585792:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.281911:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.281929:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.281950:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.281972:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e3bf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471628c expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.282042:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 41) 00010000:00010000:0.0:1787119519.282047:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 41) 00010000:00010000:0.0:1787119519.282062:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.282074:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.282118:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.282135:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 12 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.282149:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653598080:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.282338:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462600 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.289278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.289500:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633585920 00000100:00100000:1.0:1787119519.289508:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633585920 00010000:00010000:1.0:1787119519.289541:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.289576:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5299 00000100:00100000:1.0:1787119519.289583:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633585920:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.289597:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.289617:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.289639:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.289662:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 41) 00010000:00010000:1.0:1787119519.289666:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 41) 00010000:00010000:1.0:1787119519.289673:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.289679:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.289707:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.289718:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653598208:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.289791:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a618558240 going to sleep for 11 seconds 00010000:00010000:3.0:1787119519.290125:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3bfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716293 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.290142:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653598080:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.290164:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.290255:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2374:x1873929633585792:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8355us (8631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.290265:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5298 00000100:00100000:1.0:1787119519.294997:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653598208:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.295030:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.295099:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633585920:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5514us (5832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.295111:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5299 00000100:00100000:2.0:1787119519.297216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.297417:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633586048 00000100:00100000:0.0:1787119519.297427:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633586048 00000100:00100000:0.0:1787119519.297535:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5226 00000100:00100000:0.0:1787119519.297543:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633586048:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.297562:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.297580:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162a1 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.297614:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.297624:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 41) 00010000:00010000:0.0:1787119519.297628:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 41) 00010000:00010000:0.0:1787119519.297633:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.297666:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.297690:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 25 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.297705:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653598336:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.297796:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462780 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.301312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.301488:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633586176 00000100:00100000:1.0:1787119519.301498:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633586176 00010000:00010000:1.0:1787119519.301541:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.301582:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5300 00000100:00100000:1.0:1787119519.301592:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633586176:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.301608:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.301633:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.301660:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.301691:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 41) 00010000:00010000:1.0:1787119519.301696:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 41) 00010000:00010000:1.0:1787119519.301705:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.301716:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.301770:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.301785:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653598464:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.301876:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a618558240 going to sleep for 11 seconds 00010000:00010000:3.0:1787119519.302601:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3c01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471629a expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.302619:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653598336:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.302655:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.302667:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:3.0:1787119519.302717:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633586048:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5175us (5512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.302725:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5226 00000100:00100000:0.0:1787119519.306324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.306411:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633586304 00000100:00100000:3.0:1787119519.306421:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633586304 00000100:00100000:3.0:1787119519.306512:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5227 00000100:00100000:3.0:1787119519.306523:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633586304:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.306542:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.306562:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162a8 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.306597:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.306607:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 41) 00010000:00010000:3.0:1787119519.306611:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 41) 00010000:00010000:3.0:1787119519.306616:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.306653:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.306679:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 12 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.306694:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653598592:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.307000:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.310660:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653598464:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.310691:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.310762:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633586176:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9170us (9460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.310777:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5300 00000100:00100000:2.0:1787119519.313683:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653598592:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119519.313719:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.313816:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1a00, rc 0) 00000100:00100000:2.0:1787119519.313884:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633586304:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7363us (7570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.313894:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5227 00000100:00100000:0.0:1787119519.316480:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.316570:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633586432 00000100:00100000:1.0:1787119519.316581:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633586432 00002000:00100000:1.0:1787119519.316628:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a50512d500 x1873929633586432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.316639:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633586432 ext(192512->229375) 00010000:00010000:1.0:1787119519.316648:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.316676:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119519.316684:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512d500 00000100:00100000:1.0:1787119519.316714:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1179 00000100:00100000:1.0:1787119519.316723:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633586432:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119519.321616:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633586432:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4880us (5167us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119519.321631:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1179 00002000:00100000:3.0:1787119519.321645:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a50512d500 x1873929633586432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.321655:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633586432 ext(192512->229375) 00010000:00010000:3.0:1787119519.321666:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.321697:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.321706:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512d500 00000100:00100000:0.0:1787119519.325332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.325382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.325473:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633586688 00000100:00100000:3.0:1787119519.325484:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633586688 00010000:00010000:3.0:1787119519.325522:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.325565:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5301 00000100:00100000:3.0:1787119519.325575:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633586688:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.325590:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.325615:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.325642:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.325667:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a1 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.325684:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 41) 00010000:00010000:3.0:1787119519.325689:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 41) 00010000:00010000:3.0:1787119519.325698:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.325710:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.325760:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.325776:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653598720:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.325866:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.328109:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653598720:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.328141:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.328203:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2373:x1873929633586688:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2629us (2819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.328213:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5301 00000100:00100000:2.0:1787119519.328413:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633586560 00000100:00100000:2.0:1787119519.328421:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633586560 00000100:00100000:2.0:1787119519.328494:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5228 00000100:00100000:2.0:1787119519.328503:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633586560:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.328521:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.328539:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162af expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.328567:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.328576:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 41) 00010000:00010000:2.0:1787119519.328581:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 41) 00010000:00010000:2.0:1787119519.328586:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.328615:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.328640:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 25 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.328654:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506155880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653598848:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.328705:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.337265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.337371:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633586816 00000100:00100000:2.0:1787119519.337381:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633586816 00002000:00100000:2.0:1787119519.337433:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a5098a7480 x1873929633586816/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.337489:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7480 with x1873929633586816 ext(192512->196607) 00010000:00010000:2.0:1787119519.337501:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.337530:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.337539:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a7480 00000100:00100000:2.0:1787119519.337576:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1180 00000100:00100000:2.0:1787119519.337586:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633586816:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.337785:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633586816:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 200us (540us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.337793:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1180 00002000:00100000:2.0:1787119519.337799:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a5098a7480 x1873929633586816/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.337807:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7480 with x1873929633586816 ext(192512->196607) 00010000:00010000:2.0:1787119519.337812:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.337825:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.337837:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a7480 00000100:00100000:2.0:1787119519.340617:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506155880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653598848:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119519.340656:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.340681:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119519.340858:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633586560:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 12354us (15534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.340867:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5228 00000100:00100000:0.0:1787119519.344274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.344367:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633586944 00000100:00100000:3.0:1787119519.344378:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633586944 00000100:00100000:3.0:1787119519.344463:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5229 00000100:00100000:3.0:1787119519.344475:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633586944:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.344500:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.344521:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162b6 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.344555:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 41) 00010000:00010000:3.0:1787119519.344565:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.344572:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 41) 00010000:00010000:3.0:1787119519.344577:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.344622:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.344638:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.344651:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119519.344716:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633586944:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 242us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.344723:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5229 00000100:00100000:1.0:1787119519.347608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.347711:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633587072 00000100:00100000:0.0:1787119519.347721:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633587072 00010000:00010000:0.0:1787119519.347775:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.347818:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5302 00000100:00100000:0.0:1787119519.347827:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633587072:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.347842:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.347866:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.347894:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.347918:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162a8 expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.348159:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 41) 00010000:00010000:0.0:1787119519.348166:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 41) 00010000:00010000:0.0:1787119519.348176:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.348188:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.348229:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.348257:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 12 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.348273:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634149f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653599104:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.348406:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.352774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.352890:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633587200 00000100:00100000:3.0:1787119519.352899:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633587200 00010000:00010000:3.0:1787119519.352948:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.352999:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5303 00000100:00100000:3.0:1787119519.353009:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633587200:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.353026:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.353050:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.353085:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.353116:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 41) 00010000:00010000:3.0:1787119519.353121:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 41) 00010000:00010000:3.0:1787119519.353130:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.353141:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.353181:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.353196:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653599232:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.353290:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069990c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787119519.353582:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3c16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162af expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.353598:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634149f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653599104:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.353619:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.353646:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633587072:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5820us (6050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.353655:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5302 00000100:00100000:3.0:1787119519.358085:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653599232:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.358116:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.358218:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633587200:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5208us (5452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.358230:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5303 00000100:00100000:0.0:1787119519.363943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.364092:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633587328 00000100:00100000:3.0:1787119519.364103:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633587328 00000100:00100000:3.0:1787119519.364209:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5230 00000100:00100000:3.0:1787119519.364221:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633587328:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.364254:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.364274:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162bd expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.364316:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.364328:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 41) 00010000:00010000:3.0:1787119519.364333:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 41) 00010000:00010000:3.0:1787119519.364339:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.364375:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.364401:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 25 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.364424:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653599360:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119519.364558:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.372979:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.373104:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653599360:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.373141:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.373168:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:3.0:1787119519.373237:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633587328:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9019us (9305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.373253:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5230 00000100:00100000:0.0:1787119519.373594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.374289:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633587584 00000100:00100000:3.0:1787119519.374298:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633587584 00000100:00100000:3.0:1787119519.374351:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5231 00000100:00100000:3.0:1787119519.374359:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633587584:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.374378:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.374397:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162c4 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.374423:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 41) 00010000:00010000:3.0:1787119519.374430:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.374458:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 41) 00010000:00010000:3.0:1787119519.374463:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.374497:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.374509:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.374519:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1a00, rc 0) 00000100:00100000:3.0:1787119519.374558:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633587584:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 199us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.374564:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5231 00000100:00100000:1.0:1787119519.378532:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633587456 00000100:00100000:1.0:1787119519.378550:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633587456 00010000:00010000:1.0:1787119519.378603:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.378699:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5304 00000100:00100000:1.0:1787119519.378709:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633587456:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.378728:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.378764:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.378791:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.378815:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e3c1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162b6 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.378833:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 41) 00010000:00010000:1.0:1787119519.378837:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 41) 00010000:00010000:1.0:1787119519.378845:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.378856:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.378898:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.378914:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 12 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.378941:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653599616:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.379062:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.385429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.385746:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633587712 00000100:00100000:3.0:1787119519.385757:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633587712 00002000:00100000:3.0:1787119519.385812:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a506155880 x1873929633587712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.385824:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155880 with x1873929633587712 ext(192512->229375) 00010000:00010000:3.0:1787119519.385833:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.385864:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.385872:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a506155880 00000100:00100000:3.0:1787119519.385912:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1181 00000100:00100000:3.0:1787119519.385933:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633587712:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119519.387175:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653599616:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.387204:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.387255:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633587456:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8546us (14292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.387265:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5304 00000100:00100000:0.0:1787119519.404270:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633587712:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 18327us (18839us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119519.404287:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1181 00002000:00100000:0.0:1787119519.404300:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a506155880 x1873929633587712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.404311:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a506155880 with x1873929633587712 ext(192512->229375) 00010000:00010000:0.0:1787119519.404322:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.404352:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.404360:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a506155880 00000100:00100000:2.0:1787119519.408317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.408517:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633587840 00000100:00100000:1.0:1787119519.408527:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633587840 00000100:00100000:1.0:1787119519.408587:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5232 00000100:00100000:1.0:1787119519.408595:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633587840:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.408612:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.408629:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162cb expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.408656:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 41) 00010000:00010000:1.0:1787119519.408665:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.408672:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 41) 00010000:00010000:1.0:1787119519.408677:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.408717:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.408732:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.408746:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119519.408811:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633587840:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 216us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.408817:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5232 00000100:00100000:2.0:1787119519.410668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.410791:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633587968 00000100:00100000:0.0:1787119519.410802:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633587968 00010000:00010000:0.0:1787119519.410847:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.410923:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5305 00000100:00100000:0.0:1787119519.410932:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633587968:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.410948:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.410983:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.411013:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.411038:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e3c24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162bd expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.411066:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 41) 00010000:00010000:0.0:1787119519.411072:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 41) 00010000:00010000:0.0:1787119519.411081:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.411099:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.411137:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.411153:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 25 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.411168:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634149880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653599872:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.411281:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.414766:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634149880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653599872:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.414791:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.414841:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633587968:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3909us (4183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.414852:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5305 00000100:00100000:3.0:1787119519.415355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.415432:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633588096 00000100:00100000:0.0:1787119519.415472:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633588096 00002000:00100000:0.0:1787119519.415517:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a512846680 x1873929633588096/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.415527:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846680 with x1873929633588096 ext(192512->196607) 00010000:00010000:0.0:1787119519.415536:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.415562:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.415576:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512846680 00000100:00100000:0.0:1787119519.415610:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1182 00000100:00100000:0.0:1787119519.415620:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633588096:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.415800:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633588096:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 181us (446us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119519.415807:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1182 00002000:00100000:0.0:1787119519.415813:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a512846680 x1873929633588096/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.415820:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846680 with x1873929633588096 ext(192512->196607) 00010000:00010000:0.0:1787119519.415825:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.415838:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.415844:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512846680 00000100:00100000:2.0:1787119519.418014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.418239:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633588224 00000100:00100000:0.0:1787119519.418249:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633588224 00000100:00100000:0.0:1787119519.418308:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5233 00000100:00100000:0.0:1787119519.418317:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633588224:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.418335:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.418361:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162d2 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.418404:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 41) 00010000:00010000:0.0:1787119519.418414:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.418420:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 41) 00010000:00010000:0.0:1787119519.418426:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.418500:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.418515:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.418528:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84c00, rc 0) 00000100:00100000:0.0:1787119519.418587:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633588224:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 270us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.418594:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5233 00000100:00100000:3.0:1787119519.419433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.419491:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633588352 00000100:00100000:1.0:1787119519.419497:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633588352 00010000:00010000:1.0:1787119519.419528:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.419558:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5306 00000100:00100000:1.0:1787119519.419567:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2374:x1873929633588352:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.419579:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.419600:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.419623:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.419647:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e3c2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162c4 expref: 27 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.419663:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 41) 00010000:00010000:1.0:1787119519.419667:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 41) 00010000:00010000:1.0:1787119519.419675:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.419685:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.419715:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.419731:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 12 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.419744:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653600128:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.419822:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.427301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.427399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633588480 00000100:00100000:0.0:1787119519.427410:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633588480 00010000:00010000:0.0:1787119519.427475:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.427527:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5307 00000100:00100000:0.0:1787119519.427539:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633588480:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.427558:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.427583:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.427610:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.427641:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 41) 00010000:00010000:0.0:1787119519.427647:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 41) 00010000:00010000:0.0:1787119519.427657:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 26 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.427670:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 26 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.427710:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 26 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.427725:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653600256:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.427812:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064620c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787119519.429147:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3c32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162cb expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.429167:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653600128:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.429189:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.429245:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2374:x1873929633588352:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9678us (9816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.429257:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5306 00000100:00100000:0.0:1787119519.431739:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653600256:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.431771:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.431829:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633588480:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4292us (4537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.431841:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5307 00000100:00100000:3.0:1787119519.434235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.434354:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633588608 00000100:00100000:0.0:1787119519.434367:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633588608 00000100:00100000:0.0:1787119519.434432:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5234 00000100:00100000:0.0:1787119519.434551:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633588608:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.434574:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.434598:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162d9 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.434640:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.434651:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 41) 00010000:00010000:0.0:1787119519.434655:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 41) 00010000:00010000:0.0:1787119519.434660:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.434696:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.434724:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 25 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.434740:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653600384:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.434867:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064620c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.437805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.437887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633588736 00000100:00100000:1.0:1787119519.437895:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633588736 00000100:00100000:0.0:1787119519.437908:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653600384:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119519.437934:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 26 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.437953:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.437970:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:1.0:1787119519.437990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5308 00000100:00100000:1.0:1787119519.438000:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633588736:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.438017:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.438042:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 26 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.438075:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 26 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.438111:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e3c39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d2 expref: 26 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.438127:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 41) 00010000:00010000:1.0:1787119519.438132:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 41) 00010000:00010000:1.0:1787119519.438141:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.438152:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.438188:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.438208:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653600512:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.438391:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633588608:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3949us (4165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.438399:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5234 00000100:00100000:1.0:1787119519.442465:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.445780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.445859:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633588864 00000100:00100000:0.0:1787119519.445867:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633588864 00000100:00100000:0.0:1787119519.445987:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5235 00000100:00100000:0.0:1787119519.445998:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633588864:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.446019:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.446038:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162e0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.446089:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.446100:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 41) 00010000:00010000:0.0:1787119519.446104:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 41) 00010000:00010000:0.0:1787119519.446109:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.446145:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.446171:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 12 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.446188:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653600640:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.446332:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064620c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.448851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.448967:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653600640:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.449007:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.449031:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:0.0:1787119519.449103:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633588864:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3106us (3335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.449112:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5235 00000100:00100000:2.0:1787119519.449231:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633588992 00000100:00100000:2.0:1787119519.449318:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633588992 00002000:00100000:2.0:1787119519.449364:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a634148380 x1873929633588992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.449374:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148380 with x1873929633588992 ext(192512->229375) 00010000:00010000:2.0:1787119519.449382:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.449409:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.449416:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634148380 00000100:00100000:2.0:1787119519.449469:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1183 00000100:00100000:2.0:1787119519.449479:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633588992:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119519.449814:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653600512:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.449832:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.449859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633588736:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11860us (12065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.449868:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5308 00000100:00100000:0.0:1787119519.456098:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633588992:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6609us (7244us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119519.456113:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1183 00002000:00100000:0.0:1787119519.456127:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a634148380 x1873929633588992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.456139:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148380 with x1873929633588992 ext(192512->229375) 00010000:00010000:0.0:1787119519.456151:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.456183:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.456197:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634148380 00000100:00100000:2.0:1787119519.460067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.460154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.460230:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633589248 00000100:00100000:0.0:1787119519.460313:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633589248 00010000:00010000:0.0:1787119519.460358:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.460406:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5309 00000100:00100000:0.0:1787119519.460418:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2374:x1873929633589248:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.460468:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.460490:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.460516:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.460542:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162d9 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.460560:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 41) 00010000:00010000:0.0:1787119519.460565:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 41) 00010000:00010000:0.0:1787119519.460573:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.460584:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.460625:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.460639:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653600768:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.460710:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064620c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.463554:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633589120 00000100:00100000:3.0:1787119519.463571:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633589120 00000100:00100000:3.0:1787119519.463637:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5236 00000100:00100000:3.0:1787119519.463647:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633589120:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.463666:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.463685:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162e7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.463720:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.463730:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 41) 00010000:00010000:3.0:1787119519.463734:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 41) 00010000:00010000:3.0:1787119519.463740:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 14 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.463778:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.463802:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 25 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.463816:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653600896:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119519.463902:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.464673:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653600768:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.464693:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.464737:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633589248:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4321us (4583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.464746:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5309 00000100:00100000:2.0:1787119519.467939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.468090:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633589376 00000100:00100000:1.0:1787119519.468100:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633589376 00002000:00100000:1.0:1787119519.468153:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63dc05180 x1873929633589376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.468165:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05180 with x1873929633589376 ext(192512->196607) 00010000:00010000:1.0:1787119519.468177:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.468212:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119519.468220:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05180 00000100:00100000:1.0:1787119519.468257:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1184 00000100:00100000:1.0:1787119519.468268:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633589376:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119519.468526:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633589376:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 258us (609us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119519.468534:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1184 00002000:00100000:1.0:1787119519.468542:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63dc05180 x1873929633589376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.468551:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05180 with x1873929633589376 ext(192512->196607) 00010000:00010000:1.0:1787119519.468557:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.468572:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119519.468579:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05180 00000100:00100000:2.0:1787119519.473795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.473893:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633589504 00000100:00100000:1.0:1787119519.473904:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633589504 00000100:00100000:1.0:1787119519.473986:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5237 00000100:00100000:1.0:1787119519.473999:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633589504:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.474020:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.474045:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162ee expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.474094:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 41) 00010000:00010000:1.0:1787119519.474105:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.474114:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 41) 00010000:00010000:1.0:1787119519.474120:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 27 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.474175:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.474193:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 27 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.474206:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119519.474288:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633589504:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 292us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.474296:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5237 00000100:00100000:3.0:1787119519.475109:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653600896:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.475139:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 13 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.475154:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038faa00, rc 0) 00000100:00100000:3.0:1787119519.475208:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633589120:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11562us (15161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.475217:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5236 00000100:00100000:2.0:1787119519.477903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.478474:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633589632 00000100:00100000:0.0:1787119519.478485:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633589632 00010000:00010000:0.0:1787119519.478529:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 27 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.478580:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5310 00000100:00100000:0.0:1787119519.478592:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633589632:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.478608:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.478632:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 27 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.478658:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 27 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.478683:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e0 expref: 27 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.478701:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 41) 00010000:00010000:0.0:1787119519.478705:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 41) 00010000:00010000:0.0:1787119519.478714:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.478724:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.478766:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.478784:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 12 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.478798:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653601152:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.478875:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462000 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.482543:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653601152:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.482590:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.482659:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633589632:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4068us (4763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.482670:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5310 00000100:00100000:1.0:1787119519.484393:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.484484:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633589760 00000100:00100000:3.0:1787119519.484493:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633589760 00010000:00010000:3.0:1787119519.484536:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 13 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.484578:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5311 00000100:00100000:3.0:1787119519.484588:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633589760:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.484603:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.484629:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 13 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.484656:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 13 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.484682:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162e7 expref: 13 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.484699:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 41) 00010000:00010000:3.0:1787119519.484705:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 41) 00010000:00010000:3.0:1787119519.484715:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.484726:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.484763:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.484778:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653601280:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.484866:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.487956:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653601280:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.487993:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.488063:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633589760:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3467us (3669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.488074:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5311 00000100:00100000:2.0:1787119519.495595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.495712:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633589888 00000100:00100000:0.0:1787119519.495723:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633589888 00000100:00100000:0.0:1787119519.495837:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5238 00000100:00100000:0.0:1787119519.495847:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633589888:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.495865:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.495885:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162f5 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.495933:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.495944:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 41) 00010000:00010000:0.0:1787119519.495948:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 41) 00010000:00010000:0.0:1787119519.495954:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.495991:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.496018:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 25 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.496034:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653601408:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.496145:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.502332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.502416:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633590016 00000100:00100000:3.0:1787119519.502427:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633590016 00010000:00010000:3.0:1787119519.502502:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 26 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.502547:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5312 00000100:00100000:3.0:1787119519.502556:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633590016:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.502575:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.502599:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 26 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.502626:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 26 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.502657:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 41) 00010000:00010000:3.0:1787119519.502662:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 41) 00010000:00010000:3.0:1787119519.502671:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.502681:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.502720:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.502734:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653601536:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.502816:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00010000:00010000:0.0:1787119519.504182:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3c55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162ee expref: 26 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.504204:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653601408:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.504233:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.504359:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:0.0:1787119519.504539:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633589888:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8691us (8952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.504549:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5238 00000100:00100000:2.0:1787119519.507190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.507256:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633590144 00000100:00100000:0.0:1787119519.507265:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633590144 00000100:00100000:0.0:1787119519.507329:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5239 00000100:00100000:0.0:1787119519.507341:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633590144:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.507357:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.507384:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047162fc expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.507419:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.507428:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 41) 00010000:00010000:0.0:1787119519.507432:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 41) 00010000:00010000:0.0:1787119519.507455:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.507491:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.507524:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 12 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.507539:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653601664:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.507609:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064620c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.510589:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653601536:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.510626:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.510939:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653601664:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119519.510967:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.510996:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:0.0:1787119519.510997:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633590016:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8441us (8675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.511007:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5312 00000100:00100000:3.0:1787119519.511344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.511823:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633590144:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4482us (4639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.511833:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5239 00000100:00100000:2.0:1787119519.511901:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633590272 00000100:00100000:2.0:1787119519.511909:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633590272 00002000:00100000:2.0:1787119519.511950:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a63eabe300 x1873929633590272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.511961:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe300 with x1873929633590272 ext(192512->229375) 00010000:00010000:2.0:1787119519.511970:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.512001:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.512009:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabe300 00000100:00100000:2.0:1787119519.512681:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1185 00000100:00100000:2.0:1787119519.512694:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633590272:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.515429:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633590272:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2728us (4075us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119519.515467:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1185 00002000:00100000:2.0:1787119519.515480:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a63eabe300 x1873929633590272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.515491:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe300 with x1873929633590272 ext(192512->229375) 00010000:00010000:2.0:1787119519.515503:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.515532:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.515541:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabe300 00000100:00100000:3.0:1787119519.517766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.518015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.518187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633590528 00000100:00100000:2.0:1787119519.518197:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633590528 00010000:00010000:2.0:1787119519.518234:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.518255:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633590400 00000100:00100000:1.0:1787119519.518260:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633590400 00000100:00100000:2.0:1787119519.518284:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5313 00000100:00100000:2.0:1787119519.518293:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633590528:12345-192.168.201.59@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787119519.518294:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5240 00000100:00100000:1.0:1787119519.518300:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633590400:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.518309:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.518314:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.518330:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716303 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.518332:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.518360:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 15 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.518751:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 41) 00010000:00010000:1.0:1787119519.518876:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.518885:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 41) 00010000:00010000:1.0:1787119519.518891:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.518914:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162f5 expref: 15 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.518941:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.518956:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.518981:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 41) 00010000:00010000:1.0:1787119519.518985:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 41) 00010000:00010000:1.0:1787119519.518993:0:8267:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.519002:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.519026:0:8267:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.519043:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 25 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.519066:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.519072:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653601920:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119519.519125:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633590528:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 832us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.519134:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5313 00000100:00100000:1.0:1787119519.519431:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.521545:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653601920:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.521571:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119519.521631:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633590400:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3329us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.521640:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5240 00000100:00100000:3.0:1787119519.522630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.522892:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633590656 00000100:00100000:0.0:1787119519.522901:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633590656 00002000:00100000:0.0:1787119519.522947:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63eabea00 x1873929633590656/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.522955:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabea00 with x1873929633590656 ext(192512->196607) 00010000:00010000:0.0:1787119519.522963:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.523001:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.523010:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabea00 00000100:00100000:0.0:1787119519.523038:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1186 00000100:00100000:0.0:1787119519.523047:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633590656:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.523249:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633590656:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 203us (625us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119519.523255:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1186 00002000:00100000:0.0:1787119519.523260:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63eabea00 x1873929633590656/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.523266:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabea00 with x1873929633590656 ext(192512->196607) 00010000:00010000:0.0:1787119519.523270:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.523280:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.523285:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabea00 00000100:00100000:0.0:1787119519.526008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.526063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.526408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633590912 00000100:00100000:1.0:1787119519.526418:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633590912 00000100:00100000:3.0:1787119519.526424:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633590784 00000100:00100000:3.0:1787119519.526428:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633590784 00010000:00010000:1.0:1787119519.526472:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 27 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.526491:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5241 00000100:00100000:3.0:1787119519.526501:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633590784:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.526516:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.526533:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471630a expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.526543:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5314 00000100:00100000:1.0:1787119519.526550:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633590912:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.526559:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.526566:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 41) 00010000:00010000:3.0:1787119519.526574:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.526581:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 41) 00010000:00010000:3.0:1787119519.526586:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.526666:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 28 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.526693:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 28 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.526715:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e3c63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047162fc expref: 28 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.526735:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 41) 00010000:00010000:1.0:1787119519.526739:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 41) 00010000:00010000:1.0:1787119519.526746:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.526755:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.526791:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.526806:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 12 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.526819:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653602048:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.526911:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 12 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.526931:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 12 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.526941:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653602176:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119519.526949:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.526977:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.528690:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653602048:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.528715:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.528749:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653602176:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.528768:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633590912:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2219us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.528778:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5314 00010000:00010000:3.0:1787119519.528906:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.528931:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb600, rc 0) 00000100:00100000:3.0:1787119519.529031:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633590784:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2531us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.529042:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5241 00000100:00100000:1.0:1787119519.532201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.532302:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633591040 00000100:00100000:0.0:1787119519.532311:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633591040 00010000:00010000:0.0:1787119519.532347:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.532380:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5315 00000100:00100000:0.0:1787119519.532386:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633591040:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.532400:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.532418:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.532462:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.532495:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3c6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716303 expref: 13 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.532508:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 41) 00010000:00010000:0.0:1787119519.532511:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 41) 00010000:00010000:0.0:1787119519.532517:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.532524:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.532553:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.532564:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653602304:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.532641:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.534623:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653602304:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.534650:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.534707:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633591040:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2319us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.534718:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5315 00000100:00100000:1.0:1787119519.543870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.543938:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633591168 00000100:00100000:0.0:1787119519.543948:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633591168 00000100:00100000:0.0:1787119519.544006:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5242 00000100:00100000:0.0:1787119519.544017:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633591168:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.544035:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.544066:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716311 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.544102:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.544112:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 41) 00010000:00010000:0.0:1787119519.544116:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 41) 00010000:00010000:0.0:1787119519.544122:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.544155:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.544180:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 25 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.544195:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653602432:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.544288:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.547132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.547284:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633591296 00000100:00100000:3.0:1787119519.547293:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633591296 00002000:00100000:3.0:1787119519.547340:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a5098a6300 x1873929633591296/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.547351:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6300 with x1873929633591296 ext(192512->196607) 00010000:00010000:3.0:1787119519.547359:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.547389:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.547397:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a6300 00000100:00100000:3.0:1787119519.547433:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1187 00000100:00100000:3.0:1787119519.548009:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633591296:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.548709:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653602432:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.548743:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.548768:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:0.0:1787119519.548821:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633591168:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4805us (4958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.548829:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5242 00000100:00100000:3.0:1787119519.549828:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633591296:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1822us (2703us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119519.549838:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1187 00002000:00100000:3.0:1787119519.549847:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a5098a6300 x1873929633591296/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.549858:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6300 with x1873929633591296 ext(192512->196607) 00010000:00010000:3.0:1787119519.549867:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.549899:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.549908:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a6300 00000100:00100000:1.0:1787119519.552694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.552841:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633591424 00000100:00100000:0.0:1787119519.552852:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633591424 00000100:00100000:0.0:1787119519.552911:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5243 00000100:00100000:0.0:1787119519.552929:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633591424:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.552947:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.552967:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716318 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.553001:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 41) 00010000:00010000:0.0:1787119519.553010:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.553018:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 41) 00010000:00010000:0.0:1787119519.553023:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.553073:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.553089:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.553102:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:0.0:1787119519.553172:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633591424:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 252us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.553179:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5243 00000100:00100000:0.0:1787119519.554817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.554905:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633591552 00000100:00100000:2.0:1787119519.554914:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633591552 00010000:00010000:2.0:1787119519.554963:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.555005:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5316 00000100:00100000:2.0:1787119519.555015:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2374:x1873929633591552:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119519.555031:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119519.555063:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.555091:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.555117:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3c71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471630a expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.555135:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 41) 00010000:00010000:2.0:1787119519.555140:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 41) 00010000:00010000:2.0:1787119519.555150:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.555160:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.555199:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.555219:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 12 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.555234:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653602688:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119519.555502:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.559858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.559943:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633591680 00000100:00100000:3.0:1787119519.559953:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633591680 00002000:00100000:3.0:1787119519.560015:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a5098a4700 x1873929633591680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.560026:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633591680 ext(192512->229375) 00010000:00010000:3.0:1787119519.560035:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.560075:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.560083:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4700 00000100:00100000:3.0:1787119519.560120:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1188 00000100:00100000:3.0:1787119519.560131:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633591680:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.560807:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653602688:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.560833:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.560877:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2374:x1873929633591552:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5862us (6068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.560887:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5316 00000100:00100000:3.0:1787119519.572133:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633591680:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 11993us (12273us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119519.572149:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1188 00002000:00100000:3.0:1787119519.572163:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a5098a4700 x1873929633591680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.572179:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633591680 ext(192512->229375) 00010000:00010000:3.0:1787119519.572189:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.572219:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.572227:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4700 00000100:00100000:1.0:1787119519.575518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.575656:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633591808 00000100:00100000:3.0:1787119519.575666:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633591808 00000100:00100000:3.0:1787119519.575724:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5244 00000100:00100000:3.0:1787119519.575735:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633591808:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.575752:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.575772:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471631f expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.575806:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 41) 00010000:00010000:3.0:1787119519.575816:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.575823:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 41) 00010000:00010000:3.0:1787119519.575829:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 14 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.575871:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.575886:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 14 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.575899:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038faa00, rc 0) 00000100:00100000:3.0:1787119519.575966:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633591808:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 234us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.575974:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5244 00000100:00100000:0.0:1787119519.578719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.578875:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633591936 00000100:00100000:2.0:1787119519.578886:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633591936 00010000:00010000:2.0:1787119519.578936:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.578987:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5317 00000100:00100000:2.0:1787119519.578998:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633591936:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119519.579012:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119519.579037:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.579073:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.579103:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e3c78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716311 expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.579124:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 41) 00010000:00010000:2.0:1787119519.579129:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 41) 00010000:00010000:2.0:1787119519.579138:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.579148:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.579188:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.579205:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 25 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.579218:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653602944:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119519.579310:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.582910:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653602944:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.582949:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.583021:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633591936:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4024us (4310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.583037:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5317 00000100:00100000:1.0:1787119519.586038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.586192:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633592064 00000100:00100000:0.0:1787119519.586202:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633592064 00010000:00010000:0.0:1787119519.586249:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.586292:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5318 00000100:00100000:0.0:1787119519.586302:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633592064:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.586316:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.586339:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.586366:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.586391:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e3c7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716318 expref: 26 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.586407:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 41) 00010000:00010000:0.0:1787119519.586413:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 41) 00010000:00010000:0.0:1787119519.586422:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.586432:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.586497:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.586511:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653603072:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.586586:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.589749:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653603072:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.589782:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.589890:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2376:x1873929633592064:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3587us (3860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.589901:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5318 00000100:00100000:0.0:1787119519.597541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.597625:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633592192 00000100:00100000:3.0:1787119519.597637:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633592192 00000100:00100000:3.0:1787119519.597739:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5245 00000100:00100000:3.0:1787119519.597750:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633592192:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.597778:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.597797:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716326 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.597830:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.597840:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 41) 00010000:00010000:3.0:1787119519.597844:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 41) 00010000:00010000:3.0:1787119519.597850:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.597882:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 12 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.597909:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 12 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.597933:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653603200:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119519.598023:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.600676:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653603200:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.600714:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.600737:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fba00, rc 0) 00000100:00100000:3.0:1787119519.602080:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633592192:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4324us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.602091:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5245 00000100:00100000:2.0:1787119519.604198:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.606220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.606812:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633592448 00000100:00100000:3.0:1787119519.606824:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633592448 00000100:00100000:3.0:1787119519.606888:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5246 00000100:00100000:3.0:1787119519.606899:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633592448:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.606986:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.607009:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471632d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.607046:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 41) 00010000:00010000:3.0:1787119519.607065:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.607073:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 41) 00010000:00010000:3.0:1787119519.607078:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 14 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.607122:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.607136:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 14 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.607149:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb400, rc 0) 00000100:00100000:3.0:1787119519.608334:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633592448:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1432us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.608342:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5246 00000100:00100000:0.0:1787119519.608747:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633592320 00000100:00100000:0.0:1787119519.608757:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633592320 00010000:00010000:0.0:1787119519.608795:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 14 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.608836:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5319 00000100:00100000:0.0:1787119519.608845:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633592320:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.608859:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.608881:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 14 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.608909:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 14 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.609129:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3c86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471631f expref: 14 pid: 8267 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.609146:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 41) 00010000:00010000:0.0:1787119519.609150:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 41) 00010000:00010000:0.0:1787119519.609158:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.609169:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.609206:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.609223:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 25 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.609250:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653603456:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.609323:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.612860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.612926:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653603456:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.612956:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.613030:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633592576 00000100:00100000:3.0:1787119519.613041:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633592576 00000100:00100000:0.0:1787119519.613083:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633592320:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4238us (8895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.613098:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5319 00002000:00100000:3.0:1787119519.613189:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a5098a4a80 x1873929633592576/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.613201:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633592576 ext(192512->196607) 00010000:00010000:3.0:1787119519.613210:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.613507:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.613525:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4a80 00000100:00100000:0.0:1787119519.613657:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1189 00000100:00100000:0.0:1787119519.613670:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633592576:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.613907:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633592576:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 240us (1057us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119519.613914:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1189 00002000:00100000:0.0:1787119519.613921:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a5098a4a80 x1873929633592576/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.613929:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633592576 ext(192512->196607) 00010000:00010000:0.0:1787119519.613936:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.613955:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.614112:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4a80 00000100:00100000:1.0:1787119519.616936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.617120:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633592704 00000100:00100000:2.0:1787119519.617132:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633592704 00010000:00010000:2.0:1787119519.617168:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.617205:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5320 00000100:00100000:2.0:1787119519.617215:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2374:x1873929633592704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119519.617230:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119519.617928:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.617928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119519.617958:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.617996:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3c8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716326 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.618013:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 41) 00010000:00010000:2.0:1787119519.618019:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 41) 00010000:00010000:2.0:1787119519.618028:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.618038:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.618093:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.618110:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653603584:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.618201:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633592832 00000100:00100000:0.0:1787119519.618226:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633592832 00000100:00100000:2.0:1787119519.618232:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.618328:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5247 00000100:00100000:0.0:1787119519.618337:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633592832:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.618351:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.618365:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716334 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.618394:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.618401:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 41) 00010000:00010000:0.0:1787119519.618405:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 41) 00010000:00010000:0.0:1787119519.618409:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.618432:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.618475:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 12 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.618486:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653603712:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.618519:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462780 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.620659:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653603584:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.620684:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.620715:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653603712:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.620745:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2374:x1873929633592704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3530us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.620757:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5320 00010000:00010000:0.0:1787119519.621517:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.621542:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80e00, rc 0) 00000100:00100000:1.0:1787119519.622318:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633592832:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3979us (4391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.622329:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5247 00000100:00100000:1.0:1787119519.624879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.628086:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633592960 00000100:00100000:3.0:1787119519.628102:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633592960 00002000:00100000:3.0:1787119519.628167:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a5098a4000 x1873929633592960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.628179:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4000 with x1873929633592960 ext(192512->229375) 00010000:00010000:3.0:1787119519.628189:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.628223:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.628232:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4000 00000100:00100000:2.0:1787119519.628647:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1190 00000100:00100000:2.0:1787119519.628660:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633592960:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.633382:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2373:x1873929633592960:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4646us (8485us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119519.633402:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1190 00002000:00100000:0.0:1787119519.633417:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a5098a4000 x1873929633592960/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.633429:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4000 with x1873929633592960 ext(192512->229375) 00010000:00010000:0.0:1787119519.633607:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.633640:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.633659:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4000 00000100:00100000:2.0:1787119519.639411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.639541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.639768:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633593088 00000100:00100000:1.0:1787119519.639780:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633593088 00000100:00100000:1.0:1787119519.639856:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5248 00000100:00100000:1.0:1787119519.639867:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633593088:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.639885:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.639907:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471633b expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.639941:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 41) 00010000:00010000:1.0:1787119519.639951:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.639959:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 41) 00010000:00010000:1.0:1787119519.639964:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.640024:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.640061:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.640078:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119519.640148:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633593088:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 282us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.640157:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5248 00000100:00100000:0.0:1787119519.640811:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633593216 00000100:00100000:0.0:1787119519.640818:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633593216 00010000:00010000:0.0:1787119519.640843:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.640873:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5321 00000100:00100000:0.0:1787119519.640882:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633593216:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.640893:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.640913:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.640938:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.640980:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3c94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471632d expref: 14 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.640996:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 41) 00010000:00010000:0.0:1787119519.641000:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 41) 00010000:00010000:0.0:1787119519.641009:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.641020:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.641059:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.641075:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 25 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.641099:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653603968:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.641175:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462780 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.648687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.649674:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653603968:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.649706:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.650280:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633593216:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9395us (10874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.650296:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5321 00000100:00100000:0.0:1787119519.650325:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633593344 00000100:00100000:0.0:1787119519.650332:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633593344 00010000:00010000:0.0:1787119519.650363:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.650458:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5322 00000100:00100000:1.0:1787119519.650483:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2373:x1873929633593344:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.650498:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.650524:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.650552:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.650579:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e3c9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716334 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.650596:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 41) 00010000:00010000:1.0:1787119519.650601:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 41) 00010000:00010000:1.0:1787119519.650611:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.650623:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.650681:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.650697:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653604096:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.650768:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.654787:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653604096:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.654819:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.654898:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2373:x1873929633593344:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4430us (6219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.654909:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5322 00000100:00100000:3.0:1787119519.658241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.658422:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633593472 00000100:00100000:0.0:1787119519.658434:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633593472 00000100:00100000:0.0:1787119519.658509:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5249 00000100:00100000:0.0:1787119519.658520:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633593472:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.658541:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.658560:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716342 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.658591:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.658598:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 41) 00010000:00010000:0.0:1787119519.658603:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 41) 00010000:00010000:0.0:1787119519.658607:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.658640:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 12 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.658677:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 12 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.658693:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653604224:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.659381:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462780 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.667886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.667918:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653604224:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.667957:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.668056:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80200, rc 0) 00000100:00100000:0.0:1787119519.668213:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633593472:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9693us (9983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.668222:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5249 00000100:00100000:2.0:1787119519.669543:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633593600 00000100:00100000:2.0:1787119519.669555:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633593600 00010000:00010000:2.0:1787119519.669598:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.669638:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5323 00000100:00100000:2.0:1787119519.669720:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633593600:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119519.669802:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119519.669899:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.670136:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.670164:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e3ca2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471633b expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.670400:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 41) 00010000:00010000:2.0:1787119519.670407:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 41) 00010000:00010000:2.0:1787119519.670417:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.670428:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.670544:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.670565:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653604352:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119519.670653:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.671333:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.671415:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633593728 00000100:00100000:2.0:1787119519.671422:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633593728 00000100:00100000:2.0:1787119519.671492:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5250 00000100:00100000:2.0:1787119519.671501:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633593728:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.671517:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.671534:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716349 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.671558:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.671567:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 41) 00010000:00010000:2.0:1787119519.671571:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 41) 00010000:00010000:2.0:1787119519.671575:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 14 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.671602:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.671625:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 25 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.671659:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653604480:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.671723:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.677076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.677248:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653604352:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.677278:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.677284:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633593856 00000100:00100000:2.0:1787119519.677292:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633593856 00002000:00100000:2.0:1787119519.677342:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63dc05f80 x1873929633593856/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.677354:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633593856 ext(192512->196607) 00010000:00010000:2.0:1787119519.677363:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.677373:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653604480:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119519.677389:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.677392:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 14 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.677398:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05f80 00010000:00010000:0.0:1787119519.677410:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119519.677425:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1191 00000100:00100000:2.0:1787119519.677434:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633593856:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119519.678131:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633593600:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8479us (10250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.678142:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5323 00000100:00100000:0.0:1787119519.678209:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633593728:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6709us (6878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.678217:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5250 00000100:00100000:2.0:1787119519.678336:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633593856:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 902us (1272us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.678342:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1191 00002000:00100000:2.0:1787119519.678348:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63dc05f80 x1873929633593856/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.678358:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633593856 ext(192512->196607) 00010000:00010000:2.0:1787119519.678364:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.678381:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.678386:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05f80 00000100:00100000:2.0:1787119519.683901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.684086:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633593984 00000100:00100000:1.0:1787119519.684109:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633593984 00000100:00100000:1.0:1787119519.684179:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5251 00000100:00100000:1.0:1787119519.684190:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633593984:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.684210:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.684233:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716350 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.684267:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 41) 00010000:00010000:1.0:1787119519.684278:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.684286:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 41) 00010000:00010000:1.0:1787119519.684292:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.684338:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.684354:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.684367:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119519.684435:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633593984:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 247us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.684487:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5251 00000100:00100000:3.0:1787119519.684823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.685474:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633594112 00000100:00100000:0.0:1787119519.685482:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633594112 00010000:00010000:0.0:1787119519.685513:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.685562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5324 00000100:00100000:0.0:1787119519.685571:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633594112:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.685585:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.685607:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.685634:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.685673:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e3ca9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716342 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.685691:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 41) 00010000:00010000:0.0:1787119519.685696:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 41) 00010000:00010000:0.0:1787119519.685705:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.685715:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.685761:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.685783:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 12 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.685797:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653604736:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.686429:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462780 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.691130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.691368:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633594240 00000100:00100000:3.0:1787119519.691376:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633594240 00002000:00100000:3.0:1787119519.691424:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a63dc04000 x1873929633594240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119519.691436:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633594240 ext(192512->229375) 00010000:00010000:3.0:1787119519.691473:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.691501:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119519.691509:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc04000 00000100:00100000:3.0:1787119519.691543:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1192 00000100:00100000:3.0:1787119519.691553:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633594240:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.693567:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653604736:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.693603:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.693721:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633594112:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8151us (8898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.693734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5324 00000100:00100000:2.0:1787119519.706177:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633594240:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 14615us (15046us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119519.706192:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1192 00002000:00100000:2.0:1787119519.706205:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (192512->229375) req@ffff92a63dc04000 x1873929633594240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.706215:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633594240 ext(192512->229375) 00010000:00010000:2.0:1787119519.706225:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.706882:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.706893:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc04000 00000100:00100000:2.0:1787119519.710402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.710500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.710565:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633594496 00000100:00100000:1.0:1787119519.710574:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633594496 00010000:00010000:1.0:1787119519.710607:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.710652:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5325 00000100:00100000:1.0:1787119519.710661:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633594496:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.710676:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.710699:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.710724:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.710750:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3cb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716349 expref: 13 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.710773:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 41) 00010000:00010000:1.0:1787119519.710778:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 41) 00010000:00010000:1.0:1787119519.710785:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.710797:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.710843:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.710858:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653604864:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.711124:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.711568:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633594368 00000100:00100000:3.0:1787119519.711573:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633594368 00000100:00100000:1.0:1787119519.711657:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5252 00000100:00100000:1.0:1787119519.711665:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633594368:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.711680:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.711696:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716357 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.711718:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.711726:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 41) 00010000:00010000:1.0:1787119519.711730:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 41) 00010000:00010000:1.0:1787119519.711735:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.711760:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.711779:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 25 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.711790:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653604992:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119519.711927:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6088b6900 going to sleep for 11 seconds 00010000:00010000:2.0:1787119519.714877:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119519.717351:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653604864:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.717378:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.717506:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633594496:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6844us (7005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.717517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5325 00000100:00100000:1.0:1787119519.718864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.719019:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633594624 00000100:00100000:3.0:1787119519.719027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633594624 00010000:00010000:3.0:1787119519.719075:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.719222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5326 00000100:00100000:3.0:1787119519.719244:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633594624:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.719261:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.719291:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.719321:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 26 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.719348:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 41) 00010000:00010000:3.0:1787119519.719353:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 41) 00010000:00010000:3.0:1787119519.719362:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.719375:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.719412:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.719425:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653605120:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.719523:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.722310:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653605120:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.722335:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.722396:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633594624:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3162us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.722408:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5326 00010000:00010000:0.0:1787119519.722530:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3cb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716350 expref: 25 pid: 20843 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.722551:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653604992:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.722576:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.722596:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:0.0:1787119519.722623:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633594368:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10959us (12232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.722630:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5252 00000100:00100000:1.0:1787119519.728121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.728196:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633594752 00000100:00100000:0.0:1787119519.728206:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633594752 00000100:00100000:0.0:1787119519.728263:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5253 00000100:00100000:0.0:1787119519.728274:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633594752:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.728295:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.728314:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471635e expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.728351:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 12 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.728362:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 41) 00010000:00010000:0.0:1787119519.728367:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 41) 00010000:00010000:0.0:1787119519.728372:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.728408:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 12 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.728429:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 12 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.728474:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653605248:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119519.728609:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.730954:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653605248:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119519.731004:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.731026:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80000, rc 0) 00000100:00100000:1.0:1787119519.731105:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633594752:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2832us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.731114:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5253 00000100:00100000:3.0:1787119519.731525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.731573:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633594880 00000100:00100000:0.0:1787119519.731582:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633594880 00010000:00010000:0.0:1787119519.731616:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 13 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.731660:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5327 00000100:00100000:0.0:1787119519.731671:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633594880:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.731686:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.731709:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 13 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.731744:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 13 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.731769:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716357 expref: 13 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.731784:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 41) 00010000:00010000:0.0:1787119519.731788:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 41) 00010000:00010000:0.0:1787119519.731797:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.731813:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.731846:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.731859:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653605376:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.731928:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.733798:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653605376:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.733836:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.733893:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633594880:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2222us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.733904:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5327 00000100:00100000:3.0:1787119519.734616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.734681:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633595008 00000100:00100000:2.0:1787119519.734689:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633595008 00002000:00100000:2.0:1787119519.734730:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63eabc380 x1873929633595008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.734741:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc380 with x1873929633595008 ext(192512->196607) 00002000:00010000:2.0:1787119519.734746:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc380 00000100:00100000:2.0:1787119519.734776:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10641 00000100:00100000:2.0:1787119519.734785:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2373:x1873929633595008:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.734987:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2373:x1873929633595008:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 203us (372us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.734994:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10641 00002000:00100000:2.0:1787119519.735001:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff92a63eabc380 x1873929633595008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.735009:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc380 with x1873929633595008 ext(192512->196607) 00002000:00010000:2.0:1787119519.735013:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc380 00000100:00100000:2.0:1787119519.738413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.738467:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633595136 00000100:00100000:0.0:1787119519.738477:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633595136 00002000:00100000:0.0:1787119519.738523:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (196608->200703) req@ffff92a63dc04700 x1873929633595136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.738534:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04700 with x1873929633595136 ext(196608->200703) 00002000:00010000:0.0:1787119519.738540:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04700 00000100:00100000:0.0:1787119519.738577:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10642 00000100:00100000:0.0:1787119519.738587:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2374:x1873929633595136:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.739044:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2374:x1873929633595136:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 457us (638us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119519.739061:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10642 00002000:00100000:0.0:1787119519.739069:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (196608->200703) req@ffff92a63dc04700 x1873929633595136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.739077:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04700 with x1873929633595136 ext(196608->200703) 00002000:00010000:0.0:1787119519.739081:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04700 00000100:00100000:0.0:1787119519.741272:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.741735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.741824:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633595392 00000100:00100000:1.0:1787119519.741834:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633595392 00002000:00100000:1.0:1787119519.741887:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (200704->204799) req@ffff92a63eabca80 x1873929633595392/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.741899:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabca80 with x1873929633595392 ext(200704->204799) 00002000:00010000:1.0:1787119519.741905:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabca80 00000100:00100000:1.0:1787119519.741937:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10643 00000100:00100000:1.0:1787119519.741947:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2373:x1873929633595392:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119519.742336:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2373:x1873929633595392:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 388us (599us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119519.742345:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10643 00002000:00100000:1.0:1787119519.742352:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (200704->204799) req@ffff92a63eabca80 x1873929633595392/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.742361:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabca80 with x1873929633595392 ext(200704->204799) 00002000:00010000:1.0:1787119519.742364:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabca80 00000100:00100000:2.0:1787119519.742424:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633595264 00000100:00100000:2.0:1787119519.742430:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633595264 00000100:00100000:2.0:1787119519.742531:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5254 00000100:00100000:2.0:1787119519.742539:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:33946:x1873929633595264:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.742549:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.742567:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716365 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.742601:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.742612:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 41) 00010000:00010000:2.0:1787119519.742616:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 41) 00010000:00010000:2.0:1787119519.742622:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.742727:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.742822:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 25 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.742838:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653605504:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.742947:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.745345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.745411:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633595520 00000100:00100000:2.0:1787119519.745420:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633595520 00002000:00100000:2.0:1787119519.745502:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a63eabc700 x1873929633595520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.745514:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633595520 ext(204800->208895) 00010000:00010000:2.0:1787119519.745522:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.745555:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.745563:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabc700 00000100:00100000:2.0:1787119519.745649:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1193 00000100:00100000:2.0:1787119519.745659:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633595520:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.745922:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633595520:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 263us (585us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.745930:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1193 00002000:00100000:2.0:1787119519.745937:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a63eabc700 x1873929633595520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.745944:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633595520 ext(204800->208895) 00010000:00010000:2.0:1787119519.745951:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.745977:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 26 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.745985:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabc700 00000100:00100000:0.0:1787119519.748235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.748323:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633595776 00000100:00100000:1.0:1787119519.748332:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633595776 00000100:00100000:1.0:1787119519.748387:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5255 00000100:00100000:1.0:1787119519.748397:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633595776:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.748414:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.748435:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471636c expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.748506:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 41) 00010000:00010000:1.0:1787119519.748511:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 41) 00010000:00010000:1.0:1787119519.748517:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.748529:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.748542:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119519.748589:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633595776:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 193us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.748596:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5255 00000100:00100000:2.0:1787119519.748749:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653605504:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119519.748774:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.748791:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92e00, rc 0) 00000100:00100000:2.0:1787119519.748814:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633595264:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6276us (7552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.748821:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5254 00000100:00100000:3.0:1787119519.750104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.750561:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633595648 00000100:00100000:0.0:1787119519.750570:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633595648 00002000:00100000:0.0:1787119519.750617:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->204799) req@ffff92a63eabdc00 x1873929633595648/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 12776/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.750628:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdc00 with x1873929633595648 ext(192512->204799) 00010000:00010000:0.0:1787119519.750649:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.750680:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.750689:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabdc00 00000100:00100000:0.0:1787119519.750726:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1194 00000100:00100000:0.0:1787119519.750745:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633595648:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119519.751467:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633595648:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 721us (1367us total) trans 4294969236 rc 0/0 00000100:00100000:0.0:1787119519.751474:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1194 00002000:00100000:0.0:1787119519.751481:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->204799) req@ffff92a63eabdc00 x1873929633595648/t4294969236(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 12776/448 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.751487:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdc00 with x1873929633595648 ext(192512->204799) 00010000:00010000:0.0:1787119519.751492:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 29 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.751508:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 29 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.751513:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabdc00 00000100:00100000:0.0:1787119519.753925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.754169:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633595904 00000100:00100000:1.0:1787119519.754180:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633595904 00010000:00010000:1.0:1787119519.754217:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 29 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.754259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5328 00000100:00100000:1.0:1787119519.754269:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633595904:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.754284:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787119519.754300:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119517 -> 1787119518 00002000:00010000:1.0:1787119519.754303:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119517 -> 1787119518 00010000:00010000:1.0:1787119519.754307:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 29 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.754331:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 29 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.754352:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e3cc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->18446744073709551615] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471635e expref: 29 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.754366:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 41) 00010000:00010000:1.0:1787119519.754370:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 41) 00010000:00010000:1.0:1787119519.754376:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.754382:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.754387:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 41) 00010000:00010000:1.0:1787119519.754389:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 41) 00010000:00010000:1.0:1787119519.754402:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.754409:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.754436:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.754699:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653605632:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.754786:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.754796:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653605760:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.754818:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6088b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.757653:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653605632:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.757669:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653605760:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119519.757693:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.757744:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633595904:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3476us (3828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.757756:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5328 00000100:00100000:3.0:1787119519.758561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.758625:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633596032 00000100:00100000:0.0:1787119519.758643:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633596032 00002000:00100000:0.0:1787119519.758690:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (192512->204799) req@ffff92a63eabd180 x1873929633596032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.758701:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd180 with x1873929633596032 ext(192512->204799) 00002000:00010000:0.0:1787119519.758706:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd180 00000100:00100000:0.0:1787119519.758937:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10644 00000100:00100000:0.0:1787119519.758948:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633596032:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119519.759545:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633596032:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 598us (987us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1787119519.759551:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10644 00002000:00100000:0.0:1787119519.759556:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (192512->204799) req@ffff92a63eabd180 x1873929633596032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/12728 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.759562:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd180 with x1873929633596032 ext(192512->204799) 00002000:00010000:0.0:1787119519.759565:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd180 00000100:00100000:0.0:1787119519.762912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.762961:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633596160 00000100:00100000:1.0:1787119519.762970:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633596160 00000100:00100000:1.0:1787119519.763036:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5256 00000100:00100000:1.0:1787119519.763057:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633596160:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.763075:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.763095:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716373 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.763123:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.763133:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 41) 00010000:00010000:1.0:1787119519.763137:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 41) 00010000:00010000:1.0:1787119519.763140:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.763165:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.763186:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 27 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.763195:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653605888:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119519.763266:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6088b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.765566:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653605888:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119519.765604:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.765869:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:0.0:1787119519.766100:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.766205:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633596288 00000100:00100000:3.0:1787119519.766213:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633596288 00010000:00010000:3.0:1787119519.766247:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 28 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.766286:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5329 00000100:00100000:3.0:1787119519.766294:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633596288:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.766308:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.766329:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 28 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.766355:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 28 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.766377:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3cd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471636c expref: 28 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.766391:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 41) 00010000:00010000:3.0:1787119519.766396:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 41) 00010000:00010000:3.0:1787119519.766405:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.766415:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.766505:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.766522:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653606016:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.766595:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.766721:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633596160:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3676us (3818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.766730:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5256 00000100:00100000:3.0:1787119519.768667:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653606016:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.768692:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.768746:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633596288:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2452us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.768756:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5329 00000100:00100000:0.0:1787119519.772483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.772515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.772592:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633596544 00000100:00100000:3.0:1787119519.772602:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633596544 00000100:00100000:3.0:1787119519.772656:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5257 00000100:00100000:3.0:1787119519.772665:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633596544:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.772682:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.772701:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471637a expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.772732:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.772742:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 41) 00010000:00010000:3.0:1787119519.772746:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 41) 00010000:00010000:3.0:1787119519.772751:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.772784:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.772811:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 13 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.772827:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653606144:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119519.772904:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999600 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.773148:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633596416 00000100:00100000:2.0:1787119519.773153:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633596416 00002000:00100000:2.0:1787119519.773188:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63414b100 x1873929633596416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.773198:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414b100 with x1873929633596416 ext(204800->241663) 00010000:00010000:2.0:1787119519.773204:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.773219:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.773225:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414b100 00000100:00100000:2.0:1787119519.773261:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1195 00000100:00100000:2.0:1787119519.773270:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633596416:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.777589:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633596416:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4308us (5102us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119519.777603:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1195 00002000:00100000:2.0:1787119519.777616:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63414b100 x1873929633596416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.777634:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414b100 with x1873929633596416 ext(204800->241663) 00010000:00010000:2.0:1787119519.777644:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.777675:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.777684:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414b100 00000100:00100000:3.0:1787119519.779662:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653606144:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.779698:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.779720:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb800, rc 0) 00000100:00100000:3.0:1787119519.779775:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633596544:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7110us (7257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.779783:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5257 00000100:00100000:0.0:1787119519.782993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.783090:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633596672 00000100:00100000:3.0:1787119519.783101:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633596672 00000100:00100000:3.0:1787119519.783166:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5258 00000100:00100000:3.0:1787119519.783176:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633596672:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.783194:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119519.783214:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716381 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.783266:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 41) 00010000:00010000:3.0:1787119519.783275:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.783283:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 41) 00010000:00010000:3.0:1787119519.783288:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.783328:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.783343:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.783355:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa200, rc 0) 00000100:00100000:3.0:1787119519.783415:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633596672:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 241us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.783422:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5258 00000100:00100000:0.0:1787119519.785933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.786211:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633596800 00000100:00100000:3.0:1787119519.786222:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633596800 00010000:00010000:3.0:1787119519.786275:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 15 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.786320:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5330 00000100:00100000:3.0:1787119519.786329:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633596800:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.786348:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.786370:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 15 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.786397:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 15 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.786422:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3cda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716373 expref: 15 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.786486:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 41) 00010000:00010000:3.0:1787119519.786491:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 41) 00010000:00010000:3.0:1787119519.786500:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.786509:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.786547:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.786563:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.786576:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653606400:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.786648:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999600 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.790120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.791192:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653606400:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.791221:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.791393:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633596800:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5064us (5478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.791405:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5330 00000100:00100000:2.0:1787119519.791582:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633596928 00000100:00100000:2.0:1787119519.791590:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633596928 00002000:00100000:2.0:1787119519.791640:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a634149180 x1873929633596928/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.791651:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149180 with x1873929633596928 ext(204800->208895) 00010000:00010000:2.0:1787119519.791660:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.791688:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.791696:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634149180 00000100:00100000:2.0:1787119519.791719:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1196 00000100:00100000:2.0:1787119519.791729:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633596928:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.792367:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633596928:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 637us (2256us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.792377:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1196 00002000:00100000:2.0:1787119519.792386:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a634149180 x1873929633596928/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.792396:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634149180 with x1873929633596928 ext(204800->208895) 00010000:00010000:2.0:1787119519.792402:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.792421:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.792428:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634149180 00000100:00100000:0.0:1787119519.795701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.795737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.795817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633597184 00000100:00100000:3.0:1787119519.795836:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633597184 00010000:00010000:3.0:1787119519.795878:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.795931:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5331 00000100:00100000:3.0:1787119519.795941:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2374:x1873929633597184:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.795956:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.795987:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.796013:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.796039:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3ce1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471637a expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.796065:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 41) 00010000:00010000:3.0:1787119519.796070:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 41) 00010000:00010000:3.0:1787119519.796080:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.796092:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.796133:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.796149:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653606528:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.796222:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999600 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.796761:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633597056 00000100:00100000:2.0:1787119519.796769:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633597056 00000100:00100000:2.0:1787119519.796809:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5259 00000100:00100000:2.0:1787119519.796816:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633597056:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.797061:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.797079:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716388 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.797104:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.797113:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 41) 00010000:00010000:2.0:1787119519.797118:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 41) 00010000:00010000:2.0:1787119519.797123:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.797150:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.797171:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 13 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.797183:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653606656:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.797228:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.801508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.801608:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653606528:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.801630:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.801686:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2374:x1873929633597184:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5746us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.801697:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5331 00000100:00100000:3.0:1787119519.801754:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633597312 00000100:00100000:3.0:1787119519.801761:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633597312 00010000:00010000:3.0:1787119519.801791:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 14 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.801834:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5332 00000100:00100000:3.0:1787119519.801843:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633597312:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.801855:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.801875:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 14 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.801899:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 14 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.801937:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 41) 00010000:00010000:3.0:1787119519.801942:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 41) 00010000:00010000:3.0:1787119519.801950:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.801961:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.802244:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.802261:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653606784:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.802326:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00010000:00010000:2.0:1787119519.803199:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ce8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716381 expref: 14 pid: 6693 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.803216:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653606656:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119519.804193:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653606784:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.804209:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.804268:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633597312:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2424us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.804278:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5332 00010000:00010000:2.0:1787119519.805182:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.805201:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119519.805249:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633597056:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8433us (9558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.805257:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5259 00000100:00100000:0.0:1787119519.811799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.811902:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633597440 00000100:00100000:1.0:1787119519.811922:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633597440 00000100:00100000:1.0:1787119519.811983:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5260 00000100:00100000:1.0:1787119519.811993:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633597440:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.812011:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.812029:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471638f expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.812072:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.812083:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 41) 00010000:00010000:1.0:1787119519.812087:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 41) 00010000:00010000:1.0:1787119519.812093:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.812128:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.812154:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 27 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.812170:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653606912:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119519.812253:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6088b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.814721:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653606912:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119519.814762:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.814791:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:1.0:1787119519.814856:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633597440:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2864us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.814865:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5260 00000100:00100000:0.0:1787119519.820082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.820172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.820187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633597568 00000100:00100000:3.0:1787119519.820198:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633597568 00010000:00010000:3.0:1787119519.820250:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 28 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.820292:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5333 00000100:00100000:3.0:1787119519.820303:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633597568:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.820318:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.820343:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 28 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.820371:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 28 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.820397:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3cef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716388 expref: 28 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.820414:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 41) 00010000:00010000:3.0:1787119519.820419:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 41) 00010000:00010000:3.0:1787119519.820428:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.820472:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.820513:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.820534:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653607040:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.820611:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.820963:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633597696 00000100:00100000:2.0:1787119519.820969:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633597696 00000100:00100000:2.0:1787119519.821086:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5261 00000100:00100000:2.0:1787119519.821094:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633597696:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.821109:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.821122:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716396 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.821143:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.821151:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 41) 00010000:00010000:2.0:1787119519.821154:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 41) 00010000:00010000:2.0:1787119519.821158:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 29 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.821179:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.821198:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 13 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.821210:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653607168:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.821252:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.827652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.827735:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633597824 00000100:00100000:0.0:1787119519.827744:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633597824 00002000:00100000:0.0:1787119519.827788:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a5066dd500 x1873929633597824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.827799:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633597824 ext(204800->241663) 00010000:00010000:0.0:1787119519.827808:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.827951:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.827961:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dd500 00000100:00100000:0.0:1787119519.827991:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1197 00000100:00100000:0.0:1787119519.828000:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633597824:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119519.830694:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653607040:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.830837:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.831079:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2376:x1873929633597568:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10775us (11005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.831104:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5333 00000100:00100000:2.0:1787119519.831603:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653607168:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119519.831628:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.831660:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119519.831691:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633597696:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10598us (11518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.831699:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5261 00000100:00100000:0.0:1787119519.834387:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633597824:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6380us (6737us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119519.834401:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1197 00002000:00100000:0.0:1787119519.834411:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a5066dd500 x1873929633597824/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.834419:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633597824 ext(204800->241663) 00010000:00010000:0.0:1787119519.834428:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.834482:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.834491:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dd500 00000100:00100000:1.0:1787119519.836985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.837194:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633597952 00000100:00100000:3.0:1787119519.837205:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633597952 00010000:00010000:3.0:1787119519.837255:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.837347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.837396:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633598080 00000100:00100000:0.0:1787119519.837401:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633598080 00000100:00100000:3.0:1787119519.837408:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5334 00000100:00100000:3.0:1787119519.837417:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633597952:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.837432:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787119519.837459:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5262 00000100:00100000:0.0:1787119519.837468:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633598080:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.837478:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 15 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.837482:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.837496:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471639d expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.837503:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 15 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.837577:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3cf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471638f expref: 16 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.837578:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 41) 00010000:00010000:0.0:1787119519.837587:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.837593:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 41) 00010000:00010000:0.0:1787119519.837599:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 15 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.837692:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 41) 00010000:00010000:3.0:1787119519.837697:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 41) 00010000:00010000:3.0:1787119519.837706:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.837716:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.837754:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.837770:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.837781:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.837784:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653607296:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.837791:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.837799:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653607424:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.837901:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.837901:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.840511:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653607424:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.840539:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.840613:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653607296:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.840638:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633597952:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3220us (3661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.840649:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5334 00000100:00100000:3.0:1787119519.840711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119519.840759:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.840781:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80600, rc 0) 00000100:00100000:0.0:1787119519.840808:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633598080:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3341us (3460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.840814:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633598208 00000100:00100000:0.0:1787119519.840814:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5262 00000100:00100000:2.0:1787119519.840832:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633598208 00002000:00100000:2.0:1787119519.840871:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a63eabc000 x1873929633598208/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.840878:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633598208 ext(204800->208895) 00010000:00010000:2.0:1787119519.840884:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.840906:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.840911:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabc000 00000100:00100000:2.0:1787119519.840940:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1198 00000100:00100000:2.0:1787119519.840949:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633598208:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.841161:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633598208:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 212us (450us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.841168:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1198 00002000:00100000:2.0:1787119519.841175:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a63eabc000 x1873929633598208/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.841184:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633598208 ext(204800->208895) 00010000:00010000:2.0:1787119519.841189:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.841202:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.841209:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabc000 00000100:00100000:0.0:1787119519.845998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.846057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.846129:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633598336 00000100:00100000:3.0:1787119519.846141:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633598336 00010000:00010000:3.0:1787119519.846184:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.846229:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5335 00000100:00100000:3.0:1787119519.846247:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633598336:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.846263:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.846290:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.846325:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.846358:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3cfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716396 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.846378:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 41) 00010000:00010000:3.0:1787119519.846383:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 41) 00010000:00010000:3.0:1787119519.846392:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.846402:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.846484:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.846500:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653607552:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.846572:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.848273:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633598464 00000100:00100000:2.0:1787119519.848287:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633598464 00000100:00100000:2.0:1787119519.848352:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5263 00000100:00100000:2.0:1787119519.848361:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633598464:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119519.848377:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119519.848395:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163a4 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.848423:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.848432:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 41) 00010000:00010000:2.0:1787119519.848478:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 41) 00010000:00010000:2.0:1787119519.848485:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.848517:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.848540:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 13 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.848553:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653607680:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.848623:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.854260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.854417:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653607680:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119519.854494:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.854518:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:2.0:1787119519.854573:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+29:33957:x1873929633598464:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6212us (8586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.854582:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5263 00000100:00100000:1.0:1787119519.854784:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633598592 00000100:00100000:1.0:1787119519.854792:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633598592 00002000:00100000:1.0:1787119519.854850:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63414a680 x1873929633598592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.854860:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414a680 with x1873929633598592 ext(204800->241663) 00010000:00010000:1.0:1787119519.854868:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 14 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.854895:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 14 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119519.854903:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414a680 00000100:00100000:1.0:1787119519.854938:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1199 00000100:00100000:1.0:1787119519.854948:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633598592:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119519.855131:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653607552:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.855145:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.855183:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633598336:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8939us (9126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.855195:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5335 00000100:00100000:1.0:1787119519.863515:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633598592:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 8555us (9251us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119519.863535:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1199 00002000:00100000:1.0:1787119519.863547:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63414a680 x1873929633598592/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119519.863558:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414a680 with x1873929633598592 ext(204800->241663) 00010000:00010000:1.0:1787119519.863568:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 14 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.863602:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 14 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119519.863611:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414a680 00000100:00100000:0.0:1787119519.869688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.869743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.870072:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633598848 00000100:00100000:2.0:1787119519.870083:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633598848 00010000:00010000:2.0:1787119519.870133:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 14 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.870180:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5336 00000100:00100000:2.0:1787119519.870189:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633598848:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119519.870203:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119519.870227:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 14 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.870254:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 14 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.870281:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057bf586f/0xcaba3de8463e3d04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471639d expref: 14 pid: 12469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.870300:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 41) 00010000:00010000:2.0:1787119519.870304:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 41) 00010000:00010000:2.0:1787119519.870313:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.870324:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.870362:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.870376:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653607808:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119519.870501:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.870754:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633598720 00000100:00100000:1.0:1787119519.870760:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633598720 00000100:00100000:1.0:1787119519.870804:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5264 00000100:00100000:1.0:1787119519.870812:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633598720:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119519.870828:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119519.870842:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163ab expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.870863:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.870870:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 41) 00010000:00010000:1.0:1787119519.870873:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 41) 00010000:00010000:1.0:1787119519.870879:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 15 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.871423:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.871477:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 27 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119519.871491:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653607936:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119519.871547:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.877908:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653607808:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119519.877934:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119519.878001:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633598848:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7810us (8255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119519.878012:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5336 00000100:00100000:1.0:1787119519.878171:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653607936:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119519.878210:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119519.878245:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119519.878275:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633598720:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7463us (8602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119519.878281:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5264 00000100:00100000:0.0:1787119519.880326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.880418:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633598976 00000100:00100000:2.0:1787119519.880428:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633598976 00002000:00100000:2.0:1787119519.880510:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a512846300 x1873929633598976/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.880520:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846300 with x1873929633598976 ext(204800->208895) 00010000:00010000:2.0:1787119519.880528:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 28 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.880557:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 28 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.880564:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512846300 00000100:00100000:2.0:1787119519.880601:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1200 00000100:00100000:2.0:1787119519.880611:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633598976:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.880816:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633598976:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 206us (499us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.880824:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1200 00002000:00100000:2.0:1787119519.880831:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a512846300 x1873929633598976/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.880840:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846300 with x1873929633598976 ext(204800->208895) 00010000:00010000:2.0:1787119519.880847:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 28 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.880860:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 28 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.880867:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512846300 00000100:00100000:0.0:1787119519.883628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.886791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.886984:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633599104 00000100:00100000:2.0:1787119519.886994:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633599104 00000100:00100000:3.0:1787119519.887061:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633599232 00000100:00100000:3.0:1787119519.887065:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633599232 00000100:00100000:2.0:1787119519.887074:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5265 00000100:00100000:2.0:1787119519.887083:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+29:33957:x1873929633599104:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119519.887090:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 29 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.887110:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787119519.887122:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5337 00000100:00100000:3.0:1787119519.887128:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634964380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633599232:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119519.887131:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163b2 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.887141:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119519.887156:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 41) 00010000:00010000:2.0:1787119519.887163:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.887176:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 41) 00010000:00010000:2.0:1787119519.887182:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 30 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.887482:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 30 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.887508:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 30 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.887531:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3d0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163a4 expref: 30 pid: 6696 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.887546:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 41) 00010000:00010000:3.0:1787119519.887550:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 41) 00010000:00010000:3.0:1787119519.887559:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.887568:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.887610:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.887626:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 13 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.887652:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653608064:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.887748:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999a80 going to sleep for 11 seconds 00010000:00010000:2.0:1787119519.890325:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 13 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.890348:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 13 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119519.890365:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653608192:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119519.890469:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.894350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.894629:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653608064:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.894877:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633599360 00000100:00100000:1.0:1787119519.894886:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633599360 00010000:00010000:3.0:1787119519.894923:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.894985:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634964380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633599232:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7855us (8204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.894996:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5337 00010000:00010000:3.0:1787119519.895832:0:6695:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.59@tcp) returned -22 from blocking AST (req@0000000054ba6e6f x1873929653608192) - normal race ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.895888:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.895914:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3d12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ab expref: 14 pid: 20841 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.895929:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653608192:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119519.895949:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 41) 00010000:00010000:3.0:1787119519.895954:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 41) 00010000:00010000:3.0:1787119519.895963:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.895974:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.896019:0:6695:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.896034:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653608320:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119519.896836:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 204 00000100:00100000:1.0:1787119519.896855:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633599360:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119519.896870:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119519.896873:0:5835:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie caba3de8463e3d12) 00010000:00010000:1.0:1787119519.896876:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119519.896949:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633599360:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 103us (2609us total) trans 0 rc 116/116 00000100:00100000:1.0:1787119519.896963:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 204 00000100:00100000:2.0:1787119519.897399:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.901990:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653608320:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.902051:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.902074:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:0.0:1787119519.902177:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633599104:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 15092us (18561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.902186:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5265 00000100:00100000:2.0:1787119519.904667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.905362:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633599488 00000100:00100000:0.0:1787119519.905373:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633599488 00000100:00100000:0.0:1787119519.905879:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5266 00000100:00100000:0.0:1787119519.905892:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633599488:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.905918:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.905938:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163b9 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.905982:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.905993:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 41) 00010000:00010000:0.0:1787119519.905998:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 41) 00010000:00010000:0.0:1787119519.906003:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.906058:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 27 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.906085:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 27 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.906108:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653608448:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.906198:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.910818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.910854:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633599616 00000100:00100000:3.0:1787119519.910864:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633599616 00010000:00010000:3.0:1787119519.910901:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.910938:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5338 00000100:00100000:3.0:1787119519.910949:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633599616:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.910965:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.911028:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.911066:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.911524:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 41) 00010000:00010000:3.0:1787119519.911531:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 41) 00010000:00010000:3.0:1787119519.911541:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.911552:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.911593:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.911608:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653608576:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.912006:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999a80 going to sleep for 11 seconds 00010000:00010000:0.0:1787119519.912740:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3d19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b2 expref: 28 pid: 6695 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.912760:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653608448:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.912791:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.912805:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:0.0:1787119519.913509:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633599488:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7615us (8848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.913519:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5266 00000100:00100000:0.0:1787119519.914509:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653608576:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.914531:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.914585:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633599616:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3637us (3776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.914596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5338 00000100:00100000:3.0:1787119519.917968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.920619:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633599744 00000100:00100000:0.0:1787119519.920636:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633599744 00002000:00100000:0.0:1787119519.920700:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63eabd500 x1873929633599744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.920714:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd500 with x1873929633599744 ext(204800->241663) 00002000:00010000:0.0:1787119519.920721:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd500 00000100:00100000:0.0:1787119519.920812:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10645 00000100:00100000:0.0:1787119519.920835:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633599744:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119519.924205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.925149:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633599872 00000100:00100000:0.0:1787119519.925162:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633599872 00000100:00100000:0.0:1787119519.925239:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5267 00000100:00100000:0.0:1787119519.925251:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633599872:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.925274:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.925300:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163c0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.925336:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 15 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.925346:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(132 41) 00010000:00010000:0.0:1787119519.925351:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 41) 00010000:00010000:0.0:1787119519.925356:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.925398:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 15 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.925433:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 15 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.925474:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653608704:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.925560:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.931268:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633599744:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 10435us (13301us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119519.931282:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10645 00002000:00100000:0.0:1787119519.931297:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63eabd500 x1873929633599744/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:555/0 lens 488/440 e 0 to 0 dl 1787119530 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119519.931308:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd500 with x1873929633599744 ext(204800->241663) 00010000:00010000:0.0:1787119519.931318:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.931347:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119519.931355:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabd500 00000100:00100000:0.0:1787119519.935297:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653608704:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.935334:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.935361:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38c00, rc 0) 00000100:00100000:0.0:1787119519.935427:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633599872:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10177us (11232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.935472:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5267 00000100:00100000:1.0:1787119519.942748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.942799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.942952:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633600128 00000100:00100000:3.0:1787119519.942972:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633600128 00010000:00010000:3.0:1787119519.943031:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.943078:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5339 00000100:00100000:3.0:1787119519.943088:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633600128:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.943104:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.943127:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.943156:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.943185:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e3d20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163b9 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.943205:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 41) 00010000:00010000:3.0:1787119519.943210:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 41) 00010000:00010000:3.0:1787119519.943219:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.943230:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.943267:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.943282:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653608832:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.943375:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119519.943843:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633600000 00000100:00100000:0.0:1787119519.943849:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633600000 00000100:00100000:0.0:1787119519.943892:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5268 00000100:00100000:0.0:1787119519.943900:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633600000:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.943916:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.943930:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163c7 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.943963:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.943983:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 41) 00010000:00010000:0.0:1787119519.943987:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 41) 00010000:00010000:0.0:1787119519.943993:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 15 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.944018:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.944699:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 27 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.944715:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653608960:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.944784:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119519.950819:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653608832:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.950858:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.950932:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633600128:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7843us (8131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.950947:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5339 00000100:00100000:1.0:1787119519.952562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119519.953118:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633600256 00000100:00100000:2.0:1787119519.953129:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633600256 00002000:00100000:2.0:1787119519.953185:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a5066df480 x1873929633600256/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.953196:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633600256 ext(204800->208895) 00010000:00010000:2.0:1787119519.953206:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.953308:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.953318:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066df480 00000100:00100000:2.0:1787119519.953356:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1201 00000100:00100000:2.0:1787119519.953367:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633600256:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.953601:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633600256:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 235us (1047us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.953609:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1201 00002000:00100000:2.0:1787119519.953615:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a5066df480 x1873929633600256/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.953623:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633600256 ext(204800->208895) 00010000:00010000:2.0:1787119519.953628:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.953643:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.953650:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066df480 00000100:00100000:2.0:1787119519.956955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.957390:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653608960:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.957429:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.957472:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119519.957532:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633600000:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13632us (14796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.957541:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5268 00000100:00100000:0.0:1787119519.957574:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633600384 00000100:00100000:0.0:1787119519.957581:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633600384 00000100:00100000:0.0:1787119519.957638:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5269 00000100:00100000:0.0:1787119519.957647:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633600384:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.957662:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.957680:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163ce expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.957705:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 41) 00010000:00010000:0.0:1787119519.957713:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.957720:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 41) 00010000:00010000:0.0:1787119519.957726:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 29 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.957760:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.957772:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 29 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.957781:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38200, rc 0) 00000100:00100000:0.0:1787119519.957804:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+29:33957:x1873929633600384:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 159us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.957811:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5269 00000100:00100000:1.0:1787119519.961171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119519.961343:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633600512 00000100:00100000:3.0:1787119519.961354:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633600512 00010000:00010000:3.0:1787119519.961395:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 29 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.961495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5340 00000100:00100000:3.0:1787119519.961507:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633600512:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.961524:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.961547:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 29 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.961574:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 29 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.961601:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c0 expref: 29 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.961621:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 41) 00010000:00010000:3.0:1787119519.961626:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 41) 00010000:00010000:3.0:1787119519.961635:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.961647:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.961688:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.961704:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 13 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.961719:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653609216:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.961865:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119519.971471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.971558:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633600640 00000100:00100000:0.0:1787119519.971568:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633600640 00010000:00010000:0.0:1787119519.971606:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 14 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.971655:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5341 00000100:00100000:0.0:1787119519.971665:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633600640:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119519.971680:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119519.971704:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 14 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.971730:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 14 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.971761:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 41) 00010000:00010000:0.0:1787119519.971767:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 41) 00010000:00010000:0.0:1787119519.971775:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.971785:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.971837:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.971853:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653609344:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119519.971937:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462d80 going to sleep for 11 seconds 00010000:00010000:3.0:1787119519.974033:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3d2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163c7 expref: 14 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.974071:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653609216:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119519.974094:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119519.974166:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633600512:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12659us (13002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119519.974176:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5340 00000100:00100000:0.0:1787119519.980504:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653609344:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119519.980537:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119519.980592:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633600640:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8927us (9129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.980604:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5341 00000100:00100000:2.0:1787119519.985333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.985405:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633600768 00000100:00100000:0.0:1787119519.985416:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633600768 00000100:00100000:0.0:1787119519.985499:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5270 00000100:00100000:0.0:1787119519.985509:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633600768:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.985527:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.985548:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163d5 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.985583:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.985593:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 41) 00010000:00010000:0.0:1787119519.985598:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 41) 00010000:00010000:0.0:1787119519.985603:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.985637:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.985662:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 27 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119519.985678:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653609472:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119519.985763:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119519.990586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.991299:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653609472:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119519.991336:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 14 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.991358:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119519.991426:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633600768:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5918us (6103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.991475:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5270 00000100:00100000:2.0:1787119519.992626:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633600896 00000100:00100000:2.0:1787119519.992639:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633600896 00002000:00100000:2.0:1787119519.992691:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a5066dea00 x1873929633600896/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/0 e 0 to 0 dl 1787119530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.992702:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633600896 ext(204800->208895) 00010000:00010000:2.0:1787119519.992710:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 28 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.992740:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 28 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.992749:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dea00 00000100:00100000:2.0:1787119519.992786:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1202 00000100:00100000:2.0:1787119519.992797:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633600896:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119519.993247:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633600896:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 450us (2672us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119519.993255:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1202 00002000:00100000:2.0:1787119519.993263:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a5066dea00 x1873929633600896/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787119530 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119519.993271:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633600896 ext(204800->208895) 00010000:00010000:2.0:1787119519.993278:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 28 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119519.993293:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 28 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119519.993300:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dea00 00000100:00100000:1.0:1787119519.997420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119519.997504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119519.997586:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633601024 00000100:00100000:0.0:1787119519.997594:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633601024 00000100:00100000:0.0:1787119519.997644:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5271 00000100:00100000:0.0:1787119519.997654:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633601024:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119519.997672:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119519.997693:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163dc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.997724:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 41) 00010000:00010000:0.0:1787119519.997732:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.997739:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 41) 00010000:00010000:0.0:1787119519.997743:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.997784:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.997796:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119519.997805:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38800, rc 0) 00000100:00100000:0.0:1787119519.997859:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+29:33957:x1873929633601024:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 208us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119519.997866:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5271 00000100:00100000:3.0:1787119519.997979:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633601152 00000100:00100000:3.0:1787119519.997983:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633601152 00010000:00010000:3.0:1787119519.998001:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 29 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.998025:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5342 00000100:00100000:3.0:1787119519.998031:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633601152:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119519.998052:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119519.998076:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 29 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.998100:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 29 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.998121:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3d35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ce expref: 29 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.998137:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 41) 00010000:00010000:3.0:1787119519.998141:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 41) 00010000:00010000:3.0:1787119519.998149:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.998159:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.998186:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119519.998201:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 13 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119519.998211:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653609728:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119519.998255:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.002150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.002266:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633601280 00000100:00100000:0.0:1787119520.002276:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633601280 00002000:00100000:0.0:1787119520.002342:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63eabd880 x1873929633601280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.002351:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd880 with x1873929633601280 ext(204800->241663) 00010000:00010000:0.0:1787119520.002359:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.002383:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.002388:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabd880 00000100:00100000:0.0:1787119520.002414:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1203 00000100:00100000:0.0:1787119520.002422:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633601280:12345-192.168.201.59@tcp:3:kworker.0 00000100:00080000:1.0:1787119520.003109:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119520.003491:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653609728:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.003515:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.003564:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633601152:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5532us (6059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.003574:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5342 00000100:00100000:0.0:1787119520.008521:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633601280:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6091us (6375us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119520.008532:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1203 00002000:00100000:0.0:1787119520.008542:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63eabd880 x1873929633601280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.008550:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd880 with x1873929633601280 ext(204800->241663) 00010000:00010000:0.0:1787119520.008558:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.008587:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.008592:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabd880 00000100:00100000:2.0:1787119520.012310:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.012341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.012403:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633601408 00000100:00100000:3.0:1787119520.012413:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633601408 00000100:00100000:3.0:1787119520.012479:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5272 00000100:00100000:3.0:1787119520.012487:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633601408:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.012502:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.012519:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163e3 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.012545:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 41) 00010000:00010000:3.0:1787119520.012551:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.012556:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 41) 00010000:00010000:3.0:1787119520.012560:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 15 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.012590:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.012598:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 15 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.012607:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb000, rc 0) 00000100:00100000:3.0:1787119520.012668:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633601408:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 181us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.012675:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5272 00000100:00100000:1.0:1787119520.013224:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633601536 00000100:00100000:1.0:1787119520.013228:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633601536 00010000:00010000:1.0:1787119520.013249:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 15 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.013275:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5343 00000100:00100000:1.0:1787119520.013280:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2374:x1873929633601536:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119520.013288:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119520.013305:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 15 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.013325:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 15 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.013342:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3d3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163d5 expref: 15 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.013355:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 41) 00010000:00010000:1.0:1787119520.013358:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 41) 00010000:00010000:1.0:1787119520.013364:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.013371:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.013390:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.013400:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 27 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.013410:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653609984:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119520.013615:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066749c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119520.016397:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653609984:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119520.016423:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.017618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.017695:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633601664 00000100:00100000:3.0:1787119520.017703:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633601664 00010000:00010000:3.0:1787119520.017761:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.017803:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5344 00000100:00100000:3.0:1787119520.017811:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633601664:12345-192.168.201.59@tcp:103:ldlm_bl.0 00000100:00080000:1.0:1787119520.017887:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787119520.017938:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.018079:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.018107:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.018131:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3d43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163dc expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.018150:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 41) 00010000:00010000:3.0:1787119520.018154:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 41) 00010000:00010000:3.0:1787119520.018162:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.018172:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.018208:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.018219:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653610112:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.018328:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.018801:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2374:x1873929633601536:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5518us (6455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.018809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5343 00000100:00100000:3.0:1787119520.021356:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653610112:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119520.021378:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119520.021598:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633601664:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3787us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.021607:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5344 00000100:00100000:2.0:1787119520.029737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.029903:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633601792 00000100:00100000:1.0:1787119520.029912:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633601792 00000100:00100000:1.0:1787119520.029979:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5273 00000100:00100000:1.0:1787119520.029987:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633601792:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.030004:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.030022:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163ea expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.030067:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.030078:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 41) 00010000:00010000:1.0:1787119520.030082:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 41) 00010000:00010000:1.0:1787119520.030087:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.030116:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.030137:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 13 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.030147:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653610240:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119520.030222:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066749c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.033763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.033814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.033846:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633601920 00000100:00100000:3.0:1787119520.033856:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633601920 00010000:00010000:3.0:1787119520.033896:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 14 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.033943:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633602048 00000100:00100000:3.0:1787119520.033947:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5345 00000100:00100000:0.0:1787119520.033947:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633602048 00000100:00100000:3.0:1787119520.033956:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633601920:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119520.033970:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787119520.033987:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5274 00010000:00010000:3.0:1787119520.033991:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 15 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.033994:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633602048:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.034008:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.034023:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163f1 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.034028:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 15 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.034057:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 41) 00010000:00010000:0.0:1787119520.034066:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.034074:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(143 41) 00010000:00010000:0.0:1787119520.034131:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.034218:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653610240:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119520.035361:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163e3 expref: 16 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.035383:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 41) 00010000:00010000:3.0:1787119520.035388:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 41) 00010000:00010000:3.0:1787119520.038573:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.038595:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.040325:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.040369:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70080400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.040388:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653610368:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119520.040841:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787119520.044064:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70080400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.044085:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.044116:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119520.044201:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633601792:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 14212us (14472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.044211:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5273 00010000:00010000:2.0:1787119520.045328:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 27 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.045345:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 27 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.045364:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653610496:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.045436:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.049091:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653610368:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.049236:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 15 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.049260:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38a00, rc 0) 00000100:00100000:0.0:1787119520.049322:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633602048:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 15326us (15506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.049332:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5274 00000100:00100000:3.0:1787119520.054503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.055245:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653610496:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.055275:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.055349:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633601920:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 21393us (21594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.055361:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5345 00000100:00100000:0.0:1787119520.056332:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633602176 00000100:00100000:0.0:1787119520.056343:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633602176 00002000:00100000:0.0:1787119520.056396:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a63eabe680 x1873929633602176/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.056406:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe680 with x1873929633602176 ext(204800->208895) 00010000:00010000:0.0:1787119520.056414:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.056496:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.056511:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabe680 00000100:00100000:0.0:1787119520.056548:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1204 00000100:00100000:0.0:1787119520.056559:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633602176:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119520.056779:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633602176:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 220us (2284us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119520.056786:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1204 00002000:00100000:0.0:1787119520.056794:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a63eabe680 x1873929633602176/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.056802:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe680 with x1873929633602176 ext(204800->208895) 00010000:00010000:0.0:1787119520.056806:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.056819:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 28 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.056826:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabe680 00000100:00100000:3.0:1787119520.068318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.068476:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633602304 00000100:00100000:1.0:1787119520.068487:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633602304 00000100:00100000:1.0:1787119520.068551:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5275 00000100:00100000:1.0:1787119520.068560:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633602304:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.068579:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.068597:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163f8 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.068630:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 41) 00010000:00010000:1.0:1787119520.068639:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.068646:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 41) 00010000:00010000:1.0:1787119520.068651:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 29 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.068692:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.068707:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 29 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.068719:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:1.0:1787119520.068794:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+29:33957:x1873929633602304:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 234us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.068801:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5275 00000100:00100000:3.0:1787119520.072120:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.072368:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633602432 00000100:00100000:2.0:1787119520.072379:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633602432 00010000:00010000:2.0:1787119520.072421:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 29 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.072499:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5346 00000100:00100000:2.0:1787119520.072509:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633602432:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.072525:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.072548:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 29 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.072576:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 29 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.072603:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3d51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ea expref: 29 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.072621:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(146 41) 00010000:00010000:2.0:1787119520.072626:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(146 41) 00010000:00010000:2.0:1787119520.072635:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.072646:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.072688:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.072704:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 13 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.072719:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653610752:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.072827:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.076376:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653610752:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.076406:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.076513:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633602432:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4004us (4402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.076524:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5346 00000100:00100000:3.0:1787119520.088568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.089077:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633602560 00000100:00100000:1.0:1787119520.089088:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633602560 00002000:00100000:1.0:1787119520.089139:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63eabf800 x1873929633602560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.089151:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf800 with x1873929633602560 ext(204800->241663) 00010000:00010000:1.0:1787119520.089161:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.089194:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.089202:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabf800 00000100:00100000:2.0:1787119520.089393:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1205 00000100:00100000:2.0:1787119520.089406:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633602560:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.108002:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633602560:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 18585us (19434us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119520.108032:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1205 00002000:00100000:2.0:1787119520.108056:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63eabf800 x1873929633602560/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.108067:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf800 with x1873929633602560 ext(204800->241663) 00010000:00010000:2.0:1787119520.108078:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.108121:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 14 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.108130:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabf800 00000100:00100000:3.0:1787119520.111337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.111482:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633602688 00000100:00100000:0.0:1787119520.111494:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633602688 00000100:00100000:0.0:1787119520.111552:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5276 00000100:00100000:0.0:1787119520.111562:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633602688:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.111581:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.111601:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047163ff expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.111635:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(146 41) 00010000:00010000:0.0:1787119520.111644:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 27 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.111651:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 41) 00010000:00010000:0.0:1787119520.111655:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 15 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.111695:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 27 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.111709:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 15 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.111733:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39600, rc 0) 00000100:00100000:0.0:1787119520.111800:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633602688:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 240us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.111807:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5276 00000100:00100000:3.0:1787119520.113746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.113886:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633602816 00000100:00100000:0.0:1787119520.113896:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633602816 00010000:00010000:0.0:1787119520.113947:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 15 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.113988:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5347 00000100:00100000:0.0:1787119520.113998:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633602816:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.114013:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.114055:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 15 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.114081:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 15 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.114119:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f1 expref: 15 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.114140:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 41) 00010000:00010000:0.0:1787119520.114145:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 41) 00010000:00010000:0.0:1787119520.114154:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 27 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.114164:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 27 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.114201:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 27 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.114222:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 27 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.114405:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653611008:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.114540:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.130966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.131263:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633602944 00000100:00100000:3.0:1787119520.131273:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633602944 00010000:00010000:3.0:1787119520.131316:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 28 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.131363:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5348 00000100:00100000:3.0:1787119520.131374:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633602944:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119520.131393:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.131419:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 28 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.131481:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 28 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.131511:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 41) 00010000:00010000:3.0:1787119520.131517:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 41) 00010000:00010000:3.0:1787119520.131527:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.131538:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.131577:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 14 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.131591:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653611136:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.131666:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00010000:00010000:0.0:1787119520.132502:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e3d5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163f8 expref: 28 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.132525:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653611008:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.132547:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.132602:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633602816:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 18603us (18862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.132611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5347 00000100:00100000:3.0:1787119520.134966:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653611136:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119520.134991:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119520.135110:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633602944:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3736us (4153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.135122:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5348 00000100:00100000:1.0:1787119520.157732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.158122:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633603072 00000100:00100000:0.0:1787119520.158134:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633603072 00000100:00100000:0.0:1787119520.158200:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5277 00000100:00100000:0.0:1787119520.158211:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633603072:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.158243:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.158266:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716406 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.158302:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.158317:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 41) 00010000:00010000:0.0:1787119520.158321:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 41) 00010000:00010000:0.0:1787119520.158326:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.158361:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 13 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.158389:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 13 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.158404:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653611264:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119520.158502:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.161114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.161602:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633603200 00000100:00100000:1.0:1787119520.161612:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633603200 00002000:00100000:1.0:1787119520.161658:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63414f480 x1873929633603200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.161669:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f480 with x1873929633603200 ext(204800->241663) 00010000:00010000:1.0:1787119520.161678:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 14 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.161711:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 14 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.161719:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414f480 00000100:00100000:1.0:1787119520.161749:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1206 00000100:00100000:1.0:1787119520.161758:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633603200:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.175058:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633603200:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 13277us (13946us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119520.175072:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1206 00002000:00100000:3.0:1787119520.175085:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a63414f480 x1873929633603200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.175097:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f480 with x1873929633603200 ext(204800->241663) 00010000:00010000:3.0:1787119520.175107:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 14 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.175137:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 14 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.175145:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414f480 00000100:00100000:2.0:1787119520.178505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.178783:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653611264:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.178820:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.178843:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38a00, rc 0) 00000100:00100000:0.0:1787119520.178918:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633603072:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 20709us (21207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.178927:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5277 00000100:00100000:0.0:1787119520.178959:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633603328 00000100:00100000:0.0:1787119520.178965:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633603328 00000100:00100000:0.0:1787119520.179011:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5278 00000100:00100000:0.0:1787119520.179020:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633603328:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.179035:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.179065:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471640d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.179099:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 41) 00010000:00010000:0.0:1787119520.179107:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.179114:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(150 41) 00010000:00010000:0.0:1787119520.179119:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 15 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.179158:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.179169:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 15 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.179178:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38c00, rc 0) 00000100:00100000:0.0:1787119520.179217:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633603328:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 198us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.179223:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5278 00000100:00100000:2.0:1787119520.182640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.182872:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633603456 00000100:00100000:0.0:1787119520.182883:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633603456 00010000:00010000:0.0:1787119520.182932:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 15 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.182970:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5349 00000100:00100000:0.0:1787119520.182978:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633603456:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.182993:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.183015:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 15 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.183953:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 15 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.183984:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3d66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047163ff expref: 15 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.184007:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 41) 00010000:00010000:0.0:1787119520.184012:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 41) 00010000:00010000:0.0:1787119520.184189:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.184200:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.184379:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.184396:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 27 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.184412:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653611520:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.184531:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.189925:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653611520:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.189957:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.190027:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633603456:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7041us (7390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.190045:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5349 00000100:00100000:3.0:1787119520.199214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.204318:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633603584 00000100:00100000:1.0:1787119520.204334:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633603584 00002000:00100000:2.0:1787119520.204594:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a509231f80 x1873929633603584/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.204608:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231f80 with x1873929633603584 ext(204800->208895) 00010000:00010000:2.0:1787119520.204618:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.204649:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.204658:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231f80 00000100:00100000:2.0:1787119520.204696:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1207 00000100:00100000:2.0:1787119520.204706:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633603584:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.205112:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633603584:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 405us (5911us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119520.205120:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1207 00002000:00100000:2.0:1787119520.205128:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a509231f80 x1873929633603584/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.205136:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231f80 with x1873929633603584 ext(204800->208895) 00010000:00010000:2.0:1787119520.205142:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.205163:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 28 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.205171:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231f80 00000100:00100000:0.0:1787119520.210073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.210175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.210698:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633603840 00000100:00100000:3.0:1787119520.210709:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633603840 00000100:00100000:3.0:1787119520.210770:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5279 00000100:00100000:3.0:1787119520.210781:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633603840:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.210801:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.210836:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716414 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.210870:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 41) 00010000:00010000:3.0:1787119520.210879:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.210893:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(152 41) 00010000:00010000:3.0:1787119520.210898:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 29 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.210956:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.210972:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 29 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.210998:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fbe00, rc 0) 00000100:00100000:3.0:1787119520.211077:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+29:33957:x1873929633603840:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 296us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.211084:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5279 00000100:00100000:2.0:1787119520.212732:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633603712 00000100:00100000:2.0:1787119520.212744:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633603712 00010000:00010000:2.0:1787119520.212784:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 29 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.212929:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5350 00000100:00100000:2.0:1787119520.212939:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633603712:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.212952:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.212985:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 29 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.213011:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 29 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.213036:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3d6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716406 expref: 29 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.213065:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 41) 00010000:00010000:2.0:1787119520.213079:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 41) 00010000:00010000:2.0:1787119520.213088:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.213100:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.213138:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.213155:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 13 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.213170:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653611776:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.213358:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.217201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.217312:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653611776:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.217338:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.217390:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633603712:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4453us (7330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.217402:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5350 00000100:00100000:2.0:1787119520.218865:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633603968 00000100:00100000:2.0:1787119520.218878:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633603968 00010000:00010000:2.0:1787119520.218928:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 14 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.218962:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5351 00000100:00100000:2.0:1787119520.218971:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633603968:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.218998:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.219020:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 14 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.219053:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 14 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.219080:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3d74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471640d expref: 14 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.219100:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 41) 00010000:00010000:2.0:1787119520.219104:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 41) 00010000:00010000:2.0:1787119520.219113:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.219123:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.219158:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.219171:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653611904:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.219261:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.222407:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653611904:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.222467:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.222528:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633603968:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3557us (5336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.222541:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5351 00000100:00100000:2.0:1787119520.229727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.229856:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633604096 00000100:00100000:3.0:1787119520.229866:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633604096 00000100:00100000:3.0:1787119520.229933:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5280 00000100:00100000:3.0:1787119520.229943:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633604096:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.229961:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.229980:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471641b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.230013:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.230024:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 41) 00010000:00010000:3.0:1787119520.230029:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 41) 00010000:00010000:3.0:1787119520.230034:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 14 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.230079:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.230104:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 27 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.230120:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653612032:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119520.230212:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.233385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.233495:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653612032:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.233527:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 14 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.233552:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb000, rc 0) 00000100:00100000:2.0:1787119520.233616:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633604096:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3673us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.233624:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5280 00000100:00100000:0.0:1787119520.233737:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633604224 00000100:00100000:0.0:1787119520.233744:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633604224 00010000:00010000:0.0:1787119520.233776:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 28 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.233810:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5352 00000100:00100000:0.0:1787119520.233828:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633604224:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.233842:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.233862:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 28 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.233886:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 28 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.233923:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3d7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716414 expref: 28 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.233938:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 41) 00010000:00010000:0.0:1787119520.233943:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 41) 00010000:00010000:0.0:1787119520.233951:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.233962:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.234227:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.234249:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653612160:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.234309:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.237640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.238050:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653612160:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.238077:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.238137:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633604224:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4318us (4760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.238149:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5352 00000100:00100000:1.0:1787119520.238237:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633604352 00000100:00100000:1.0:1787119520.238248:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633604352 00000100:00100000:1.0:1787119520.238292:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5281 00000100:00100000:1.0:1787119520.238299:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633604352:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.238313:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.238328:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716422 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.238354:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.238360:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 41) 00010000:00010000:1.0:1787119520.238363:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 41) 00010000:00010000:1.0:1787119520.238366:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.238394:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.238414:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 13 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.238424:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653612288:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119520.238485:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.241858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.241932:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633604480 00000100:00100000:0.0:1787119520.241943:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633604480 00002000:00100000:0.0:1787119520.241991:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a509233800 x1873929633604480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.242003:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233800 with x1873929633604480 ext(204800->241663) 00010000:00010000:0.0:1787119520.242012:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.242050:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.242058:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509233800 00000100:00100000:0.0:1787119520.242087:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1208 00000100:00100000:0.0:1787119520.242104:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633604480:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119520.246429:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653612288:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119520.246509:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.246535:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:1.0:1787119520.246601:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633604352:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8299us (8968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.246611:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5281 00000100:00100000:2.0:1787119520.250169:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633604480:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 8061us (8308us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119520.250184:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1208 00002000:00100000:2.0:1787119520.250199:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a509233800 x1873929633604480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.250210:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233800 with x1873929633604480 ext(204800->241663) 00010000:00010000:2.0:1787119520.250220:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.250269:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.250278:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509233800 00000100:00100000:3.0:1787119520.253784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.253842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.254190:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633604608 00000100:00100000:2.0:1787119520.254201:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633604608 00000100:00100000:2.0:1787119520.254270:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5282 00000100:00100000:2.0:1787119520.254281:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633604608:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.254300:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.254321:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716429 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.254352:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 41) 00010000:00010000:2.0:1787119520.254362:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.254369:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(156 41) 00010000:00010000:2.0:1787119520.254374:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.254416:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.254431:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 15 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.254493:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119520.254548:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633604608:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 268us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.254555:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5282 00000100:00100000:0.0:1787119520.254674:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633604736 00000100:00100000:0.0:1787119520.254680:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633604736 00010000:00010000:0.0:1787119520.254701:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 15 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.254734:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5353 00000100:00100000:0.0:1787119520.254741:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633604736:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.254751:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.254773:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 15 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.254797:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 15 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.254828:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3d82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471641b expref: 15 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.254843:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 41) 00010000:00010000:0.0:1787119520.254847:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 41) 00010000:00010000:0.0:1787119520.254854:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.254864:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.254890:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.254916:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 27 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.254931:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653612544:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.255002:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.259380:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653612544:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.259408:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.259509:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633604736:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4767us (5665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.259520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5353 00000100:00100000:1.0:1787119520.260864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.261029:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633604864 00000100:00100000:3.0:1787119520.261047:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633604864 00002000:00100000:3.0:1787119520.261096:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a5066df800 x1873929633604864/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.261108:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df800 with x1873929633604864 ext(204800->208895) 00010000:00010000:3.0:1787119520.261119:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.261152:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.261161:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066df800 00000100:00100000:3.0:1787119520.261198:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1209 00000100:00100000:3.0:1787119520.261209:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633604864:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.261424:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633604864:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 213us (563us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119520.261431:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1209 00002000:00100000:3.0:1787119520.261470:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a5066df800 x1873929633604864/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.261478:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df800 with x1873929633604864 ext(204800->208895) 00010000:00010000:3.0:1787119520.261483:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.261496:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.261503:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066df800 00000100:00100000:1.0:1787119520.266570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.266614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.266699:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633605120 00000100:00100000:3.0:1787119520.266710:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633605120 00010000:00010000:3.0:1787119520.266756:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.266805:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5354 00000100:00100000:3.0:1787119520.266825:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2374:x1873929633605120:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119520.266841:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.266865:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.266894:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.266933:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3d89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716422 expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.266952:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 41) 00010000:00010000:3.0:1787119520.266957:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 41) 00010000:00010000:3.0:1787119520.266965:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 13 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.266976:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 13 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.267014:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 13 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.267035:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653612672:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.267132:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.267599:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633604992 00000100:00100000:0.0:1787119520.267604:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633604992 00000100:00100000:0.0:1787119520.267647:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5283 00000100:00100000:0.0:1787119520.267656:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633604992:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.267672:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.267687:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716430 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.267712:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 13 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.267720:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 41) 00010000:00010000:0.0:1787119520.267724:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 41) 00010000:00010000:0.0:1787119520.267729:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 29 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.267756:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 13 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.267773:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 13 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.267786:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653612800:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119520.267842:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.274553:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653612672:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119520.274581:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119520.274641:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2374:x1873929633605120:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7826us (8024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.274653:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5354 00000100:00100000:0.0:1787119520.274746:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653612800:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.274769:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.274791:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38600, rc 0) 00000100:00100000:0.0:1787119520.274818:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633604992:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7164us (8257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.274825:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5283 00000100:00100000:3.0:1787119520.277697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.277811:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633605248 00000100:00100000:2.0:1787119520.277831:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633605248 00010000:00010000:2.0:1787119520.277873:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 14 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.277927:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5355 00000100:00100000:2.0:1787119520.277936:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633605248:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.277954:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.277989:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 14 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.278018:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 14 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.278057:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716429 expref: 14 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.278086:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 41) 00010000:00010000:2.0:1787119520.278091:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 41) 00010000:00010000:2.0:1787119520.278101:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.278115:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.278158:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.278173:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653612928:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.278422:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0780 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.285479:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653612928:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.285509:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.285576:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633605248:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7638us (7888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.285588:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5355 00000100:00100000:1.0:1787119520.288184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.288294:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633605376 00000100:00100000:2.0:1787119520.288304:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633605376 00000100:00100000:2.0:1787119520.288369:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5284 00000100:00100000:2.0:1787119520.288380:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:33946:x1873929633605376:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.288400:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.288420:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716437 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.288494:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.288512:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 41) 00010000:00010000:2.0:1787119520.288517:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 41) 00010000:00010000:2.0:1787119520.288522:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.288557:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.288586:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 27 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.288600:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653613056:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119520.288674:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0780 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.292801:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653613056:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.292850:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.292873:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119520.293176:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633605376:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4796us (4999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.293186:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5284 00000100:00100000:1.0:1787119520.302605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.302707:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633605504 00000100:00100000:0.0:1787119520.302717:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633605504 00010000:00010000:0.0:1787119520.302760:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 28 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.302808:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5356 00000100:00100000:0.0:1787119520.302829:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633605504:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.302846:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.302871:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 28 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.302897:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 28 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.302939:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3d97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716430 expref: 28 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.302958:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 41) 00010000:00010000:0.0:1787119520.302963:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 41) 00010000:00010000:0.0:1787119520.302971:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.302982:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.303021:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.303047:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653613184:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.303142:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119520.308647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.308734:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633605632 00000100:00100000:0.0:1787119520.308745:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633605632 00000100:00100000:0.0:1787119520.308808:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5285 00000100:00100000:0.0:1787119520.308829:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633605632:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.308848:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.308868:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471643e expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.308917:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.308928:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 41) 00010000:00010000:0.0:1787119520.308933:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 41) 00010000:00010000:0.0:1787119520.308938:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 29 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.308984:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.309009:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 13 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.309024:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653613312:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119520.309113:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.314511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.314586:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633605760 00000100:00100000:2.0:1787119520.314596:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633605760 00002000:00100000:2.0:1787119520.314647:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a509230000 x1873929633605760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.314658:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633605760 ext(204800->241663) 00010000:00010000:2.0:1787119520.314668:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.314697:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.314705:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230000 00000100:00100000:2.0:1787119520.314738:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1210 00000100:00100000:2.0:1787119520.314748:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633605760:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119520.315159:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653613312:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119520.315193:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 29 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.315212:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38600, rc 0) 00000100:00100000:1.0:1787119520.315254:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+29:33957:x1873929633605632:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6428us (6616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.315262:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5285 00000100:00100000:0.0:1787119520.315914:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653613184:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.315928:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.315966:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633605504:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13140us (13372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.315975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5356 00000100:00100000:3.0:1787119520.320118:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633605760:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5358us (5602us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119520.320132:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1210 00002000:00100000:3.0:1787119520.320146:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff92a509230000 x1873929633605760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.320157:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633605760 ext(204800->241663) 00010000:00010000:3.0:1787119520.320167:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.320198:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.320207:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230000 00000100:00100000:2.0:1787119520.323142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.323246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.323332:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633606016 00000100:00100000:1.0:1787119520.323343:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633606016 00010000:00010000:1.0:1787119520.323382:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.323424:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5357 00000100:00100000:1.0:1787119520.323433:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2373:x1873929633606016:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119520.323475:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119520.323496:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.323520:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.323543:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3d9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716437 expref: 14 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.323560:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 41) 00010000:00010000:1.0:1787119520.323565:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 41) 00010000:00010000:1.0:1787119520.323572:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.323581:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.323617:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.323631:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653613440:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119520.323703:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.326729:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633605888 00000100:00100000:3.0:1787119520.326745:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633605888 00000100:00100000:3.0:1787119520.326822:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5286 00000100:00100000:3.0:1787119520.326833:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633605888:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.326853:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.326875:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716445 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.327202:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653613440:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119520.327235:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119520.327298:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2373:x1873929633606016:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3864us (4051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.327308:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5357 00010000:00010000:3.0:1787119520.328300:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.328316:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 41) 00010000:00010000:3.0:1787119520.328322:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(161 41) 00010000:00010000:3.0:1787119520.328328:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.328374:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.328401:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 27 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.328417:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653613568:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119520.328566:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.330998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.331109:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633606144 00000100:00100000:2.0:1787119520.331118:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633606144 00002000:00100000:2.0:1787119520.331168:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a634964380 x1873929633606144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.331179:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634964380 with x1873929633606144 ext(204800->208895) 00010000:00010000:2.0:1787119520.331188:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.331216:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.331243:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634964380 00000100:00100000:2.0:1787119520.331277:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1211 00000100:00100000:2.0:1787119520.331286:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633606144:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.331552:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633606144:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 266us (563us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119520.331560:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1211 00002000:00100000:2.0:1787119520.331567:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a634964380 x1873929633606144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.331575:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634964380 with x1873929633606144 ext(204800->208895) 00010000:00010000:2.0:1787119520.331582:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.331596:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.331603:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634964380 00000100:00100000:3.0:1787119520.335109:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653613568:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119520.335143:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 14 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.335169:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa800, rc 0) 00000100:00100000:3.0:1787119520.335231:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633605888:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8393us (12092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.335240:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5286 00000100:00100000:1.0:1787119520.336800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.337884:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633606272 00000100:00100000:2.0:1787119520.337896:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633606272 00002000:00100000:2.0:1787119520.337958:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a63414aa00 x1873929633606272/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.337968:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414aa00 with x1873929633606272 ext(208896->212991) 00010000:00010000:2.0:1787119520.337978:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.338007:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.338016:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414aa00 00000100:00100000:2.0:1787119520.338059:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1212 00000100:00100000:2.0:1787119520.338069:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2374:x1873929633606272:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.338280:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2374:x1873929633606272:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 210us (1486us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119520.338287:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1212 00002000:00100000:2.0:1787119520.338293:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a63414aa00 x1873929633606272/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.338302:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414aa00 with x1873929633606272 ext(208896->212991) 00010000:00010000:2.0:1787119520.338307:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.338321:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.338328:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414aa00 00000100:00100000:0.0:1787119520.340019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.340272:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633606400 00000100:00100000:2.0:1787119520.340280:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633606400 00002000:00100000:2.0:1787119520.340318:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a634964700 x1873929633606400/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 4584/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.340335:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634964700 with x1873929633606400 ext(204800->208895) 00010000:00010000:2.0:1787119520.340342:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.340366:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 28 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.340374:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634964700 00000100:00100000:2.0:1787119520.340407:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1213 00000100:00100000:2.0:1787119520.340416:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2376:x1873929633606400:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119520.340874:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2376:x1873929633606400:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 458us (861us total) trans 4294969237 rc 0/0 00000100:00100000:2.0:1787119520.340881:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1213 00002000:00100000:2.0:1787119520.340888:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a634964700 x1873929633606400/t4294969237(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 4584/448 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.340897:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634964700 with x1873929633606400 ext(204800->208895) 00010000:00010000:2.0:1787119520.340913:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 30 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.340928:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 30 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.340934:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634964700 00000100:00100000:1.0:1787119520.345124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.345222:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633606528 00000100:00100000:0.0:1787119520.345242:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633606528 00000100:00100000:0.0:1787119520.345303:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5287 00000100:00100000:0.0:1787119520.345313:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+30:33957:x1873929633606528:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.345331:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.345350:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471644c expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.345382:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(161 41) 00010000:00010000:0.0:1787119520.345388:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 41) 00010000:00010000:0.0:1787119520.345395:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.345408:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.345422:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119520.345522:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+31:33957:x1873929633606528:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 210us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.345528:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5287 00000100:00100000:1.0:1787119520.348135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.348238:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633606656 00000100:00100000:2.0:1787119520.348248:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633606656 00010000:00010000:2.0:1787119520.348289:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 31 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.348338:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5358 00000100:00100000:2.0:1787119520.348348:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620709450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+31:2376:x1873929633606656:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.348368:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.348392:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 31 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.348418:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 31 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.348483:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3da5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471643e expref: 31 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.348504:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 41) 00010000:00010000:2.0:1787119520.348509:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 41) 00010000:00010000:2.0:1787119520.348518:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.348529:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.348537:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 41) 00010000:00010000:2.0:1787119520.348540:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 41) 00010000:00010000:2.0:1787119520.348545:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.348554:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.348587:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.348599:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653613696:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.348688:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 13 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.348699:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653613824:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.348721:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.353181:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653613696:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.353197:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653613824:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.353235:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.353336:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620709450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2376:x1873929633606656:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4988us (5210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.353346:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5358 00000100:00100000:1.0:1787119520.369010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.369062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.369182:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633606784 00000100:00100000:3.0:1787119520.369192:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633606784 00002000:00100000:3.0:1787119520.369250:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a634148e00 x1873929633606784/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.369262:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148e00 with x1873929633606784 ext(208896->212991) 00002000:00010000:3.0:1787119520.369268:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148e00 00000100:00100000:3.0:1787119520.369295:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633606912 00000100:00100000:3.0:1787119520.369299:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633606912 00002000:00100000:3.0:1787119520.369313:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a62a126680 x1873929633606912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.369322:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126680 with x1873929633606912 ext(204800->208895) 00002000:00010000:3.0:1787119520.369325:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126680 00000100:00100000:3.0:1787119520.369354:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10646 00000100:00100000:3.0:1787119520.369362:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2373:x1873929633606784:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.369580:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2373:x1873929633606784:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 217us (578us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119520.369587:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10646 00002000:00100000:3.0:1787119520.369594:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a634148e00 x1873929633606784/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.369609:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634148e00 with x1873929633606784 ext(208896->212991) 00002000:00010000:3.0:1787119520.369612:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634148e00 00000100:00100000:3.0:1787119520.369627:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10647 00000100:00100000:3.0:1787119520.369634:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633606912:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.369723:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633606912:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 89us (660us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119520.369731:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10647 00002000:00100000:3.0:1787119520.369737:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a62a126680 x1873929633606912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.369745:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126680 with x1873929633606912 ext(204800->208895) 00002000:00010000:3.0:1787119520.369748:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126680 00000100:00100000:1.0:1787119520.383342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.383876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.383965:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633607168 00000100:00100000:3.0:1787119520.383975:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633607168 00000100:00100000:3.0:1787119520.384047:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5288 00000100:00100000:3.0:1787119520.384058:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:33946:x1873929633607168:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.384078:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.384098:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716453 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.384132:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 29 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.384143:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 41) 00010000:00010000:3.0:1787119520.384148:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 41) 00010000:00010000:3.0:1787119520.384153:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.384189:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 29 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.384215:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 29 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.384231:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653613952:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119520.384338:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.388274:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633607040 00000100:00100000:2.0:1787119520.388289:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633607040 00002000:00100000:2.0:1787119520.388342:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a634039500 x1873929633607040/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.388353:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039500 with x1873929633607040 ext(212992->217087) 00010000:00010000:2.0:1787119520.388362:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 30 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.388390:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 30 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.388411:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039500 00000100:00100000:0.0:1787119520.388775:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1214 00000100:00100000:0.0:1787119520.388787:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2373:x1873929633607040:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119520.389424:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2373:x1873929633607040:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 637us (6086us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119520.389434:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1214 00002000:00100000:0.0:1787119520.389461:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a634039500 x1873929633607040/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.389477:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039500 with x1873929633607040 ext(212992->217087) 00010000:00010000:0.0:1787119520.389486:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 30 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.389508:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 30 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.389515:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039500 00000100:00100000:0.0:1787119520.391004:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653613952:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.391052:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 15 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.391073:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb400, rc 0) 00000100:00100000:0.0:1787119520.391123:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633607168:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7067us (7248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.391131:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5288 00000100:00100000:1.0:1787119520.399323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.399852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.399967:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633607296 00000100:00100000:0.0:1787119520.399981:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633607296 00002000:00100000:0.0:1787119520.400046:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a63403b480 x1873929633607296/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 4584/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.400058:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b480 with x1873929633607296 ext(208896->212991) 00010000:00010000:0.0:1787119520.400068:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 30 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.400103:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 30 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.400112:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b480 00000100:00100000:0.0:1787119520.400151:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1215 00000100:00100000:0.0:1787119520.400162:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2376:x1873929633607296:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119520.400855:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2376:x1873929633607296:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 691us (1539us total) trans 4294969238 rc 0/0 00000100:00100000:0.0:1787119520.400865:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1215 00002000:00100000:0.0:1787119520.400873:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a63403b480 x1873929633607296/t4294969238(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 4584/448 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.400882:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b480 with x1873929633607296 ext(208896->212991) 00010000:00010000:0.0:1787119520.400889:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 32 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.402076:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 32 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.402091:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b480 00000100:00100000:1.0:1787119520.402248:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633607424 00000100:00100000:1.0:1787119520.402258:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633607424 00000100:00100000:1.0:1787119520.402311:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5289 00000100:00100000:1.0:1787119520.402322:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+32:33957:x1873929633607424:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.402338:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.402356:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471645a expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.402383:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 41) 00010000:00010000:1.0:1787119520.402388:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 41) 00010000:00010000:1.0:1787119520.402394:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.402407:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.402420:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:1.0:1787119520.402493:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633607424:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 173us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.402499:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5289 00000100:00100000:3.0:1787119520.409209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.409356:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633607552 00000100:00100000:0.0:1787119520.409367:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633607552 00010000:00010000:0.0:1787119520.409408:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 33 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.409501:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5359 00000100:00100000:0.0:1787119520.409512:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2373:x1873929633607552:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.409530:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787119520.409551:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119518 -> 1787119519 00002000:00010000:0.0:1787119520.409554:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119518 -> 1787119519 00010000:00010000:0.0:1787119520.409561:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 33 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.409587:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 33 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.409615:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3db3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [208896->18446744073709551615] (req 208896->212991) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471644c expref: 33 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.409636:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 41) 00010000:00010000:0.0:1787119520.409640:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 41) 00010000:00010000:0.0:1787119520.409649:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 14 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.409659:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 14 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.409668:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 41) 00010000:00010000:0.0:1787119520.409670:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 41) 00010000:00010000:0.0:1787119520.409675:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 32 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.409683:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 32 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.409722:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 32 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.409739:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653614080:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.409826:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 14 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.409837:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653614208:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.409862:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.414387:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653614080:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.414418:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653614208:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.414486:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.414554:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2373:x1873929633607552:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5041us (5354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.414565:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5359 00000100:00100000:1.0:1787119520.417593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.418074:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633607680 00000100:00100000:3.0:1787119520.418084:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633607680 00002000:00100000:3.0:1787119520.418229:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a634039880 x1873929633607680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.418240:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039880 with x1873929633607680 ext(208896->212991) 00002000:00010000:3.0:1787119520.418246:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039880 00000100:00100000:3.0:1787119520.418282:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10648 00000100:00100000:3.0:1787119520.418292:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633607680:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.418515:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2375:x1873929633607680:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 224us (931us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119520.418523:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10648 00002000:00100000:3.0:1787119520.418530:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a634039880 x1873929633607680/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.418538:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039880 with x1873929633607680 ext(208896->212991) 00002000:00010000:3.0:1787119520.418541:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039880 00000100:00100000:0.0:1787119520.428759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.428829:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633607808 00000100:00100000:3.0:1787119520.428841:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633607808 00000100:00100000:0.0:1787119520.428844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.428897:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5290 00000100:00100000:1.0:1787119520.428942:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633607936 00000100:00100000:1.0:1787119520.428946:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633607936 00002000:00100000:1.0:1787119520.428983:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a5098a5880 x1873929633607936/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.428994:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5880 with x1873929633607936 ext(212992->217087) 00002000:00010000:1.0:1787119520.429001:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5880 00000100:00100000:3.0:1787119520.429090:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:33946:x1873929633607808:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.429106:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.429126:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716461 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.429162:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 32 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.429172:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 41) 00010000:00010000:3.0:1787119520.429176:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 41) 00010000:00010000:3.0:1787119520.429181:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.429234:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 32 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.429264:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 32 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.429286:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653614336:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119520.429369:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:1.0:1787119520.429691:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1216 00000100:00100000:1.0:1787119520.429700:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2375:x1873929633607936:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119520.429875:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2375:x1873929633607936:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 175us (1028us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119520.429882:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1216 00002000:00100000:1.0:1787119520.429889:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a5098a5880 x1873929633607936/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.429897:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5880 with x1873929633607936 ext(212992->217087) 00010000:00010000:1.0:1787119520.429904:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 32 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.429922:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 32 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.429929:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5880 00000100:00100000:2.0:1787119520.436732:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653614336:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.436780:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.436805:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb800, rc 0) 00000100:00100000:2.0:1787119520.436884:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633607808:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7797us (8136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.436894:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5290 00000100:00100000:3.0:1787119520.447805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.448007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.448118:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633608064 00000100:00100000:1.0:1787119520.448129:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633608064 00002000:00100000:1.0:1787119520.448179:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509230700 x1873929633608064/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.448191:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230700 with x1873929633608064 ext(217088->221183) 00010000:00010000:1.0:1787119520.448202:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 32 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.448206:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633608192 00000100:00100000:2.0:1787119520.448213:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633608192 00010000:00010000:1.0:1787119520.448239:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 33 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787119520.448245:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a509233b80 x1873929633608192/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 4584/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00010000:1.0:1787119520.448258:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230700 00002000:00100000:2.0:1787119520.448265:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233b80 with x1873929633608192 ext(212992->217087) 00010000:00010000:2.0:1787119520.448273:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 33 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.448296:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1217 00010000:00010000:2.0:1787119520.448299:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 33 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.448310:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633608064:12345-192.168.201.59@tcp:3:kworker.0 00002000:00010000:2.0:1787119520.448311:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509233b80 00000100:00100000:2.0:1787119520.448349:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1218 00000100:00100000:2.0:1787119520.448358:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2375:x1873929633608192:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119520.448545:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633608064:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 240us (753us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119520.448551:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1217 00002000:00100000:1.0:1787119520.448558:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509230700 x1873929633608064/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.448564:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230700 with x1873929633608064 ext(217088->221183) 00010000:00010000:1.0:1787119520.448568:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 33 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.448579:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 33 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.448583:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230700 00000100:00100000:2.0:1787119520.448728:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633608192:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 370us (720us total) trans 4294969239 rc 0/0 00000100:00100000:2.0:1787119520.448735:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1218 00002000:00100000:2.0:1787119520.448742:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a509233b80 x1873929633608192/t4294969239(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 4584/448 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.448750:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233b80 with x1873929633608192 ext(212992->217087) 00010000:00010000:2.0:1787119520.448755:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 34 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.448768:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 34 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.448775:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509233b80 00000100:00100000:3.0:1787119520.452212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.452698:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633608320 00000100:00100000:2.0:1787119520.452708:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633608320 00000100:00100000:2.0:1787119520.452777:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5291 00000100:00100000:2.0:1787119520.452787:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633608320:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.452806:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.452826:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716468 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.452863:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 41) 00010000:00010000:2.0:1787119520.452869:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 41) 00010000:00010000:2.0:1787119520.452875:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.452888:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.453398:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:2.0:1787119520.453683:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633608320:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 895us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.453692:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5291 00000100:00100000:1.0:1787119520.455542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.455707:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633608448 00000100:00100000:3.0:1787119520.455718:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633608448 00010000:00010000:3.0:1787119520.455758:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 35 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.455805:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5360 00000100:00100000:3.0:1787119520.455814:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2376:x1873929633608448:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119520.455829:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.455853:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 35 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.455880:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 35 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.455915:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e3dc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [212992->18446744073709551615] (req 212992->217087) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471645a expref: 35 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.455933:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 41) 00010000:00010000:3.0:1787119520.455937:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 41) 00010000:00010000:3.0:1787119520.455946:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 15 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.455956:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 15 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.455965:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 41) 00010000:00010000:3.0:1787119520.455967:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 41) 00010000:00010000:3.0:1787119520.455972:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.455981:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.456032:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.456056:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653614464:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119520.456145:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 15 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.456156:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653614592:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.456182:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.462385:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653614464:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.462413:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653614592:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119520.462464:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119520.462530:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633608448:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6716us (6996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.462542:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5360 00000100:00100000:1.0:1787119520.466364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.466507:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633608576 00000100:00100000:2.0:1787119520.466518:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633608576 00002000:00100000:2.0:1787119520.466568:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a63403b100 x1873929633608576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.466578:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b100 with x1873929633608576 ext(212992->217087) 00002000:00010000:2.0:1787119520.466584:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b100 00000100:00100000:2.0:1787119520.466618:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10650 00000100:00100000:2.0:1787119520.466627:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633608576:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.466825:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633608576:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 198us (472us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119520.466834:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10650 00002000:00100000:2.0:1787119520.466842:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a63403b100 x1873929633608576/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.466850:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b100 with x1873929633608576 ext(212992->217087) 00002000:00010000:2.0:1787119520.466853:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63403b100 00000100:00100000:1.0:1787119520.470876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.471208:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633608704 00000100:00100000:0.0:1787119520.471220:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633608704 00000100:00100000:0.0:1787119520.471289:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5292 00000100:00100000:0.0:1787119520.471300:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633608704:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.471317:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.471337:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471646f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.471371:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.471380:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 41) 00010000:00010000:0.0:1787119520.471384:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 41) 00010000:00010000:0.0:1787119520.471390:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.471483:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.471511:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 33 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.471526:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653614720:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119520.471666:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.475500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.475655:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633608832 00000100:00100000:2.0:1787119520.475665:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633608832 00002000:00100000:2.0:1787119520.475710:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509231880 x1873929633608832/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.475723:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633608832 ext(217088->221183) 00010000:00010000:2.0:1787119520.475732:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.475762:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.475770:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231880 00000100:00100000:2.0:1787119520.475805:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1219 00000100:00100000:2.0:1787119520.475815:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633608832:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.476154:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633608832:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 339us (662us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119520.476163:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1219 00002000:00100000:2.0:1787119520.476170:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509231880 x1873929633608832/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.476181:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633608832 ext(217088->221183) 00010000:00010000:2.0:1787119520.476187:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.476203:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.476210:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231880 00000100:00100000:0.0:1787119520.481683:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653614720:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.481726:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.481756:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119520.481990:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633608704:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10690us (11122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.482001:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5292 00000100:00100000:1.0:1787119520.485423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.485816:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633608960 00000100:00100000:2.0:1787119520.485827:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633608960 00000100:00100000:2.0:1787119520.485892:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5293 00000100:00100000:2.0:1787119520.485912:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633608960:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.485932:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.485953:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716476 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.485988:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 41) 00010000:00010000:2.0:1787119520.485998:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.486006:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 41) 00010000:00010000:2.0:1787119520.486022:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 35 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.486083:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.486099:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 35 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.486112:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119520.486175:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633608960:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 274us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.486182:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5293 00000100:00100000:2.0:1787119520.488800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.488910:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633609088 00000100:00100000:0.0:1787119520.488920:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633609088 00010000:00010000:0.0:1787119520.488960:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.489021:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5361 00000100:00100000:0.0:1787119520.489031:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2374:x1873929633609088:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.489058:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.489083:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.489110:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.489133:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3dcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716468 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.489151:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 41) 00010000:00010000:0.0:1787119520.489155:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 41) 00010000:00010000:0.0:1787119520.489164:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.489175:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.489217:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.489244:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 16 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.489257:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653614976:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.489336:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119520.494131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.494358:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653614976:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.494384:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.494483:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633609088:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5452us (5692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.494496:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5361 00000100:00100000:3.0:1787119520.494886:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633609216 00000100:00100000:3.0:1787119520.494904:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633609216 00002000:00100000:3.0:1787119520.494949:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a634039180 x1873929633609216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.494959:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633609216 ext(217088->253951) 00010000:00010000:3.0:1787119520.494967:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.494997:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.495004:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039180 00000100:00100000:3.0:1787119520.495025:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1220 00000100:00100000:3.0:1787119520.495045:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633609216:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.498673:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633609216:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3628us (4542us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119520.498688:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1220 00002000:00100000:3.0:1787119520.498701:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a634039180 x1873929633609216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.498718:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633609216 ext(217088->253951) 00010000:00010000:3.0:1787119520.498730:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.498761:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.498770:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039180 00000100:00100000:1.0:1787119520.501501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.501547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.501629:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633609472 00000100:00100000:0.0:1787119520.501639:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633609472 00010000:00010000:0.0:1787119520.501677:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.501723:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5362 00000100:00100000:0.0:1787119520.501733:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633609472:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.501750:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.501772:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.501796:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.501819:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3dd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471646f expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.501838:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 41) 00010000:00010000:0.0:1787119520.501843:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 41) 00010000:00010000:0.0:1787119520.501850:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.501859:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.501897:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.501923:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653615104:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.502007:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.502119:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633609344 00000100:00100000:2.0:1787119520.502123:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633609344 00000100:00100000:2.0:1787119520.502161:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5294 00000100:00100000:2.0:1787119520.502169:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633609344:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.502182:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.502195:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471647d expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.502215:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.502222:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 41) 00010000:00010000:2.0:1787119520.502225:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 41) 00010000:00010000:2.0:1787119520.502228:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.502251:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.502267:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 33 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.502278:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653615232:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119520.502306:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.505965:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653615104:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.506006:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.506076:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633609472:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4343us (4527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.506086:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5362 00000100:00100000:2.0:1787119520.506828:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653615232:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.506856:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.506879:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119520.506938:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633609344:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4769us (5446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.506946:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5294 00000100:00100000:1.0:1787119520.507961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.508120:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633609600 00000100:00100000:3.0:1787119520.508130:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633609600 00010000:00010000:3.0:1787119520.508172:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.508214:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5363 00000100:00100000:3.0:1787119520.508233:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633609600:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119520.508249:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.508273:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.508298:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.508323:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ddd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716476 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.508346:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 41) 00010000:00010000:3.0:1787119520.508351:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 41) 00010000:00010000:3.0:1787119520.508359:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.508371:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.508412:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.508428:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653615360:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.508756:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.511751:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653615360:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119520.511775:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119520.511827:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633609600:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3604us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.511838:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5363 00000100:00100000:1.0:1787119520.517581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.517666:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633609728 00000100:00100000:2.0:1787119520.517676:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633609728 00000100:00100000:2.0:1787119520.517728:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5295 00000100:00100000:2.0:1787119520.517735:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633609728:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.517753:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.517769:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716484 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.518206:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.518217:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 41) 00010000:00010000:2.0:1787119520.518222:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 41) 00010000:00010000:2.0:1787119520.518228:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.518265:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.518293:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 16 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.518309:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653615488:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119520.518397:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0780 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.523171:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653615488:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.523221:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.523248:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119520.523339:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633609728:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5603us (5767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.523354:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5295 00000100:00100000:1.0:1787119520.529395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.529539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.529657:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633609856 00000100:00100000:0.0:1787119520.529667:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633609856 00000100:00100000:3.0:1787119520.529753:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633609984 00000100:00100000:3.0:1787119520.529758:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633609984 00010000:00010000:1.0:1787119520.529792:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 18 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.529853:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5296 00000100:00100000:3.0:1787119520.529865:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633609984:12345-192.168.201.59@tcp:101:mmap_sanity.0 00000100:00100000:1.0:1787119520.529872:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5364 00000100:00100000:1.0:1787119520.529878:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633609856:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119520.529883:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.529892:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.529902:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471648b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.529927:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 41) 00010000:00010000:3.0:1787119520.529940:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.529946:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 41) 00010000:00010000:3.0:1787119520.529952:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.532047:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 19 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.532085:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 19 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.532117:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3de4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471647d expref: 19 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.532136:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 41) 00010000:00010000:1.0:1787119520.532141:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 41) 00010000:00010000:1.0:1787119520.532150:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.532161:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.532510:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.532528:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 33 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.532544:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653615744:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119520.532692:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787119520.532710:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 33 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.532722:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 33 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.532732:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606158700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653615616:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119520.532758:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.536497:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606158700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653615616:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.536524:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.536574:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633609856:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6696us (7189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.536586:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5364 00000100:00100000:1.0:1787119520.536686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.536751:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633610112 00000100:00100000:2.0:1787119520.536759:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633610112 00002000:00100000:2.0:1787119520.536802:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a606159c00 x1873929633610112/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.536813:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159c00 with x1873929633610112 ext(217088->221183) 00010000:00010000:2.0:1787119520.536822:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.536849:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.536857:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606159c00 00000100:00100000:2.0:1787119520.536887:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1221 00000100:00100000:2.0:1787119520.536895:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633610112:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.537108:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633610112:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 213us (422us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119520.537115:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1221 00002000:00100000:2.0:1787119520.537122:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a606159c00 x1873929633610112/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.537132:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159c00 with x1873929633610112 ext(217088->221183) 00010000:00010000:2.0:1787119520.537138:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.537153:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.537159:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606159c00 00000100:00100000:3.0:1787119520.537479:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653615744:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119520.537502:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.537521:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa600, rc 0) 00000100:00100000:3.0:1787119520.537547:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633609984:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7685us (8008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.537557:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5296 00000100:00100000:1.0:1787119520.541805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.541895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.541997:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633610240 00000100:00100000:0.0:1787119520.542008:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633610240 00000100:00100000:0.0:1787119520.542080:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5297 00000100:00100000:0.0:1787119520.542091:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633610240:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.542109:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.542131:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716492 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.542165:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 41) 00010000:00010000:0.0:1787119520.542174:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.542182:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 41) 00010000:00010000:0.0:1787119520.542188:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 35 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.542231:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.542246:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 35 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.542264:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119520.542332:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633610240:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 243us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.542339:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5297 00000100:00100000:2.0:1787119520.542635:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633610368 00000100:00100000:2.0:1787119520.542640:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633610368 00010000:00010000:2.0:1787119520.542663:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.542696:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5365 00000100:00100000:2.0:1787119520.542703:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2373:x1873929633610368:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.542714:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.542735:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.542757:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.542777:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3deb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716484 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.542795:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 41) 00010000:00010000:2.0:1787119520.542798:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 41) 00010000:00010000:2.0:1787119520.542805:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.542814:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.542841:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.542855:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 16 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.542868:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653616000:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.542938:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0780 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.547148:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653616000:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.547176:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.547238:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2373:x1873929633610368:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4535us (5342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.547250:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5365 00000100:00100000:3.0:1787119520.548255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.548319:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633610496 00000100:00100000:2.0:1787119520.548326:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633610496 00002000:00100000:2.0:1787119520.548367:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a509231500 x1873929633610496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.548378:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633610496 ext(217088->253951) 00010000:00010000:2.0:1787119520.548387:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.548415:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.548423:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231500 00000100:00100000:2.0:1787119520.548469:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1222 00000100:00100000:2.0:1787119520.548478:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633610496:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.552421:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633610496:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3934us (4160us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119520.552434:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1222 00002000:00100000:2.0:1787119520.552484:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a509231500 x1873929633610496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.552496:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633610496 ext(217088->253951) 00010000:00010000:2.0:1787119520.552506:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.552538:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.552548:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231500 00000100:00100000:3.0:1787119520.555171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.555212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.555320:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633610752 00000100:00100000:1.0:1787119520.555331:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633610752 00010000:00010000:1.0:1787119520.555374:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.555415:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5366 00000100:00100000:1.0:1787119520.555425:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633610752:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119520.555469:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119520.555495:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.555521:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.555552:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3df2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471648b expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.555569:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 41) 00010000:00010000:1.0:1787119520.555574:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 41) 00010000:00010000:1.0:1787119520.555584:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 33 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.555594:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 33 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.555632:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 33 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.555648:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a60615aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653616128:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119520.555734:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674540 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.556006:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633610624 00000100:00100000:2.0:1787119520.556012:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633610624 00000100:00100000:2.0:1787119520.556062:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5298 00000100:00100000:2.0:1787119520.556071:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633610624:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.556086:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.556100:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716499 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.556121:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 33 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.556129:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 41) 00010000:00010000:2.0:1787119520.556132:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 41) 00010000:00010000:2.0:1787119520.556137:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.556159:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 33 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.556175:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 33 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.556186:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653616256:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119520.556231:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.559772:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653616256:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.559819:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.559842:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119520.559932:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633610624:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3861us (4770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.559941:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5298 00000100:00100000:0.0:1787119520.563588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.563713:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a60615aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653616128:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119520.563740:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119520.563800:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633610752:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8375us (8585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.563812:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5366 00000100:00100000:1.0:1787119520.563842:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633610880 00000100:00100000:1.0:1787119520.563848:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633610880 00010000:00010000:1.0:1787119520.563878:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 34 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.564498:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5367 00000100:00100000:2.0:1787119520.564511:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633610880:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.564527:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.564556:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 34 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.564583:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 34 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.564610:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e3df9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716492 expref: 34 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.564628:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 41) 00010000:00010000:2.0:1787119520.564633:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 41) 00010000:00010000:2.0:1787119520.564642:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.564653:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.564698:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.564713:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653616384:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.564794:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.568702:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653616384:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.568730:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.568832:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2375:x1873929633610880:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4322us (5251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.568844:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5367 00000100:00100000:2.0:1787119520.574681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.574788:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633611008 00000100:00100000:0.0:1787119520.574800:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633611008 00000100:00100000:0.0:1787119520.575050:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5299 00000100:00100000:0.0:1787119520.575061:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e92b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633611008:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.575079:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.575109:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164a0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.575143:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.575153:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 41) 00010000:00010000:0.0:1787119520.575158:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 41) 00010000:00010000:0.0:1787119520.575164:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.575202:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.575247:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 16 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.575263:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653616512:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119520.575356:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.579434:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653616512:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.579510:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.579532:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38600, rc 0) 00000100:00100000:0.0:1787119520.579598:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e92b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633611008:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4538us (4928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.579606:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5299 00000100:00100000:1.0:1787119520.581069:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.581137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.581211:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633611264 00000100:00100000:3.0:1787119520.581221:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633611264 00000100:00100000:3.0:1787119520.581274:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5300 00000100:00100000:3.0:1787119520.581284:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633611264:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.581303:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.581323:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164a7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.581351:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 41) 00010000:00010000:3.0:1787119520.581360:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.581367:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 41) 00010000:00010000:3.0:1787119520.581372:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.581406:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.581417:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.581430:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fba00, rc 0) 00000100:00100000:3.0:1787119520.581514:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633611264:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 230us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.581521:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5300 00000100:00100000:2.0:1787119520.581782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633611136 00000100:00100000:2.0:1787119520.581787:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633611136 00010000:00010000:2.0:1787119520.581808:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 18 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.581835:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5368 00000100:00100000:2.0:1787119520.581843:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633611136:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.581855:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.581877:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 18 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.581902:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 18 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.581922:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3e00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716499 expref: 18 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.581936:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 41) 00010000:00010000:2.0:1787119520.581940:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 41) 00010000:00010000:2.0:1787119520.581947:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.581957:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.581984:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.582000:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 33 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.582014:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653616768:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.582085:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.586273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.586728:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633611392 00000100:00100000:1.0:1787119520.586738:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633611392 00002000:00100000:1.0:1787119520.586790:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63414d880 x1873929633611392/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.586801:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d880 with x1873929633611392 ext(217088->221183) 00010000:00010000:1.0:1787119520.586811:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.586841:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.586849:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414d880 00000100:00100000:1.0:1787119520.586884:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1223 00000100:00100000:1.0:1787119520.586894:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633611392:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119520.587105:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653616768:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.587127:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119520.587142:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633611392:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 249us (879us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119520.587150:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1223 00000100:00100000:0.0:1787119520.587155:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633611136:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5314us (6124us total) trans 0 rc 0/0 00002000:00100000:1.0:1787119520.587157:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63414d880 x1873929633611392/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787119520.587163:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5368 00002000:00100000:1.0:1787119520.587165:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d880 with x1873929633611392 ext(217088->221183) 00010000:00010000:1.0:1787119520.587171:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.587185:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.587191:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414d880 00000100:00100000:2.0:1787119520.590671:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.590771:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633611520 00000100:00100000:1.0:1787119520.590782:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633611520 00000100:00100000:1.0:1787119520.590846:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5301 00000100:00100000:1.0:1787119520.590857:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633611520:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.590877:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.591086:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164ae expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.591126:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 41) 00010000:00010000:1.0:1787119520.591136:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.591144:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 41) 00010000:00010000:1.0:1787119520.591150:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.591194:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.591209:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.591242:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119520.591352:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633611520:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 496us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.591360:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5301 00000100:00100000:2.0:1787119520.592396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.593833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633611648 00000100:00100000:0.0:1787119520.593847:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633611648 00010000:00010000:0.0:1787119520.594216:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.594377:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5369 00000100:00100000:0.0:1787119520.594389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2376:x1873929633611648:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.594406:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.594432:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.594483:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.594512:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3e07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a0 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.594534:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 41) 00010000:00010000:0.0:1787119520.594539:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 41) 00010000:00010000:0.0:1787119520.594548:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.594559:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.594603:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.594624:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 16 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.594639:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653617024:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.594735:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.599126:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653617024:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.599154:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.599215:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633611648:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4828us (6823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.599233:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5369 00000100:00100000:2.0:1787119520.600663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.600744:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633611776 00000100:00100000:3.0:1787119520.600753:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633611776 00002000:00100000:3.0:1787119520.600796:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63414ed80 x1873929633611776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.600807:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ed80 with x1873929633611776 ext(217088->253951) 00010000:00010000:3.0:1787119520.600816:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.600846:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.600855:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414ed80 00000100:00100000:3.0:1787119520.600887:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1224 00000100:00100000:3.0:1787119520.600897:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633611776:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.605489:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633611776:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4540us (4782us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119520.605503:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1224 00002000:00100000:3.0:1787119520.605518:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63414ed80 x1873929633611776/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.605536:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ed80 with x1873929633611776 ext(217088->253951) 00010000:00010000:3.0:1787119520.605547:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.605579:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.605588:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414ed80 00000100:00100000:2.0:1787119520.616292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.616344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.616493:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633612032 00000100:00100000:1.0:1787119520.616504:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633612032 00010000:00010000:1.0:1787119520.616556:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 17 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.616679:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633611904 00000100:00100000:3.0:1787119520.616683:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633611904 00000100:00100000:3.0:1787119520.616729:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5302 00000100:00100000:3.0:1787119520.616739:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633611904:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.616756:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.616777:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164b5 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.616810:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 41) 00010000:00010000:3.0:1787119520.616820:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.616828:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 41) 00010000:00010000:3.0:1787119520.616833:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 19 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.616874:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.616891:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 19 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.617551:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5370 00000100:00100000:1.0:1787119520.617565:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2373:x1873929633612032:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119520.617577:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119520.617603:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 19 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.617631:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 19 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.617654:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164a7 expref: 19 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.617669:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 41) 00010000:00010000:1.0:1787119520.617673:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 41) 00010000:00010000:1.0:1787119520.617679:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.617689:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.617717:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.617731:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 33 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.617745:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a60615ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653617280:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119520.617829:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674540 going to sleep for 11 seconds 00010000:00010000:3.0:1787119520.617986:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa200, rc 0) 00000100:00100000:3.0:1787119520.618018:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633611904:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1281us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.618026:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5302 00000100:00100000:1.0:1787119520.622209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.622407:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633612160 00000100:00100000:0.0:1787119520.622420:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633612160 00010000:00010000:0.0:1787119520.622491:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.622532:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5371 00000100:00100000:0.0:1787119520.622543:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633612160:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.622563:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.622592:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.622622:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.622661:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 41) 00010000:00010000:0.0:1787119520.622667:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 41) 00010000:00010000:0.0:1787119520.622677:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.622688:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.622733:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.622749:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653617408:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.623000:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ae expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.623018:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a60615ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653617280:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.623051:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.623109:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.623715:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633612032:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6152us (7368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.623725:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5370 00000100:00100000:0.0:1787119520.627353:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653617408:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.627410:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.627676:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633612160:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5132us (5477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.627708:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5371 00000100:00100000:0.0:1787119520.633686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.633802:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633612288 00000100:00100000:2.0:1787119520.633813:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633612288 00000100:00100000:2.0:1787119520.633922:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5303 00000100:00100000:2.0:1787119520.633934:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633612288:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.633955:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.633974:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164bc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.634007:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.634016:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 41) 00010000:00010000:2.0:1787119520.634021:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 41) 00010000:00010000:2.0:1787119520.634025:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.634079:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.634111:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 16 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.634126:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653617536:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119520.634227:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119520.637842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.637937:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633612416 00000100:00100000:0.0:1787119520.637946:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633612416 00010000:00010000:0.0:1787119520.637987:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 17 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.638041:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5372 00000100:00100000:0.0:1787119520.638052:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633612416:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.638067:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.638089:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 17 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.638115:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 17 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.638143:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 41) 00010000:00010000:0.0:1787119520.638148:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 41) 00010000:00010000:0.0:1787119520.638157:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.638167:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.638206:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.638219:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653617664:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.638317:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462b40 going to sleep for 11 seconds 00010000:00010000:2.0:1787119520.638902:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3e1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164b5 expref: 17 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.638920:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653617536:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.638944:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.638955:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119520.639002:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633612288:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5071us (5326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.639010:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5303 00000100:00100000:1.0:1787119520.642880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.642955:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633612544 00000100:00100000:0.0:1787119520.642965:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633612544 00000100:00100000:0.0:1787119520.643023:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5304 00000100:00100000:0.0:1787119520.643046:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633612544:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.643068:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.643091:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164c3 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.643129:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.643140:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 41) 00010000:00010000:0.0:1787119520.643145:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 41) 00010000:00010000:0.0:1787119520.643150:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.643187:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.643214:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 33 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.643241:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653617792:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119520.643681:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.644979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.646372:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653617664:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.646400:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.646479:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633612416:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8427us (8644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.646493:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5372 00000100:00100000:3.0:1787119520.646799:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633612672 00000100:00100000:3.0:1787119520.646808:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633612672 00002000:00100000:3.0:1787119520.646854:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63414ca80 x1873929633612672/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.646865:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ca80 with x1873929633612672 ext(217088->221183) 00010000:00010000:3.0:1787119520.646874:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.647054:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.647064:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414ca80 00000100:00100000:3.0:1787119520.647137:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1225 00000100:00100000:3.0:1787119520.647148:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633612672:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.647349:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633612672:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 202us (2375us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119520.647360:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1225 00002000:00100000:3.0:1787119520.647367:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63414ca80 x1873929633612672/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.647376:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ca80 with x1873929633612672 ext(217088->221183) 00010000:00010000:3.0:1787119520.647382:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.647396:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.647403:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414ca80 00000100:00100000:0.0:1787119520.647573:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653617792:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.647597:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.647613:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119520.647640:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633612544:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4609us (4770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.647646:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5304 00000100:00100000:1.0:1787119520.656467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.656548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.656604:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633612928 00000100:00100000:3.0:1787119520.656612:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633612928 00010000:00010000:3.0:1787119520.656644:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.656677:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5373 00000100:00100000:3.0:1787119520.656687:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633612928:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119520.656703:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.656725:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.656749:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.656775:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164bc expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.656788:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 41) 00010000:00010000:3.0:1787119520.656792:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 41) 00010000:00010000:3.0:1787119520.656798:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.656805:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.656843:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.656859:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653617920:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.656940:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.657089:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633612800 00000100:00100000:0.0:1787119520.657094:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633612800 00000100:00100000:0.0:1787119520.657135:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5305 00000100:00100000:0.0:1787119520.657143:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633612800:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.657157:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.657171:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164ca expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.657191:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.657199:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 41) 00010000:00010000:0.0:1787119520.657202:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 41) 00010000:00010000:0.0:1787119520.657206:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.657235:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.657251:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 16 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.657262:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653618048:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119520.657389:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.661204:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653618048:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.661257:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.661280:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38000, rc 0) 00000100:00100000:0.0:1787119520.661345:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633612800:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4203us (4904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.661355:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5305 00000100:00100000:3.0:1787119520.663571:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653617920:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119520.663597:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119520.663642:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633612928:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6957us (7093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.663653:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5373 00000100:00100000:1.0:1787119520.667407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.667543:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633613056 00000100:00100000:0.0:1787119520.667556:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633613056 00002000:00100000:0.0:1787119520.667612:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a60615ad80 x1873929633613056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.667623:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615ad80 with x1873929633613056 ext(217088->253951) 00010000:00010000:0.0:1787119520.667633:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.667672:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.667680:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a60615ad80 00000100:00100000:0.0:1787119520.667718:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1226 00000100:00100000:0.0:1787119520.667728:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633613056:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119520.671259:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633613056:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3520us (3850us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119520.671272:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1226 00002000:00100000:0.0:1787119520.671286:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a60615ad80 x1873929633613056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.671298:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615ad80 with x1873929633613056 ext(217088->253951) 00010000:00010000:0.0:1787119520.671309:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.671341:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.671349:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a60615ad80 00000100:00100000:2.0:1787119520.674683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.674727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.674804:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633613184 00000100:00100000:3.0:1787119520.674813:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633613184 00000100:00100000:3.0:1787119520.674875:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5306 00000100:00100000:3.0:1787119520.674887:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633613184:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.674915:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.674936:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164d1 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.674969:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 41) 00010000:00010000:3.0:1787119520.674979:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.674987:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 41) 00010000:00010000:3.0:1787119520.674993:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.675045:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.675062:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.675077:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038faa00, rc 0) 00000100:00100000:3.0:1787119520.675138:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633613184:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 253us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.675146:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5306 00000100:00100000:0.0:1787119520.675328:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633613312 00000100:00100000:0.0:1787119520.675333:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633613312 00010000:00010000:0.0:1787119520.675356:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 18 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.675397:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5374 00000100:00100000:0.0:1787119520.675405:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633613312:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.675414:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.675477:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 18 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.675502:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 18 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.675522:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3e2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164c3 expref: 18 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.675539:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 41) 00010000:00010000:0.0:1787119520.675543:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 41) 00010000:00010000:0.0:1787119520.675552:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.675563:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.675628:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.675650:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 33 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.675664:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653618304:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.675723:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.678396:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653618304:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.678421:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.678499:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633613312:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3094us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.678511:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5374 00000100:00100000:2.0:1787119520.681499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.681612:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633613440 00000100:00100000:0.0:1787119520.681623:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633613440 00010000:00010000:0.0:1787119520.681663:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.681706:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5375 00000100:00100000:0.0:1787119520.681716:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2373:x1873929633613440:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.681731:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.681756:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.681783:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.681813:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ca expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.681831:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 41) 00010000:00010000:0.0:1787119520.681836:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 41) 00010000:00010000:0.0:1787119520.681844:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.681855:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.681894:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.681921:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653618432:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.682019:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.684870:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653618432:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.684908:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.684966:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2373:x1873929633613440:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3251us (3475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.684985:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5375 00000100:00100000:1.0:1787119520.690627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.690728:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633613568 00000100:00100000:2.0:1787119520.690738:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633613568 00000100:00100000:2.0:1787119520.690833:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5307 00000100:00100000:2.0:1787119520.690843:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633613568:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.690863:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.690881:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164d8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.690913:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.690923:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 41) 00010000:00010000:2.0:1787119520.690927:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 41) 00010000:00010000:2.0:1787119520.690932:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.690966:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.691006:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 16 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.691021:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653618560:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119520.691123:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.694218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.694302:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633613696 00000100:00100000:3.0:1787119520.694311:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633613696 00010000:00010000:3.0:1787119520.694348:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 17 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.694393:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5376 00000100:00100000:3.0:1787119520.694403:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633613696:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119520.694420:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.694465:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 17 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.694495:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 17 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.694526:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 41) 00010000:00010000:3.0:1787119520.694531:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 41) 00010000:00010000:3.0:1787119520.694540:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.694551:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.694592:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.694608:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653618688:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.694690:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119520.697275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.698170:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653618688:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119520.698196:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119520.698260:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633613696:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3856us (4051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.698283:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5376 00000100:00100000:2.0:1787119520.698535:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633613824 00000100:00100000:2.0:1787119520.698544:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633613824 00000100:00100000:2.0:1787119520.698634:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5308 00000100:00100000:2.0:1787119520.698644:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633613824:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.698666:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.698687:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164df expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.698720:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.698731:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 41) 00010000:00010000:2.0:1787119520.698736:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 41) 00010000:00010000:2.0:1787119520.698741:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.698776:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.698804:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.698819:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653618816:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119520.698887:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00010000:00010000:0.0:1787119520.699133:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3e38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d1 expref: 18 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.699155:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653618560:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.699176:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.699186:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.699198:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:0.0:1787119520.699232:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633613568:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8390us (8615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.699238:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5307 00000100:00100000:3.0:1787119520.702201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.702324:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633613952 00000100:00100000:2.0:1787119520.702335:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633613952 00002000:00100000:2.0:1787119520.702388:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509232a00 x1873929633613952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.702399:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633613952 ext(217088->221183) 00010000:00010000:2.0:1787119520.702409:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.702464:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.702472:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509232a00 00000100:00100000:2.0:1787119520.702509:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1227 00000100:00100000:2.0:1787119520.702520:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633613952:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.702719:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633613952:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 200us (530us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119520.702727:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1227 00002000:00100000:2.0:1787119520.702735:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509232a00 x1873929633613952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.702743:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633613952 ext(217088->221183) 00010000:00010000:2.0:1787119520.702749:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.702763:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 34 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.702770:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509232a00 00000100:00100000:2.0:1787119520.704808:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653618816:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.704847:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.704871:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119520.704935:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633613824:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6292us (7671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.704944:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5308 00000100:00100000:3.0:1787119520.708297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.708347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.708429:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633614080 00000100:00100000:0.0:1787119520.708464:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633614080 00000100:00100000:0.0:1787119520.708525:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5309 00000100:00100000:0.0:1787119520.708536:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633614080:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.708555:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.708575:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164e6 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.708611:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 41) 00010000:00010000:0.0:1787119520.708620:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.708633:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 41) 00010000:00010000:0.0:1787119520.708639:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.708684:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.708699:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.708714:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38000, rc 0) 00000100:00100000:0.0:1787119520.708787:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633614080:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 253us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.708794:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5309 00000100:00100000:2.0:1787119520.709895:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633614208 00000100:00100000:2.0:1787119520.709913:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633614208 00010000:00010000:2.0:1787119520.709947:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.709985:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5377 00000100:00100000:2.0:1787119520.709994:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2376:x1873929633614208:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.710007:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.710039:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.710065:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.710087:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3e3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164d8 expref: 35 pid: 6696 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.710102:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 41) 00010000:00010000:2.0:1787119520.710107:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 41) 00010000:00010000:2.0:1787119520.710116:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.710128:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.710163:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.710179:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 16 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.710194:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653619072:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.710285:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.715754:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653619072:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.715782:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.715846:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633614208:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5852us (7497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.715858:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5377 00000100:00100000:3.0:1787119520.717550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.717646:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633614336 00000100:00100000:0.0:1787119520.717656:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633614336 00002000:00100000:0.0:1787119520.717704:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a509230a80 x1873929633614336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.717715:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633614336 ext(217088->253951) 00010000:00010000:0.0:1787119520.717724:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.717753:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.717765:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230a80 00000100:00100000:0.0:1787119520.717795:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1228 00000100:00100000:0.0:1787119520.717805:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633614336:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119520.722003:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633614336:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4187us (4448us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119520.722018:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1228 00002000:00100000:0.0:1787119520.722042:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a509230a80 x1873929633614336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.722054:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633614336 ext(217088->253951) 00010000:00010000:0.0:1787119520.722064:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.722094:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.722103:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230a80 00000100:00100000:1.0:1787119520.724738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.724837:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633614464 00000100:00100000:3.0:1787119520.724847:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633614464 00000100:00100000:3.0:1787119520.724915:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5310 00000100:00100000:3.0:1787119520.724926:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633614464:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.724946:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.724965:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164ed expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.725000:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 41) 00010000:00010000:3.0:1787119520.725010:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.725018:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 41) 00010000:00010000:3.0:1787119520.725023:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.725077:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.725094:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.725108:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb000, rc 0) 00000100:00100000:3.0:1787119520.725207:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633614464:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 282us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.725216:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5310 00000100:00100000:1.0:1787119520.727024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.727793:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633614592 00000100:00100000:0.0:1787119520.727805:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633614592 00010000:00010000:0.0:1787119520.727847:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 18 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.727893:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5378 00000100:00100000:0.0:1787119520.727911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633614592:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.727927:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.727947:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 18 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.727984:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 18 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.728011:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3e46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164df expref: 18 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.728039:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 41) 00010000:00010000:0.0:1787119520.728045:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 41) 00010000:00010000:0.0:1787119520.728055:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.728067:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.728109:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.728124:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 33 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.728138:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653619328:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.728239:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.731856:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653619328:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.731886:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.731963:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633614592:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4051us (4944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.731975:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5378 00000100:00100000:2.0:1787119520.734537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.734630:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633614720 00000100:00100000:1.0:1787119520.734641:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633614720 00010000:00010000:1.0:1787119520.734680:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.734726:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5379 00000100:00100000:1.0:1787119520.734736:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633614720:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119520.734750:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119520.734774:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.734799:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.734826:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e3e4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164e6 expref: 34 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.734848:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 41) 00010000:00010000:1.0:1787119520.734853:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 41) 00010000:00010000:1.0:1787119520.734862:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.734872:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.734930:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.734944:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511631880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653619456:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119520.735049:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.737810:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511631880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653619456:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119520.737839:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119520.737909:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633614720:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3174us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.737919:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5379 00010000:00010000:0.0:1787119520.738907:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119520.743508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.743609:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633614848 00000100:00100000:1.0:1787119520.743618:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633614848 00000100:00100000:1.0:1787119520.743682:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5311 00000100:00100000:1.0:1787119520.743703:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633614848:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.743726:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.743750:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164f4 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.743787:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.743797:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 41) 00010000:00010000:1.0:1787119520.743803:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 41) 00010000:00010000:1.0:1787119520.743808:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.743841:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.743875:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 16 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.743891:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653619584:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119520.743994:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066746c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119520.753265:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653619584:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119520.753305:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.753328:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119520.753393:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633614848:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9692us (9894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.753402:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5311 00000100:00100000:3.0:1787119520.755931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.755974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.756174:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633615104 00000100:00100000:2.0:1787119520.756184:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633615104 00000100:00100000:2.0:1787119520.756244:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5312 00000100:00100000:2.0:1787119520.756253:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633615104:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.756272:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.756290:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047164fb expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.756324:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 41) 00010000:00010000:2.0:1787119520.756332:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.756339:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 41) 00010000:00010000:2.0:1787119520.756345:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.756386:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.756401:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.756413:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:2.0:1787119520.756508:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633615104:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 255us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.756515:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5312 00000100:00100000:0.0:1787119520.756634:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633614976 00000100:00100000:0.0:1787119520.756639:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633614976 00010000:00010000:0.0:1787119520.756660:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 18 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.756698:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5380 00000100:00100000:0.0:1787119520.756705:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633614976:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119520.756715:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119520.756737:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 18 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.756761:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 18 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.756782:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3e54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164ed expref: 18 pid: 6693 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.756797:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 41) 00010000:00010000:0.0:1787119520.756800:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 41) 00010000:00010000:0.0:1787119520.756809:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.756818:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.756842:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.756856:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 33 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.756868:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653619840:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119520.756933:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.762960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.763121:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633615232 00000100:00100000:1.0:1787119520.763133:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633615232 00002000:00100000:1.0:1787119520.763181:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509231c00 x1873929633615232/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.763193:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633615232 ext(217088->221183) 00010000:00010000:1.0:1787119520.763204:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.763233:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.763248:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231c00 00000100:00100000:1.0:1787119520.763287:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1229 00000100:00100000:1.0:1787119520.763297:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633615232:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119520.763527:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633615232:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 230us (577us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119520.763534:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1229 00002000:00100000:1.0:1787119520.763541:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509231c00 x1873929633615232/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.763550:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633615232 ext(217088->221183) 00010000:00010000:1.0:1787119520.763556:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.763571:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.763578:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231c00 00000100:00100000:0.0:1787119520.763774:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653619840:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.763793:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.763825:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633614976:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7119us (7850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.763833:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5380 00000100:00100000:0.0:1787119520.771641:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.771945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.772012:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633615488 00000100:00100000:2.0:1787119520.772023:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633615488 00000100:00100000:3.0:1787119520.772076:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633615360 00000100:00100000:3.0:1787119520.772082:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633615360 00000100:00100000:3.0:1787119520.772142:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5313 00000100:00100000:3.0:1787119520.772152:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633615360:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.772169:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.772189:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716502 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.772249:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 36 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.772293:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5381 00000100:00100000:2.0:1787119520.772301:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633615488:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.772312:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.772354:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 41) 00010000:00010000:3.0:1787119520.772401:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.772411:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 41) 00010000:00010000:3.0:1787119520.772417:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 36 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.772756:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 36 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.776848:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.776848:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 36 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.777889:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 36 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.777956:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e3e5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164f4 expref: 36 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.777986:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 41) 00010000:00010000:2.0:1787119520.777992:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 41) 00010000:00010000:2.0:1787119520.778001:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.778012:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.778078:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.778180:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 16 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.778197:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653620096:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.778372:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00010000:00010000:3.0:1787119520.778658:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa600, rc 0) 00000100:00100000:3.0:1787119520.778698:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633615360:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6546us (7064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.778706:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5313 00000100:00100000:2.0:1787119520.789147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.789709:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653620096:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.789735:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.789803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633615488:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 17501us (17857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.789819:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5381 00000100:00100000:3.0:1787119520.791285:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633615616 00000100:00100000:3.0:1787119520.791300:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633615616 00002000:00100000:3.0:1787119520.791360:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63414c700 x1873929633615616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.791372:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c700 with x1873929633615616 ext(217088->253951) 00010000:00010000:3.0:1787119520.791382:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.791415:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.791423:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414c700 00000100:00100000:3.0:1787119520.791830:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1230 00000100:00100000:3.0:1787119520.791844:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633615616:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119520.797977:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633615616:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6127us (8828us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119520.797992:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1230 00002000:00100000:0.0:1787119520.798005:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63414c700 x1873929633615616/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119520.798017:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c700 with x1873929633615616 ext(217088->253951) 00010000:00010000:0.0:1787119520.798039:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.798070:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119520.798079:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414c700 00000100:00100000:3.0:1787119520.803732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.803772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.804128:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633615872 00000100:00100000:1.0:1787119520.804140:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633615872 00010000:00010000:1.0:1787119520.804186:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.804241:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5382 00000100:00100000:1.0:1787119520.804253:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633615872:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119520.804271:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119520.804298:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.804325:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.804351:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3e62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047164fb expref: 17 pid: 20841 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.804368:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 41) 00010000:00010000:1.0:1787119520.804373:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 41) 00010000:00010000:1.0:1787119520.804381:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.804391:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.804425:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.804492:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653620224:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119520.804560:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.805431:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633615744 00000100:00100000:0.0:1787119520.805474:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633615744 00000100:00100000:0.0:1787119520.805527:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5314 00000100:00100000:0.0:1787119520.805536:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633615744:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.805552:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.805566:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716509 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.805595:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.805608:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 41) 00010000:00010000:0.0:1787119520.805612:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 41) 00010000:00010000:0.0:1787119520.805616:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 18 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.805643:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.805833:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 33 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119520.805848:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653620352:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119520.805917:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.817228:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653620352:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119520.817272:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 18 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.817299:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:3.0:1787119520.817369:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633615744:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11832us (13645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.817379:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5314 00000100:00100000:1.0:1787119520.822424:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653620224:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119520.822464:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119520.822532:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633615872:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 18281us (18758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.822544:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5382 00000100:00100000:0.0:1787119520.824388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.824511:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633616000 00000100:00100000:2.0:1787119520.824522:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633616000 00010000:00010000:2.0:1787119520.824564:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 34 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.824610:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5383 00000100:00100000:2.0:1787119520.824620:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633616000:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.824636:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.824659:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 34 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.824685:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 34 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.824712:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3e69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716502 expref: 34 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.824731:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 41) 00010000:00010000:2.0:1787119520.824736:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 41) 00010000:00010000:2.0:1787119520.824746:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.824757:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.824800:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.824816:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653620480:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.824918:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.827970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.828279:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653620480:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.828306:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.828369:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633616000:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3749us (3991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.828381:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5383 00000100:00100000:1.0:1787119520.829095:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633616128 00000100:00100000:1.0:1787119520.829105:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633616128 00000100:00100000:1.0:1787119520.829259:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5315 00000100:00100000:1.0:1787119520.829286:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633616128:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.829323:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.829354:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716510 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.829402:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.829425:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 41) 00010000:00010000:1.0:1787119520.829429:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 41) 00010000:00010000:1.0:1787119520.829559:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.829628:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.829675:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 16 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.829690:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653620608:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119520.829765:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119520.840399:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653620608:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119520.840486:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.840513:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119520.840582:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633616128:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11313us (12621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.840592:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5315 00000100:00100000:3.0:1787119520.841358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.841544:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633616256 00000100:00100000:2.0:1787119520.841553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633616256 00010000:00010000:2.0:1787119520.841592:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 17 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.841625:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5384 00000100:00100000:2.0:1787119520.841634:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633616256:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.841652:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.841677:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 17 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.841702:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 17 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.841735:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3e70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716509 expref: 17 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.841754:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 41) 00010000:00010000:2.0:1787119520.841759:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 41) 00010000:00010000:2.0:1787119520.841768:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.841780:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.841817:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.841831:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653620736:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.841906:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.848745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.848849:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633616384 00000100:00100000:1.0:1787119520.848861:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633616384 00000100:00100000:1.0:1787119520.848935:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5316 00000100:00100000:1.0:1787119520.848945:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633616384:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.848964:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.848984:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716517 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.849021:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.849042:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 41) 00010000:00010000:1.0:1787119520.849047:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 41) 00010000:00010000:1.0:1787119520.849052:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.849089:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.849114:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 33 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.849129:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653620864:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119520.849217:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.856823:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653620736:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.856854:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.856918:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633616256:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 15283us (15563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.856930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5384 00000100:00100000:1.0:1787119520.858713:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653620864:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119520.858754:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 17 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.858779:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119520.858842:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633616384:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9898us (10109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.858852:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5316 00000100:00100000:3.0:1787119520.862052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.862160:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633616512 00000100:00100000:2.0:1787119520.862172:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633616512 00002000:00100000:2.0:1787119520.862226:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a508da4380 x1873929633616512/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.862239:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4380 with x1873929633616512 ext(217088->221183) 00010000:00010000:2.0:1787119520.862250:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.862281:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.862290:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4380 00000100:00100000:2.0:1787119520.862325:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1231 00000100:00100000:2.0:1787119520.862335:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633616512:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.862582:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633616512:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 249us (555us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119520.862589:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1231 00002000:00100000:2.0:1787119520.862595:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a508da4380 x1873929633616512/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.862603:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4380 with x1873929633616512 ext(217088->221183) 00010000:00010000:2.0:1787119520.862608:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.862621:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.862627:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4380 00000100:00100000:3.0:1787119520.874572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.874678:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633616640 00000100:00100000:1.0:1787119520.874688:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633616640 00010000:00010000:1.0:1787119520.874736:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.874771:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5385 00000100:00100000:1.0:1787119520.874782:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633616640:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119520.874798:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119520.874823:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.874855:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.874884:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e3e77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716510 expref: 34 pid: 6695 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.874914:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 41) 00010000:00010000:1.0:1787119520.874919:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 41) 00010000:00010000:1.0:1787119520.874929:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.874940:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.874980:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.874994:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653620992:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119520.875084:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.878987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.879121:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633616768 00000100:00100000:3.0:1787119520.879131:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633616768 00000100:00100000:3.0:1787119520.879184:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5317 00000100:00100000:3.0:1787119520.879193:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633616768:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.879211:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.879239:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471651e expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.879272:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.879288:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 41) 00010000:00010000:3.0:1787119520.879293:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(203 41) 00010000:00010000:3.0:1787119520.879298:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 35 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.879329:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.879354:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 16 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.879368:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653621120:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119520.879480:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119520.887987:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653620992:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119520.888014:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119520.888075:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2376:x1873929633616640:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13295us (13511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.888089:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5385 00000100:00100000:2.0:1787119520.889677:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653621120:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.889715:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 34 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.889740:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fba00, rc 0) 00000100:00100000:2.0:1787119520.889855:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633616768:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10662us (10877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.889864:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5317 00000100:00100000:3.0:1787119520.893375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.893569:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633616896 00000100:00100000:2.0:1787119520.893580:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633616896 00002000:00100000:2.0:1787119520.893635:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a508da4000 x1873929633616896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.893648:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633616896 ext(217088->253951) 00010000:00010000:2.0:1787119520.893659:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 17 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.893689:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 17 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.893697:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4000 00000100:00100000:2.0:1787119520.893734:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1232 00000100:00100000:2.0:1787119520.893744:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633616896:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119520.898416:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633616896:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4662us (5040us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119520.898429:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1232 00002000:00100000:2.0:1787119520.898676:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a508da4000 x1873929633616896/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119520.898688:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633616896 ext(217088->253951) 00010000:00010000:2.0:1787119520.898698:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 17 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.898726:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 17 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119520.898734:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4000 00000100:00100000:0.0:1787119520.901676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.901725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.901922:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633617152 00000100:00100000:3.0:1787119520.901933:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633617152 00000100:00100000:3.0:1787119520.901999:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5318 00000100:00100000:3.0:1787119520.902009:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633617152:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119520.902035:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119520.902057:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716525 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.902091:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(203 41) 00010000:00010000:3.0:1787119520.902100:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.902108:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 41) 00010000:00010000:3.0:1787119520.902113:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 18 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.902156:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.902172:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 18 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.902184:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb600, rc 0) 00000100:00100000:2.0:1787119520.902335:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633617024 00000100:00100000:2.0:1787119520.902339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633617024 00010000:00010000:2.0:1787119520.902360:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 19 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.902392:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5386 00000100:00100000:2.0:1787119520.902400:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633617024:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.902412:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.902477:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 19 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.902501:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 19 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.902521:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3e7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716517 expref: 19 pid: 8267 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.902535:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 41) 00010000:00010000:2.0:1787119520.902539:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 41) 00010000:00010000:2.0:1787119520.902552:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.902561:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.902587:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.902601:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 33 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.902615:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653621376:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.902691:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633617152:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 683us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.902699:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5318 00000100:00100000:2.0:1787119520.903352:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.907146:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653621376:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.907175:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.907246:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633617024:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4845us (5580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.907258:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5386 00000100:00100000:3.0:1787119520.907346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.907705:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633617280 00000100:00100000:2.0:1787119520.907712:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633617280 00010000:00010000:2.0:1787119520.907738:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 34 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.907767:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5387 00000100:00100000:2.0:1787119520.907773:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633617280:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.907783:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.907802:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 34 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.907828:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 34 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.907854:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3e85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471651e expref: 34 pid: 20843 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.907869:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 41) 00010000:00010000:2.0:1787119520.907873:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 41) 00010000:00010000:2.0:1787119520.907879:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.907886:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.907929:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.907948:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653621504:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.908016:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.910833:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653621504:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.910859:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.910919:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633617280:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3145us (3574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.910930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5387 00000100:00100000:1.0:1787119520.918630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.919203:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633617408 00000100:00100000:2.0:1787119520.919213:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633617408 00000100:00100000:2.0:1787119520.919397:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5319 00000100:00100000:2.0:1787119520.919409:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633617408:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.919426:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.919480:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471652c expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.919521:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.919532:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 41) 00010000:00010000:2.0:1787119520.919537:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 41) 00010000:00010000:2.0:1787119520.919544:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.919584:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.919611:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 16 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.919627:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653621632:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119520.919716:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.926503:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653621632:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119520.926555:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.926582:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119520.926644:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633617408:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7237us (8211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.926652:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5319 00000100:00100000:0.0:1787119520.926755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.926848:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633617536 00000100:00100000:1.0:1787119520.926855:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633617536 00010000:00010000:1.0:1787119520.926885:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 17 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.926926:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5388 00000100:00100000:1.0:1787119520.926934:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633617536:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119520.926947:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119520.926970:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 17 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.927004:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 17 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.927038:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3e8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716525 expref: 17 pid: 12469 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.927053:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=1s v=(206 41) 00010000:00010000:1.0:1787119520.927057:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 41) 00010000:00010000:1.0:1787119520.927066:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.927076:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.927110:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.927124:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653621760:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119520.927182:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.931310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.932976:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633617664 00000100:00100000:1.0:1787119520.932990:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633617664 00000100:00100000:1.0:1787119520.933183:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5320 00000100:00100000:1.0:1787119520.933193:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633617664:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.933212:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.933240:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716533 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.933273:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.933283:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 41) 00010000:00010000:1.0:1787119520.933287:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(207 41) 00010000:00010000:1.0:1787119520.933291:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.933325:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.933356:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 33 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119520.933372:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511631f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653621888:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119520.933587:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066749c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119520.943175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.943332:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511631f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653621888:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119520.943371:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.943397:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:0.0:1787119520.943486:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633617664:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10293us (12188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.943496:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5320 00000100:00100000:3.0:1787119520.943587:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633617792 00000100:00100000:3.0:1787119520.943595:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633617792 00002000:00100000:3.0:1787119520.943639:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a5098a5c00 x1873929633617792/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.943649:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5c00 with x1873929633617792 ext(217088->221183) 00010000:00010000:3.0:1787119520.943656:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.943691:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.943699:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5c00 00000100:00100000:3.0:1787119520.943721:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1233 00000100:00100000:3.0:1787119520.943729:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633617792:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.943914:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633617792:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 184us (747us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119520.943921:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1233 00002000:00100000:3.0:1787119520.943927:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a5098a5c00 x1873929633617792/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.943935:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5c00 with x1873929633617792 ext(217088->221183) 00010000:00010000:3.0:1787119520.943940:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.943953:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.943960:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5c00 00000100:00100000:3.0:1787119520.943997:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653621760:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119520.944009:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119520.944046:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633617536:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 17112us (17291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119520.944055:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5388 00000100:00100000:3.0:1787119520.951047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.951167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.951322:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633618048 00000100:00100000:2.0:1787119520.951332:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633618048 00000100:00100000:2.0:1787119520.951391:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5321 00000100:00100000:2.0:1787119520.951401:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633618048:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119520.951418:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119520.951461:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471653a expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951496:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(207 41) 00010000:00010000:2.0:1787119520.951505:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951513:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 41) 00010000:00010000:2.0:1787119520.951519:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 35 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951560:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951575:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 35 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951587:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119520.951640:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633618048:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 239us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.951647:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5321 00000100:00100000:2.0:1787119520.951676:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633617920 00000100:00100000:2.0:1787119520.951680:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633617920 00010000:00010000:2.0:1787119520.951697:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 35 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.951727:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5389 00000100:00100000:2.0:1787119520.951733:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2373:x1873929633617920:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.951744:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.951766:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 35 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951795:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 35 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951826:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3e93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471652c expref: 35 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951839:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 41) 00010000:00010000:2.0:1787119520.951843:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 41) 00010000:00010000:2.0:1787119520.951850:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951859:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951881:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.951895:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 16 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.951908:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653622144:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.951955:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119520.957392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.957474:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653622144:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119520.957503:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119520.957572:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2373:x1873929633617920:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5837us (6547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119520.957583:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5389 00000100:00100000:1.0:1787119520.957717:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633618176 00000100:00100000:1.0:1787119520.957724:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633618176 00002000:00100000:1.0:1787119520.957769:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a508da5f80 x1873929633618176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.957780:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5f80 with x1873929633618176 ext(217088->253951) 00010000:00010000:1.0:1787119520.957789:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 17 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.957817:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 17 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.957824:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5f80 00000100:00100000:1.0:1787119520.957908:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1234 00000100:00100000:1.0:1787119520.957919:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633618176:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119520.961928:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633618176:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3999us (4535us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119520.961942:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1234 00002000:00100000:1.0:1787119520.961956:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a508da5f80 x1873929633618176/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:556/0 lens 488/440 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119520.961967:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5f80 with x1873929633618176 ext(217088->253951) 00010000:00010000:1.0:1787119520.961978:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 17 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.962009:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 17 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119520.962018:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5f80 00000100:00100000:3.0:1787119520.968561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119520.968683:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633618304 00000100:00100000:0.0:1787119520.968695:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633618304 00000100:00100000:0.0:1787119520.968759:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5322 00000100:00100000:0.0:1787119520.968768:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633618304:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119520.968787:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119520.968817:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716541 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.968851:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 41) 00010000:00010000:0.0:1787119520.968859:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.968866:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 41) 00010000:00010000:0.0:1787119520.968871:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.968923:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.968937:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119520.968949:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38600, rc 0) 00000100:00100000:0.0:1787119520.969009:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633618304:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 242us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.969016:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5322 00000100:00100000:3.0:1787119520.973395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.973518:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633618432 00000100:00100000:2.0:1787119520.973529:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633618432 00010000:00010000:2.0:1787119520.973572:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 18 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.973620:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5390 00000100:00100000:2.0:1787119520.973630:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633618432:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119520.973646:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119520.973671:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 18 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.973697:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 18 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.973720:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e3e9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716533 expref: 18 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.973737:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(211 41) 00010000:00010000:2.0:1787119520.973742:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(211 41) 00010000:00010000:2.0:1787119520.973751:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.973766:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.973819:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119520.973836:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 33 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119520.973850:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653622400:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119520.973944:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119520.980352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119520.980655:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633618560 00000100:00100000:3.0:1787119520.980665:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633618560 00002000:00100000:3.0:1787119520.980717:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63414c000 x1873929633618560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/0 e 0 to 0 dl 1787119531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.980728:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c000 with x1873929633618560 ext(217088->221183) 00010000:00010000:3.0:1787119520.980737:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 34 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.980766:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 34 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.980774:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414c000 00000100:00100000:3.0:1787119520.980816:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1235 00000100:00100000:3.0:1787119520.980827:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633618560:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119520.981073:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633618560:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 246us (731us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119520.981081:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1235 00002000:00100000:3.0:1787119520.981089:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63414c000 x1873929633618560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787119531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119520.981097:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c000 with x1873929633618560 ext(217088->221183) 00010000:00010000:3.0:1787119520.981104:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 34 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.981119:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 34 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119520.981126:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414c000 00000100:00100000:0.0:1787119520.981643:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653622400:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119520.981666:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119520.981710:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633618432:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8081us (8324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119520.981719:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5390 00000100:00100000:2.0:1787119520.991170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119520.991222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119520.991673:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633618688 00000100:00100000:1.0:1787119520.991685:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633618688 00000100:00100000:1.0:1787119520.991751:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5323 00000100:00100000:1.0:1787119520.991761:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633618688:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119520.991783:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119520.991803:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716548 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.991833:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(211 41) 00010000:00010000:1.0:1787119520.991843:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.991850:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(212 41) 00010000:00010000:1.0:1787119520.991855:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 35 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.991894:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.991910:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 35 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119520.991922:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119520.992002:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633618688:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 242us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119520.992010:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5323 00000100:00100000:3.0:1787119520.994134:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633618816 00000100:00100000:3.0:1787119520.994150:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633618816 00010000:00010000:3.0:1787119520.994204:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 35 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.994264:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5391 00000100:00100000:3.0:1787119520.994274:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2376:x1873929633618816:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119520.994289:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119520.994313:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 35 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.994338:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 35 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.994365:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3ea1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471653a expref: 35 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.994389:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(213 41) 00010000:00010000:3.0:1787119520.994394:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(213 41) 00010000:00010000:3.0:1787119520.994404:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.994416:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.994518:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119520.994535:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 16 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119520.994551:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653622656:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119520.994657:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.000348:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653622656:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119521.000380:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119521.000482:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633618816:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6207us (9257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.000495:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5391 00000100:00100000:0.0:1787119521.010310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.010420:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633618944 00000100:00100000:2.0:1787119521.010433:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633618944 00010000:00010000:2.0:1787119521.010516:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.010562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5392 00000100:00100000:2.0:1787119521.010573:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633618944:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.010591:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119521.010620:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.010654:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.010683:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3ea8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716541 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.010706:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(213 41) 00010000:00010000:2.0:1787119521.010711:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(213 41) 00010000:00010000:2.0:1787119521.010720:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.010731:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.010772:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.010786:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653622784:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.010871:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.019772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.020121:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633619072 00000100:00100000:2.0:1787119521.020132:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633619072 00000100:00100000:2.0:1787119521.020199:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5324 00000100:00100000:2.0:1787119521.020209:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633619072:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.020227:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.020248:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471654f expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.020281:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.020292:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(213 41) 00010000:00010000:2.0:1787119521.020296:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 41) 00010000:00010000:2.0:1787119521.020301:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.020336:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.020362:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 33 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.020377:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653622912:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119521.020506:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066780 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.021385:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653622784:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119521.021415:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119521.021517:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633618944:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10944us (11222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.021527:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5392 00000100:00100000:2.0:1787119521.024379:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653622912:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119521.024414:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.024481:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119521.024542:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633619072:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4334us (4782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.024555:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5324 00000100:00100000:0.0:1787119521.025277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.025393:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633619200 00000100:00100000:2.0:1787119521.025401:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633619200 00010000:00010000:2.0:1787119521.025530:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.025609:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5393 00000100:00100000:2.0:1787119521.025619:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620709050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633619200:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.025636:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119521.025662:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.025689:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.025714:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e3eaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716548 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.025732:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 41) 00010000:00010000:2.0:1787119521.025737:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 41) 00010000:00010000:2.0:1787119521.025745:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.025755:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.025798:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.025823:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653623040:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.025902:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066780 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.030770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.031315:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633619328 00000100:00100000:3.0:1787119521.031328:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633619328 00000100:00100000:3.0:1787119521.031393:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5325 00000100:00100000:3.0:1787119521.031402:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633619328:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.031423:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.031592:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716556 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.031638:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.031648:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 41) 00010000:00010000:3.0:1787119521.031652:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(215 41) 00010000:00010000:3.0:1787119521.031657:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.031693:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.031721:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 16 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.031737:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653623168:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119521.031937:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.041563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.041670:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653623040:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119521.041698:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119521.041757:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620709050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2375:x1873929633619200:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 16139us (16481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.041768:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5393 00000100:00100000:0.0:1787119521.042264:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633619456 00000100:00100000:0.0:1787119521.042273:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633619456 00002000:00100000:0.0:1787119521.042323:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a511633800 x1873929633619456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.042334:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633800 with x1873929633619456 ext(217088->253951) 00010000:00010000:0.0:1787119521.042344:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.042375:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.042383:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633800 00000100:00100000:0.0:1787119521.042415:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1236 00000100:00100000:0.0:1787119521.042425:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633619456:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119521.047945:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653623168:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119521.047985:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 34 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.048008:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa200, rc 0) 00000100:00100000:3.0:1787119521.048083:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633619328:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 16680us (17324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.048092:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5325 00000100:00100000:0.0:1787119521.050536:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633619456:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 8099us (8972us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119521.050553:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1236 00002000:00100000:0.0:1787119521.050566:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a511633800 x1873929633619456/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.050577:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633800 with x1873929633619456 ext(217088->253951) 00010000:00010000:0.0:1787119521.050587:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.050618:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.050628:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633800 00000100:00100000:2.0:1787119521.053424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.053970:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633619584 00000100:00100000:3.0:1787119521.053981:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633619584 00000100:00100000:3.0:1787119521.054113:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5326 00000100:00100000:3.0:1787119521.054124:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633619584:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.054144:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.054163:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471655d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.054197:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(215 41) 00010000:00010000:3.0:1787119521.054206:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.054214:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 41) 00010000:00010000:3.0:1787119521.054219:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.054271:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.054288:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.054302:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb000, rc 0) 00000100:00100000:3.0:1787119521.054550:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633619584:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 427us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.054558:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5326 00000100:00100000:0.0:1787119521.064574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.065090:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633619712 00000100:00100000:3.0:1787119521.065100:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633619712 00010000:00010000:3.0:1787119521.065143:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.065194:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5394 00000100:00100000:3.0:1787119521.065205:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633619712:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119521.065234:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119521.065261:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.065291:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.065319:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3eb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471654f expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.065346:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(217 41) 00010000:00010000:3.0:1787119521.065351:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(217 41) 00010000:00010000:3.0:1787119521.065360:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.065371:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.065427:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.065485:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 33 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.065501:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653623424:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119521.065576:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.085755:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653623424:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119521.085787:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119521.085925:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633619712:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 20719us (21361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.085936:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5394 00000100:00100000:3.0:1787119521.094289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.094396:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633619840 00000100:00100000:0.0:1787119521.094407:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633619840 00002000:00100000:0.0:1787119521.094500:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a508da4a80 x1873929633619840/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.094513:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4a80 with x1873929633619840 ext(217088->221183) 00010000:00010000:0.0:1787119521.094522:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 34 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.094553:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 34 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.094566:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4a80 00000100:00100000:0.0:1787119521.094588:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1237 00000100:00100000:0.0:1787119521.094598:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633619840:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119521.094803:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633619840:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 205us (525us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119521.094811:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1237 00002000:00100000:0.0:1787119521.094818:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a508da4a80 x1873929633619840/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.094826:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4a80 with x1873929633619840 ext(217088->221183) 00010000:00010000:0.0:1787119521.094832:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 34 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.094846:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 34 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.094853:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4a80 00000100:00100000:1.0:1787119521.104984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.105043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.105185:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633619968 00000100:00100000:2.0:1787119521.105196:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633619968 00000100:00100000:2.0:1787119521.105266:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5327 00000100:00100000:2.0:1787119521.105277:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633619968:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.105298:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.105319:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716564 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.105355:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(217 41) 00010000:00010000:2.0:1787119521.105366:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.105374:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(218 41) 00000100:00100000:3.0:1787119521.105382:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633620096 00010000:00010000:2.0:1787119521.105382:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.105389:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633620096 00010000:00010000:3.0:1787119521.105421:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.105478:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.105495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5395 00010000:00010000:2.0:1787119521.105498:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 36 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.105508:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2375:x1873929633620096:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.105517:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00010000:00010000:3.0:1787119521.105521:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119521.105550:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.105579:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.105593:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+36:33957:x1873929633619968:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 316us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.105602:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5327 00010000:00010000:3.0:1787119521.105606:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ebd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716556 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.105624:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 41) 00010000:00010000:3.0:1787119521.105629:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 41) 00010000:00010000:3.0:1787119521.105639:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.105649:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.105689:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.105712:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 16 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.105726:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653623680:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.106897:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:2.0:1787119521.109049:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653623680:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119521.109075:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119521.109741:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633620096:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4231us (4691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.109755:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5395 00000100:00100000:3.0:1787119521.110275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.110413:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633620224 00000100:00100000:2.0:1787119521.110423:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633620224 00010000:00010000:2.0:1787119521.110493:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 17 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.110540:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5396 00000100:00100000:2.0:1787119521.110551:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633620224:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.110571:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119521.110597:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 17 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.110624:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 17 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.110653:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ec4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471655d expref: 17 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.110671:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 41) 00010000:00010000:2.0:1787119521.110676:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 41) 00010000:00010000:2.0:1787119521.110684:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.110694:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.110735:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.110752:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653623808:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.128780:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.129927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.132382:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653623808:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.132411:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.132513:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633620224:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 21962us (22239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.132524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5396 00000100:00100000:2.0:1787119521.134646:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633620352 00000100:00100000:2.0:1787119521.134664:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633620352 00000100:00100000:2.0:1787119521.134748:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5328 00000100:00100000:2.0:1787119521.134758:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633620352:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.134778:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.134799:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471656b expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.134829:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.134839:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 41) 00010000:00010000:2.0:1787119521.134844:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 41) 00010000:00010000:2.0:1787119521.134850:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.134882:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.134976:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 33 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.134991:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653623936:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119521.135144:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.142368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.142469:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633620480 00000100:00100000:1.0:1787119521.142479:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633620480 00002000:00100000:1.0:1787119521.142526:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a508da5880 x1873929633620480/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.142538:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633620480 ext(217088->221183) 00010000:00010000:1.0:1787119521.142548:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 34 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.142578:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 34 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119521.142588:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5880 00000100:00100000:1.0:1787119521.142612:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1238 00000100:00100000:1.0:1787119521.142622:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633620480:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.142858:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653623936:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119521.142894:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.142927:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:1.0:1787119521.154069:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633620480:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 11433us (11696us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119521.154089:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1238 00002000:00100000:1.0:1787119521.154105:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a508da5880 x1873929633620480/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.154116:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633620480 ext(217088->221183) 00010000:00010000:1.0:1787119521.154128:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 34 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.154161:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 34 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119521.154169:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5880 00000100:00100000:2.0:1787119521.158770:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633620352:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 23999us (28836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.158785:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5328 00000100:00100000:3.0:1787119521.163734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.164075:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633620608 00000100:00100000:0.0:1787119521.164087:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633620608 00000100:00100000:0.0:1787119521.164150:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5329 00000100:00100000:0.0:1787119521.164161:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633620608:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.164179:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.164198:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716572 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.164241:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 41) 00010000:00010000:0.0:1787119521.164251:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.164259:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 41) 00010000:00010000:0.0:1787119521.164264:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.164305:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.164320:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.164333:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38a00, rc 0) 00000100:00100000:0.0:1787119521.164386:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633620608:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 228us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.164394:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5329 00000100:00100000:3.0:1787119521.164749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.169076:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633620736 00000100:00100000:2.0:1787119521.169093:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633620736 00010000:00010000:2.0:1787119521.169140:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 35 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.169184:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5397 00000100:00100000:2.0:1787119521.169194:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2375:x1873929633620736:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.169565:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.169651:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 35 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.169682:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 35 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.169707:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3ecb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716564 expref: 35 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.169724:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(222 41) 00010000:00010000:0.0:1787119521.169729:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(222 41) 00010000:00010000:0.0:1787119521.169737:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.169747:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.169789:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.169805:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 16 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.169819:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653624192:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.169927:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.173566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.174390:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633620864 00000100:00100000:2.0:1787119521.174401:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633620864 00002000:00100000:2.0:1787119521.174501:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63eb28e00 x1873929633620864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.174513:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28e00 with x1873929633620864 ext(217088->253951) 00010000:00010000:2.0:1787119521.174523:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.174554:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.174562:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28e00 00000100:00100000:2.0:1787119521.174595:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1239 00000100:00100000:2.0:1787119521.174605:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633620864:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.179127:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633620864:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4511us (5559us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119521.179142:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1239 00002000:00100000:2.0:1787119521.179154:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63eb28e00 x1873929633620864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.179166:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28e00 with x1873929633620864 ext(217088->253951) 00010000:00010000:2.0:1787119521.179176:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.179220:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.179229:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28e00 00000100:00100000:0.0:1787119521.186699:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653624192:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.186731:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.186811:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633620736:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 17617us (22061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.186822:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5397 00000100:00100000:3.0:1787119521.196046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.196097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.196179:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633620992 00000100:00100000:0.0:1787119521.196190:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633620992 00000100:00100000:0.0:1787119521.196261:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5330 00000100:00100000:0.0:1787119521.196272:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633620992:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.196296:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.196316:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716579 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.196355:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(222 41) 00010000:00010000:0.0:1787119521.196364:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.196372:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(223 41) 00010000:00010000:0.0:1787119521.196378:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.196434:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.196472:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.196490:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119521.196546:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633620992:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 275us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.196553:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5330 00000100:00100000:2.0:1787119521.198781:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633621120 00000100:00100000:2.0:1787119521.198801:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633621120 00010000:00010000:2.0:1787119521.198849:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.198912:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5398 00000100:00100000:2.0:1787119521.198929:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2373:x1873929633621120:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.198944:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119521.198972:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.199005:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.199047:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3ed2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471656b expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.199069:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 41) 00010000:00010000:2.0:1787119521.199074:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 41) 00010000:00010000:2.0:1787119521.199082:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.199101:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.199143:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 33 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.199159:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 33 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.199173:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653624448:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.199362:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.204338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.204471:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653624448:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119521.204499:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.205681:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633621248 00000100:00100000:1.0:1787119521.205693:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633621248 00010000:00010000:1.0:1787119521.207857:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 34 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.207951:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5399 00000100:00100000:1.0:1787119521.207964:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633621248:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119521.208099:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119521.208128:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 34 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.208162:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 34 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.208188:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3ed9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716572 expref: 34 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.208280:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 41) 00010000:00010000:1.0:1787119521.208286:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 41) 00010000:00010000:1.0:1787119521.208295:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.208306:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.208347:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.208362:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653624576:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.210075:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2373:x1873929633621120:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11142us (13965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.210089:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5398 00000100:00100000:1.0:1787119521.216801:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066749c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.217171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.222094:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633621376 00000100:00100000:3.0:1787119521.222111:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633621376 00000100:00100000:3.0:1787119521.222189:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5331 00000100:00100000:3.0:1787119521.222199:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633621376:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.222219:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.222238:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716580 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.222272:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.222288:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 41) 00010000:00010000:3.0:1787119521.222292:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(225 41) 00010000:00010000:3.0:1787119521.222298:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 35 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.222336:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.222365:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 16 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.222381:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653624704:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119521.222522:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.224205:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653624576:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119521.224244:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.224300:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2376:x1873929633621248:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 16338us (19969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.224314:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5399 00000100:00100000:0.0:1787119521.229655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.229877:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633621504 00000100:00100000:1.0:1787119521.229897:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633621504 00010000:00010000:1.0:1787119521.229938:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 17 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.229988:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5400 00000100:00100000:1.0:1787119521.229999:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633621504:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119521.230014:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119521.230046:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 17 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.230073:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 17 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.230101:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(225 41) 00010000:00010000:1.0:1787119521.230106:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(225 41) 00010000:00010000:1.0:1787119521.230115:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.230126:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.230162:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.230182:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653624832:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119521.230256:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066749c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787119521.230576:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3ee0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716579 expref: 17 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.230596:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653624704:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119521.230624:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.230635:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa200, rc 0) 00000100:00100000:3.0:1787119521.230670:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633621376:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8472us (13503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.230682:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5331 00000100:00100000:0.0:1787119521.235678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.235763:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633621632 00000100:00100000:2.0:1787119521.235772:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633621632 00000100:00100000:2.0:1787119521.235825:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5332 00000100:00100000:2.0:1787119521.235834:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633621632:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.235852:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.235869:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716587 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.235908:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.235918:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(225 41) 00010000:00010000:2.0:1787119521.235923:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 41) 00010000:00010000:2.0:1787119521.235928:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.235961:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.235985:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 33 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.236004:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653624960:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119521.236095:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.241389:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653624832:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119521.241418:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.241510:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633621504:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11511us (11864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.241522:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5400 00000100:00100000:3.0:1787119521.243035:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653624960:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119521.243073:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.243096:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:1.0:1787119521.243406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.243504:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633621760 00000100:00100000:2.0:1787119521.243513:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633621760 00002000:00100000:2.0:1787119521.243558:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a511632300 x1873929633621760/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.243568:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632300 with x1873929633621760 ext(217088->221183) 00010000:00010000:2.0:1787119521.243576:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.243604:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.243612:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511632300 00000100:00100000:2.0:1787119521.243645:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1240 00000100:00100000:2.0:1787119521.243655:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633621760:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.243852:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633621760:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 198us (446us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119521.243860:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1240 00002000:00100000:2.0:1787119521.243866:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a511632300 x1873929633621760/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.243874:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632300 with x1873929633621760 ext(217088->221183) 00010000:00010000:2.0:1787119521.243880:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.243906:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.243913:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511632300 00000100:00100000:3.0:1787119521.247323:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.247808:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633621632:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11971us (12137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.247819:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5332 00000100:00100000:0.0:1787119521.247854:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633621888 00000100:00100000:0.0:1787119521.247862:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633621888 00000100:00100000:0.0:1787119521.247915:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5333 00000100:00100000:0.0:1787119521.247924:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633621888:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.247941:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.247961:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471658e expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.247992:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 41) 00010000:00010000:0.0:1787119521.248001:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.248007:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 41) 00010000:00010000:0.0:1787119521.248012:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 35 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.248062:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.248077:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 35 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.248090:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38200, rc 0) 00000100:00100000:0.0:1787119521.248119:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633621888:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 195us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.248125:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5333 00000100:00100000:1.0:1787119521.251257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.251388:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633622016 00000100:00100000:2.0:1787119521.251399:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633622016 00010000:00010000:2.0:1787119521.251472:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 35 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.251511:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5401 00000100:00100000:2.0:1787119521.251521:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2375:x1873929633622016:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.251537:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119521.251560:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 35 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.251586:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 35 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.251613:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e3ee7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716580 expref: 35 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.251630:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 41) 00010000:00010000:2.0:1787119521.251635:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 41) 00010000:00010000:2.0:1787119521.251646:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.251657:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.251697:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.251713:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 16 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.251728:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653625216:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.251821:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:2.0:1787119521.254496:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653625216:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119521.254525:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119521.254581:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633622016:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3060us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.254591:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5401 00000100:00100000:3.0:1787119521.259862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.260102:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633622144 00000100:00100000:2.0:1787119521.260114:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633622144 00002000:00100000:2.0:1787119521.260175:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63eb2b100 x1873929633622144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.260187:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b100 with x1873929633622144 ext(217088->253951) 00010000:00010000:2.0:1787119521.260198:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.260243:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.260252:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2b100 00000100:00100000:2.0:1787119521.260279:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1241 00000100:00100000:2.0:1787119521.260289:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633622144:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.265160:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633622144:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4862us (5297us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119521.265184:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1241 00002000:00100000:2.0:1787119521.265203:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63eb2b100 x1873929633622144/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.265230:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b100 with x1873929633622144 ext(217088->253951) 00010000:00010000:2.0:1787119521.265242:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.265282:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.265299:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2b100 00000100:00100000:1.0:1787119521.268338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.268553:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633622272 00000100:00100000:3.0:1787119521.268566:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633622272 00000100:00100000:3.0:1787119521.268630:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5334 00000100:00100000:3.0:1787119521.268641:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633622272:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.268663:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.268684:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716595 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.268716:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 41) 00010000:00010000:3.0:1787119521.268724:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.268732:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(229 41) 00010000:00010000:3.0:1787119521.268737:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.268779:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.268796:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.268809:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa600, rc 0) 00000100:00100000:3.0:1787119521.268880:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633622272:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 241us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.268897:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5334 00000100:00100000:1.0:1787119521.273798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.273906:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633622400 00000100:00100000:0.0:1787119521.273919:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633622400 00010000:00010000:0.0:1787119521.273963:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.274010:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5402 00000100:00100000:0.0:1787119521.274030:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633622400:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.274049:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.274075:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.274101:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.274132:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3eee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716587 expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.274149:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 41) 00010000:00010000:0.0:1787119521.274153:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 41) 00010000:00010000:0.0:1787119521.274162:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.274172:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.274226:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 33 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.274244:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 33 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.274259:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653625472:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.274347:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.276972:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653625472:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.276998:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.277066:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633622400:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3046us (3281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.277082:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5402 00000100:00100000:2.0:1787119521.279400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.279549:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633622528 00000100:00100000:1.0:1787119521.279559:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633622528 00010000:00010000:1.0:1787119521.279598:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 34 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.279642:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5403 00000100:00100000:1.0:1787119521.279652:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633622528:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119521.279667:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119521.279690:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 34 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.279715:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 34 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.279740:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e3ef5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471658e expref: 34 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.279759:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 41) 00010000:00010000:1.0:1787119521.279764:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 41) 00010000:00010000:1.0:1787119521.279772:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.279782:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.279819:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.279833:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511632a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653625600:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119521.279933:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066746c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.282922:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511632a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653625600:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.282950:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.283018:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633622528:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3365us (3628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.283038:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5403 00000100:00100000:3.0:1787119521.295699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.295832:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633622656 00000100:00100000:0.0:1787119521.295843:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633622656 00000100:00100000:0.0:1787119521.295918:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5335 00000100:00100000:0.0:1787119521.295929:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633622656:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.295949:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.295972:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471659c expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.296009:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.296019:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 41) 00010000:00010000:0.0:1787119521.296054:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 41) 00010000:00010000:0.0:1787119521.296060:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.296096:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.296130:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 16 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.296144:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653625728:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119521.296240:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.297618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.298096:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633622784 00000100:00100000:0.0:1787119521.298105:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633622784 00002000:00100000:0.0:1787119521.298155:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a511630a80 x1873929633622784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.298167:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630a80 with x1873929633622784 ext(217088->253951) 00010000:00010000:0.0:1787119521.298178:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 17 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.298221:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 17 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.298230:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511630a80 00000100:00100000:0.0:1787119521.298263:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1242 00000100:00100000:0.0:1787119521.298272:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633622784:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119521.306597:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653625728:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119521.306643:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.306680:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:3.0:1787119521.306735:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633622656:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10808us (11047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.306745:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5335 00000100:00100000:0.0:1787119521.307410:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633622784:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 9135us (9795us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119521.307421:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1242 00002000:00100000:0.0:1787119521.307432:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a511630a80 x1873929633622784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.307493:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630a80 with x1873929633622784 ext(217088->253951) 00010000:00010000:0.0:1787119521.307511:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 17 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.307576:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 17 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.307585:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511630a80 00000100:00100000:2.0:1787119521.311636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.311784:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633622912 00000100:00100000:0.0:1787119521.311795:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633622912 00000100:00100000:0.0:1787119521.311855:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5336 00000100:00100000:0.0:1787119521.311865:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633622912:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.311896:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.311916:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165a3 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.311948:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 41) 00010000:00010000:0.0:1787119521.311957:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.311964:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 41) 00010000:00010000:0.0:1787119521.311970:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.312028:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.312046:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.312060:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119521.312123:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633622912:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 259us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.312130:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5336 00000100:00100000:3.0:1787119521.313160:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.313876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633623040 00000100:00100000:0.0:1787119521.313897:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633623040 00010000:00010000:0.0:1787119521.313940:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 18 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.313987:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5404 00000100:00100000:0.0:1787119521.313997:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633623040:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.314012:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.314049:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 18 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.314076:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 18 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.314104:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e3efc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716595 expref: 18 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.314127:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 41) 00010000:00010000:0.0:1787119521.314132:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 41) 00010000:00010000:0.0:1787119521.314141:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.314151:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.314190:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.314217:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 33 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.314233:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653625984:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.314521:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.320950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.321048:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633623168 00000100:00100000:2.0:1787119521.321058:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633623168 00002000:00100000:2.0:1787119521.321102:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63eb28a80 x1873929633623168/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.321115:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633623168 ext(217088->221183) 00010000:00010000:2.0:1787119521.321124:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.321152:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.321160:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28a80 00000100:00100000:2.0:1787119521.321189:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1243 00000100:00100000:2.0:1787119521.321197:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633623168:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.321531:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633623168:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 333us (875us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119521.321540:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1243 00002000:00100000:2.0:1787119521.321546:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63eb28a80 x1873929633623168/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.321556:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633623168 ext(217088->221183) 00010000:00010000:2.0:1787119521.321561:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.321576:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.321590:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28a80 00000100:00100000:2.0:1787119521.325095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.325234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.325428:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653625984:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.325480:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.325534:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633623040:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11538us (12381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.325546:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5404 00000100:00100000:0.0:1787119521.325579:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633623424 00000100:00100000:0.0:1787119521.325585:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633623424 00010000:00010000:0.0:1787119521.325616:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.325654:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5405 00000100:00100000:0.0:1787119521.325677:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633623424:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.325691:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.325717:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.325744:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.325771:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e3f03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471659c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.325790:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 41) 00010000:00010000:0.0:1787119521.325795:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 41) 00010000:00010000:0.0:1787119521.325804:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.325816:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.325852:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.325872:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653626112:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.325930:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.336435:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633623296 00000100:00100000:0.0:1787119521.336644:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653626112:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.336684:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.336746:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2375:x1873929633623424:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11082us (11512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.336757:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5405 00000100:00100000:3.0:1787119521.340905:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633623296 00000100:00100000:3.0:1787119521.340987:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5337 00000100:00100000:3.0:1787119521.340998:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633623296:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.341017:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.341048:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165aa expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.341084:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.341094:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 41) 00010000:00010000:3.0:1787119521.341098:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 41) 00010000:00010000:3.0:1787119521.341103:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.341137:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.341164:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 16 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.341179:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653626240:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119521.341494:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.344487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.344611:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633623552 00000100:00100000:0.0:1787119521.344621:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633623552 00010000:00010000:0.0:1787119521.344657:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.344699:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5406 00000100:00100000:0.0:1787119521.344709:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633623552:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.344724:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.344748:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.344775:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.344805:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 41) 00010000:00010000:0.0:1787119521.344811:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 41) 00010000:00010000:0.0:1787119521.344821:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.344832:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.344870:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.344897:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653626368:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.344992:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787119521.345870:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e3f0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165a3 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.345901:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653626240:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119521.345926:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.345943:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb600, rc 0) 00000100:00100000:3.0:1787119521.346048:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633623296:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5052us (20964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.346057:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5337 00000100:00100000:2.0:1787119521.353725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.355345:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633623680 00000100:00100000:3.0:1787119521.355359:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633623680 00000100:00100000:3.0:1787119521.355422:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5338 00000100:00100000:3.0:1787119521.355432:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633623680:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.355466:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.355485:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165b1 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.355519:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.355529:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 41) 00010000:00010000:3.0:1787119521.355534:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 41) 00010000:00010000:3.0:1787119521.355539:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.355575:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.355601:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 33 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.355617:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653626496:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119521.355899:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653626368:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.355918:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119521.355984:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.357504:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633623552:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12786us (13017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.357519:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5406 00000100:00100000:2.0:1787119521.361510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.362017:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633623808 00000100:00100000:0.0:1787119521.362038:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633623808 00010000:00010000:0.0:1787119521.362079:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.362128:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5407 00000100:00100000:0.0:1787119521.362139:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620708450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633623808:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.362157:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.362181:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.362221:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.362251:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 41) 00010000:00010000:0.0:1787119521.362257:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 41) 00010000:00010000:0.0:1787119521.362267:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.362278:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.362318:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.362333:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653626624:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.362421:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787119521.365076:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165aa expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.365103:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653626496:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119521.365137:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.365153:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fbe00, rc 0) 00000100:00100000:0.0:1787119521.365674:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653626624:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.365689:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.365781:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620708450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2375:x1873929633623808:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3642us (4280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.365792:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5407 00000100:00100000:2.0:1787119521.367377:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633623680:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11936us (13652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.367405:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5338 00000100:00100000:2.0:1787119521.377984:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.378094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.378427:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633624064 00000100:00100000:0.0:1787119521.378457:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633624064 00002000:00100000:0.0:1787119521.378512:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63414d500 x1873929633624064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.378524:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d500 with x1873929633624064 ext(217088->253951) 00002000:00010000:0.0:1787119521.378532:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414d500 00000100:00100000:0.0:1787119521.378570:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10651 00000100:00100000:0.0:1787119521.378581:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633624064:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119521.379517:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633623936 00000100:00100000:3.0:1787119521.379524:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633623936 00000100:00100000:3.0:1787119521.379556:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5339 00000100:00100000:3.0:1787119521.379563:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633623936:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.379575:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.379593:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165b8 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.379623:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.379634:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 41) 00010000:00010000:3.0:1787119521.379639:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(236 41) 00010000:00010000:3.0:1787119521.379645:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.379679:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.379703:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.379719:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653626752:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119521.379783:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.383525:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653626752:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119521.383572:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.383598:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fba00, rc 0) 00000100:00100000:3.0:1787119521.383651:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633623936:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4088us (5678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.383660:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5339 00000100:00100000:0.0:1787119521.391588:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633624064:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 12994us (13482us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119521.391604:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10651 00002000:00100000:0.0:1787119521.391619:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63414d500 x1873929633624064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.391630:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d500 with x1873929633624064 ext(217088->253951) 00010000:00010000:0.0:1787119521.391640:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.391670:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.391678:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414d500 00000100:00100000:3.0:1787119521.396375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.396535:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633624192 00000100:00100000:2.0:1787119521.396547:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633624192 00000100:00100000:2.0:1787119521.396607:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5340 00000100:00100000:2.0:1787119521.396616:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633624192:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.396635:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.396657:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165bf expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.396690:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(236 41) 00010000:00010000:2.0:1787119521.396699:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.396706:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 41) 00010000:00010000:2.0:1787119521.396712:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.396764:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.396780:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.396792:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119521.396856:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633624192:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 241us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.396864:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5340 00000100:00100000:1.0:1787119521.399081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.399179:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633624320 00000100:00100000:0.0:1787119521.399190:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633624320 00010000:00010000:0.0:1787119521.399242:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.399286:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5408 00000100:00100000:0.0:1787119521.399297:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633624320:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.399313:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.399339:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.399365:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.399389:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b1 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.399405:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 41) 00010000:00010000:0.0:1787119521.399410:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 41) 00010000:00010000:0.0:1787119521.399429:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.399492:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.399531:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.399546:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 33 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.399566:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653627008:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.399640:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.402676:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653627008:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.402702:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.402762:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633624320:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3464us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.402774:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5408 00000100:00100000:2.0:1787119521.405698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.405796:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633624448 00000100:00100000:1.0:1787119521.405806:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633624448 00002000:00100000:1.0:1787119521.405854:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63414d180 x1873929633624448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.405865:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d180 with x1873929633624448 ext(217088->221183) 00010000:00010000:1.0:1787119521.405875:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.405916:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119521.405925:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414d180 00000100:00100000:1.0:1787119521.405963:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1244 00000100:00100000:1.0:1787119521.405974:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633624448:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119521.406337:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633624448:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 365us (647us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119521.406345:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1244 00002000:00100000:1.0:1787119521.406352:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63414d180 x1873929633624448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.406360:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d180 with x1873929633624448 ext(217088->221183) 00010000:00010000:1.0:1787119521.406366:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.406380:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119521.406387:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63414d180 00000100:00100000:1.0:1787119521.410905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.410991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.411276:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633624576 00000100:00100000:3.0:1787119521.411290:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633624576 00000100:00100000:3.0:1787119521.411352:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5341 00000100:00100000:3.0:1787119521.411361:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633624576:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.411380:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.411399:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165c6 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.411715:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633624704 00000100:00100000:0.0:1787119521.411720:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633624704 00010000:00010000:0.0:1787119521.411743:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 36 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.411779:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5409 00000100:00100000:0.0:1787119521.411787:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2375:x1873929633624704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.411798:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.411820:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 36 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.411845:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 36 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.411869:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165b8 expref: 36 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.411900:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 41) 00010000:00010000:0.0:1787119521.411905:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 41) 00010000:00010000:0.0:1787119521.411914:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.411924:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.411961:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.412161:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653627136:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.412267:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787119521.414831:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.414848:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 41) 00010000:00010000:1.0:1787119521.414853:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 41) 00010000:00010000:1.0:1787119521.414859:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 35 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.414908:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.414935:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 16 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.414953:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653627264:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119521.415200:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.415360:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653627136:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.415380:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.415406:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2375:x1873929633624704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3620us (4414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.415415:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5409 00000100:00100000:2.0:1787119521.418736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.418800:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633624832 00000100:00100000:0.0:1787119521.418810:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633624832 00010000:00010000:0.0:1787119521.418850:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 17 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.418913:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5410 00000100:00100000:0.0:1787119521.418924:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633624832:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.418940:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.418963:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 17 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.419001:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 17 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.419038:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 41) 00010000:00010000:0.0:1787119521.419043:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 41) 00010000:00010000:0.0:1787119521.419051:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.419062:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.419100:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.419115:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653627392:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.419399:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787119521.419568:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165bf expref: 17 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.419583:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653627264:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119521.419609:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.419618:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb600, rc 0) 00000100:00100000:1.0:1787119521.419650:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633624576:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8290us (8767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.419661:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5341 00000100:00100000:2.0:1787119521.426834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.426917:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633624960 00000100:00100000:3.0:1787119521.426926:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633624960 00000100:00100000:3.0:1787119521.426986:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5342 00000100:00100000:3.0:1787119521.426997:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633624960:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.427016:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.427046:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165cd expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.427078:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.427088:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 41) 00010000:00010000:3.0:1787119521.427092:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 41) 00010000:00010000:3.0:1787119521.427098:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 18 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.427130:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.427156:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 33 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.427171:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653627520:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119521.427458:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.430426:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653627392:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.430483:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.430767:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633624832:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11842us (12041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.430782:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5410 00000100:00100000:2.0:1787119521.431101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.432182:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633625088 00000100:00100000:0.0:1787119521.432194:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633625088 00010000:00010000:0.0:1787119521.432253:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.432298:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5411 00000100:00100000:0.0:1787119521.432308:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633625088:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.432323:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.432348:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.432375:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.432402:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 41) 00010000:00010000:0.0:1787119521.432408:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 41) 00010000:00010000:0.0:1787119521.432418:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.432428:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.432493:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.432514:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653627648:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.432598:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462e40 going to sleep for 11 seconds 00010000:00010000:3.0:1787119521.435543:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165c6 expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.435570:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653627520:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119521.435601:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.435617:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038faa00, rc 0) 00000100:00100000:3.0:1787119521.435690:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633624960:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8694us (8864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.435700:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5342 00000100:00100000:0.0:1787119521.436501:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653627648:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.436520:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.436568:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2375:x1873929633625088:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4260us (5467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.436577:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5411 00000100:00100000:2.0:1787119521.440054:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.441305:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633625216 00000100:00100000:3.0:1787119521.441318:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633625216 00000100:00100000:3.0:1787119521.441386:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5343 00000100:00100000:3.0:1787119521.441396:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633625216:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.441542:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.441565:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165d4 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.441598:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.441608:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 41) 00010000:00010000:3.0:1787119521.441613:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(241 41) 00010000:00010000:3.0:1787119521.441618:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.441653:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.441678:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 16 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.441693:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653627776:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119521.441781:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119521.443157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.443308:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633625344 00000100:00100000:0.0:1787119521.443319:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633625344 00002000:00100000:0.0:1787119521.443364:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a634038a80 x1873929633625344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.443376:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038a80 with x1873929633625344 ext(217088->253951) 00010000:00010000:0.0:1787119521.443386:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.443427:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.443436:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634038a80 00000100:00100000:0.0:1787119521.443491:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1245 00000100:00100000:0.0:1787119521.443501:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633625344:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119521.450838:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633625344:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7326us (7675us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119521.450855:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1245 00002000:00100000:0.0:1787119521.450868:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a634038a80 x1873929633625344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.450879:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038a80 with x1873929633625344 ext(217088->253951) 00010000:00010000:0.0:1787119521.450898:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.450927:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.450934:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634038a80 00000100:00100000:3.0:1787119521.451734:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653627776:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119521.451764:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.451784:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fba00, rc 0) 00000100:00100000:2.0:1787119521.451898:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633625216:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10502us (11853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.451905:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5343 00000100:00100000:2.0:1787119521.454643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.454736:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633625472 00000100:00100000:3.0:1787119521.454747:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633625472 00000100:00100000:3.0:1787119521.454805:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5344 00000100:00100000:3.0:1787119521.454816:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633625472:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.454836:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.454856:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165db expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.454900:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(241 41) 00010000:00010000:3.0:1787119521.454909:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.454917:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 41) 00010000:00010000:3.0:1787119521.454922:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.454964:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.454978:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.454991:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fbe00, rc 0) 00000100:00100000:3.0:1787119521.455052:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633625472:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 238us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.455059:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5344 00000100:00100000:1.0:1787119521.457678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.457764:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633625600 00000100:00100000:0.0:1787119521.457774:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633625600 00010000:00010000:0.0:1787119521.457811:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.457852:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5412 00000100:00100000:0.0:1787119521.457860:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633625600:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.457874:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.457904:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.457932:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.457966:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e3f34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165cd expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.457989:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 41) 00010000:00010000:0.0:1787119521.457993:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 41) 00010000:00010000:0.0:1787119521.458002:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.458013:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.458060:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.458075:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 33 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.458089:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653628032:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.458179:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.461200:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653628032:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.461240:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.461301:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633625600:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3440us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.461315:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5412 00000100:00100000:0.0:1787119521.464227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.464375:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633625728 00000100:00100000:2.0:1787119521.464387:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633625728 00002000:00100000:2.0:1787119521.464435:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a5098a7b80 x1873929633625728/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.464487:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7b80 with x1873929633625728 ext(217088->221183) 00010000:00010000:2.0:1787119521.464497:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.464527:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.464535:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a7b80 00000100:00100000:2.0:1787119521.464571:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1246 00000100:00100000:2.0:1787119521.464581:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633625728:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.464785:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633625728:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 205us (566us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119521.464793:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1246 00002000:00100000:2.0:1787119521.464798:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a5098a7b80 x1873929633625728/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.464807:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7b80 with x1873929633625728 ext(217088->221183) 00010000:00010000:2.0:1787119521.464812:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.464826:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.464833:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a7b80 00000100:00100000:1.0:1787119521.468475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.468519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.468603:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633625984 00000100:00100000:2.0:1787119521.468612:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633625984 00010000:00010000:2.0:1787119521.468648:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.468689:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5413 00000100:00100000:2.0:1787119521.468697:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633625984:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.468712:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119521.468732:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.468755:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.468779:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e3f3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165d4 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.468796:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 41) 00010000:00010000:2.0:1787119521.468800:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 41) 00010000:00010000:2.0:1787119521.468809:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.468820:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.468854:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.468868:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653628160:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.469053:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066900 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.469308:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633625856 00000100:00100000:0.0:1787119521.469313:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633625856 00000100:00100000:0.0:1787119521.469353:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5345 00000100:00100000:0.0:1787119521.469360:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633625856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.469374:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.469388:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165e2 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.469408:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.469414:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 41) 00010000:00010000:0.0:1787119521.469418:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 41) 00010000:00010000:0.0:1787119521.469422:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 35 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.469467:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 16 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.469485:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 16 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.469496:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653628288:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119521.469533:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.473120:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653628288:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119521.473160:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 35 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.473184:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38c00, rc 0) 00000100:00100000:1.0:1787119521.473298:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633625856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3936us (4858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.473307:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5345 00000100:00100000:2.0:1787119521.476686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.476779:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633626112 00000100:00100000:1.0:1787119521.476789:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633626112 00010000:00010000:1.0:1787119521.476831:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 17 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.476876:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5414 00000100:00100000:1.0:1787119521.476887:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633626112:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119521.477059:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119521.477083:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 17 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.477110:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 17 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.477139:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 41) 00010000:00010000:1.0:1787119521.477144:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 41) 00010000:00010000:1.0:1787119521.477153:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.477164:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.477272:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.477292:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653628416:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119521.477370:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a606674540 going to sleep for 11 seconds 00010000:00010000:0.0:1787119521.477616:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3f42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165db expref: 17 pid: 6696 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.477633:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653628160:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.477654:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.477680:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633625984:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8983us (9160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.477689:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5413 00000100:00100000:1.0:1787119521.481262:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653628416:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119521.481290:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.481383:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633626112:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4497us (4706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.481395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5414 00000100:00100000:2.0:1787119521.485043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.485125:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633626240 00000100:00100000:3.0:1787119521.485135:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633626240 00000100:00100000:3.0:1787119521.485194:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5346 00000100:00100000:3.0:1787119521.485274:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633626240:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.485293:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.485312:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165e9 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.485346:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.485356:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 41) 00010000:00010000:3.0:1787119521.485360:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(245 41) 00010000:00010000:3.0:1787119521.485366:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.485400:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.485738:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 33 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.485755:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653628544:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119521.486030:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119521.489261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.489395:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653628544:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119521.489476:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.489500:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb600, rc 0) 00000100:00100000:0.0:1787119521.489555:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633626240:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4352us (4523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.489565:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5346 00000100:00100000:1.0:1787119521.491274:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633626368 00000100:00100000:1.0:1787119521.491289:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633626368 00010000:00010000:1.0:1787119521.491756:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.491808:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5415 00000100:00100000:1.0:1787119521.491821:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633626368:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119521.491837:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119521.491861:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.491899:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.491929:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3f49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e2 expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.491949:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(245 41) 00010000:00010000:1.0:1787119521.491954:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(245 41) 00010000:00010000:1.0:1787119521.491963:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.493045:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.493114:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.493132:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653628672:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119521.493404:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066746c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.499582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.502710:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633626496 00000100:00100000:2.0:1787119521.502728:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633626496 00000100:00100000:2.0:1787119521.502822:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5347 00000100:00100000:2.0:1787119521.502833:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633626496:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.502858:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.502883:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165f0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.502929:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.502941:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(245 41) 00010000:00010000:2.0:1787119521.502945:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 41) 00010000:00010000:2.0:1787119521.502951:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 35 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.502998:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.503073:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 16 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.503091:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653628800:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119521.503203:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066540 going to sleep for 11 seconds 00000100:00100000:2.0:1787119521.510790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.510939:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653628800:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119521.510977:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 35 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.511002:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:0.0:1787119521.511080:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633626496:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8247us (11507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.511090:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5347 00000100:00100000:3.0:1787119521.514076:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633626624 00000100:00100000:3.0:1787119521.514094:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633626624 00002000:00100000:3.0:1787119521.514150:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63403a300 x1873929633626624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119521.514162:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a300 with x1873929633626624 ext(217088->253951) 00010000:00010000:3.0:1787119521.514171:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.514199:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119521.514576:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403a300 00000100:00100000:1.0:1787119521.516042:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653628672:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119521.516075:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.516153:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633626368:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 24335us (26903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.516165:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5415 00000100:00100000:2.0:1787119521.521525:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1247 00000100:00100000:2.0:1787119521.521553:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633626624:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119521.524522:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633626624:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2971us (13731us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119521.524536:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1247 00002000:00100000:1.0:1787119521.524550:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63403a300 x1873929633626624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.524561:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403a300 with x1873929633626624 ext(217088->253951) 00010000:00010000:1.0:1787119521.524572:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.524603:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119521.524611:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403a300 00000100:00100000:3.0:1787119521.526956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.527070:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633626752 00000100:00100000:2.0:1787119521.527081:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633626752 00000100:00100000:2.0:1787119521.527143:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5348 00000100:00100000:2.0:1787119521.527152:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633626752:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.527168:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.527188:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165f7 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.527230:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 41) 00010000:00010000:2.0:1787119521.527239:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.527247:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 41) 00010000:00010000:2.0:1787119521.527252:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.527296:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.527311:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 18 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.527323:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119521.527379:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633626752:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 228us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.527387:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5348 00000100:00100000:2.0:1787119521.529545:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.529683:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633626880 00000100:00100000:3.0:1787119521.529692:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633626880 00010000:00010000:3.0:1787119521.529732:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.529775:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5416 00000100:00100000:3.0:1787119521.529784:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633626880:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119521.529797:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119521.529819:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.529845:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.529871:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e3f50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165e9 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.529899:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 41) 00010000:00010000:3.0:1787119521.529904:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 41) 00010000:00010000:3.0:1787119521.529912:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.529929:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.529968:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.529984:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 33 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.529998:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb29f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653629056:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119521.530097:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.533615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.533718:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633627008 00000100:00100000:0.0:1787119521.533729:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633627008 00002000:00100000:0.0:1787119521.533779:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63eb2b800 x1873929633627008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.533791:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633627008 ext(217088->221183) 00010000:00010000:0.0:1787119521.533800:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.533829:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.533838:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2b800 00000100:00100000:0.0:1787119521.533871:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1248 00000100:00100000:0.0:1787119521.533891:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633627008:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119521.534114:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633627008:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 233us (506us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119521.534122:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1248 00002000:00100000:0.0:1787119521.534129:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63eb2b800 x1873929633627008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.534137:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633627008 ext(217088->221183) 00010000:00010000:0.0:1787119521.534143:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.534162:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.534170:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2b800 00000100:00100000:2.0:1787119521.534285:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb29f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653629056:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119521.534308:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119521.534343:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633626880:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4559us (4808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.534350:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5416 00000100:00100000:0.0:1787119521.541939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.542818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.543156:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633627136 00000100:00100000:1.0:1787119521.543167:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633627136 00000100:00100000:1.0:1787119521.543232:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5349 00000100:00100000:1.0:1787119521.543242:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633627136:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119521.543261:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119521.543281:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047165fe expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.543318:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 41) 00010000:00010000:1.0:1787119521.543326:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.543334:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(249 41) 00010000:00010000:1.0:1787119521.543339:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 35 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.543380:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.543395:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 35 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.543408:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119521.543496:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633627136:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 254us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.543503:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5349 00000100:00100000:0.0:1787119521.543671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633627264 00000100:00100000:0.0:1787119521.543676:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633627264 00010000:00010000:0.0:1787119521.543699:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 35 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.543734:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5417 00000100:00100000:0.0:1787119521.543741:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2375:x1873929633627264:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.543750:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.543772:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 35 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.543798:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 35 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.543818:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f0 expref: 35 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.543832:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 41) 00010000:00010000:0.0:1787119521.543836:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 41) 00010000:00010000:0.0:1787119521.543844:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.543853:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.543879:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 16 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.543909:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 16 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.543923:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653629312:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.543987:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5064620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.547226:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653629312:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119521.547254:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.547316:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633627264:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3575us (4501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.547327:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5417 00000100:00100000:3.0:1787119521.549176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.549868:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633627392 00000100:00100000:1.0:1787119521.549888:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633627392 00010000:00010000:1.0:1787119521.549932:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 17 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.549972:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5418 00000100:00100000:1.0:1787119521.549987:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2374:x1873929633627392:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119521.550002:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119521.550035:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 17 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.550060:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 17 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.550083:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3f5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165f7 expref: 17 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.550100:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 41) 00010000:00010000:1.0:1787119521.550104:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 41) 00010000:00010000:1.0:1787119521.550112:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.550121:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.550157:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.550176:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653629440:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119521.550390:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066746c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.553143:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653629440:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119521.553169:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.553227:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2374:x1873929633627392:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3240us (4059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.553237:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5418 00000100:00100000:0.0:1787119521.563193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.563309:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633627520 00000100:00100000:2.0:1787119521.563320:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633627520 00000100:00100000:2.0:1787119521.563380:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5350 00000100:00100000:2.0:1787119521.563391:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633627520:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.563416:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.563436:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716605 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.563516:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.563525:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 41) 00010000:00010000:2.0:1787119521.563530:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(251 41) 00010000:00010000:2.0:1787119521.563536:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.563569:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.563595:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 33 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.563612:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653629568:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119521.563700:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.566783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.566921:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633627648 00000100:00100000:0.0:1787119521.566930:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633627648 00002000:00100000:0.0:1787119521.566980:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63eb2a300 x1873929633627648/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.566992:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a300 with x1873929633627648 ext(217088->221183) 00010000:00010000:0.0:1787119521.567001:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.567042:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.567056:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2a300 00000100:00100000:0.0:1787119521.567092:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1249 00000100:00100000:0.0:1787119521.567102:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633627648:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119521.567322:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633627648:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 220us (549us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119521.567329:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1249 00002000:00100000:0.0:1787119521.567336:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a63eb2a300 x1873929633627648/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.567344:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a300 with x1873929633627648 ext(217088->221183) 00010000:00010000:0.0:1787119521.567350:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.567364:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.567371:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2a300 00000100:00100000:2.0:1787119521.568326:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653629568:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119521.568359:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.568380:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119521.568429:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633627520:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5040us (5246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.568459:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5350 00000100:00100000:3.0:1787119521.578778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.578873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.579041:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633627904 00000100:00100000:2.0:1787119521.579050:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633627904 00010000:00010000:2.0:1787119521.579088:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 34 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.579188:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633627776 00000100:00100000:0.0:1787119521.579192:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633627776 00000100:00100000:0.0:1787119521.579237:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5351 00000100:00100000:0.0:1787119521.579247:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633627776:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.579262:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.579279:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471660c expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.579312:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(251 41) 00010000:00010000:0.0:1787119521.579319:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.579326:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 41) 00010000:00010000:0.0:1787119521.579331:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.579371:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.579386:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.579398:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38600, rc 0) 00000100:00100000:0.0:1787119521.579479:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+36:33957:x1873929633627776:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 233us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.579486:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5351 00000100:00100000:2.0:1787119521.579945:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5419 00000100:00100000:2.0:1787119521.579959:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2375:x1873929633627904:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.579972:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119521.579999:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 35 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.580041:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 35 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.580071:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e3f65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047165fe expref: 35 pid: 6693 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.580087:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 41) 00010000:00010000:2.0:1787119521.580091:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 41) 00010000:00010000:2.0:1787119521.580103:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.580113:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.580147:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.580163:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 16 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.580176:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653629824:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.580237:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066540 going to sleep for 11 seconds 00000100:00100000:2.0:1787119521.583797:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653629824:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119521.583826:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119521.583883:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633627904:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3929us (5009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.583894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5419 00000100:00100000:3.0:1787119521.587384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.588798:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633628032 00000100:00100000:2.0:1787119521.588811:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633628032 00002000:00100000:2.0:1787119521.588865:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63eb2b480 x1873929633628032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.588876:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b480 with x1873929633628032 ext(217088->253951) 00010000:00010000:2.0:1787119521.588887:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.588916:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.588931:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2b480 00000100:00100000:2.0:1787119521.588971:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1250 00000100:00100000:2.0:1787119521.589052:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633628032:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.597223:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633628032:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 8163us (9838us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119521.597238:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1250 00002000:00100000:2.0:1787119521.597251:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a63eb2b480 x1873929633628032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.597263:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b480 with x1873929633628032 ext(217088->253951) 00010000:00010000:2.0:1787119521.597274:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.597306:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 17 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.597314:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2b480 00000100:00100000:3.0:1787119521.601038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.601147:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633628160 00000100:00100000:0.0:1787119521.601159:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633628160 00000100:00100000:0.0:1787119521.601223:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5352 00000100:00100000:0.0:1787119521.601233:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633628160:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.601253:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.601275:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716613 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.601318:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 41) 00010000:00010000:0.0:1787119521.601327:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.601335:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(254 41) 00010000:00010000:0.0:1787119521.601340:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.601382:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.601398:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.601411:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39200, rc 0) 00000100:00100000:0.0:1787119521.601520:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633628160:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 288us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.601528:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5352 00000100:00100000:0.0:1787119521.606657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.606813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633628288 00000100:00100000:1.0:1787119521.606823:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633628288 00010000:00010000:1.0:1787119521.606861:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.606990:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5420 00000100:00100000:1.0:1787119521.607001:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633628288:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119521.607049:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119521.607073:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.607099:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.607125:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3f6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716605 expref: 18 pid: 20841 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.607148:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 41) 00010000:00010000:1.0:1787119521.607152:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 41) 00010000:00010000:1.0:1787119521.607161:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.607171:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.607208:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.607223:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 33 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.607236:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653630080:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119521.607317:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066746c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.614837:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653630080:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119521.614865:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.614926:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633628288:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7926us (8277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.614936:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5420 00000100:00100000:0.0:1787119521.626545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.626740:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633628416 00000100:00100000:1.0:1787119521.626750:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633628416 00010000:00010000:1.0:1787119521.626793:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.626844:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5421 00000100:00100000:1.0:1787119521.626854:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2373:x1873929633628416:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119521.626869:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119521.626904:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.626933:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.626960:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e3f73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471660c expref: 34 pid: 12469 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.626977:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 41) 00010000:00010000:1.0:1787119521.626982:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 41) 00010000:00010000:1.0:1787119521.626990:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.627001:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.627054:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 16 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.627075:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653630208:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119521.627153:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6066746c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.631657:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653630208:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119521.631684:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.631740:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2373:x1873929633628416:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4887us (5206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.631751:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5421 00000100:00100000:0.0:1787119521.660099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.660150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.660233:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633628672 00000100:00100000:3.0:1787119521.660244:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633628672 00002000:00100000:3.0:1787119521.660295:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a5098a4e00 x1873929633628672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119521.660307:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633628672 ext(217088->253951) 00002000:00010000:3.0:1787119521.660313:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:3.0:1787119521.660346:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10652 00000100:00100000:3.0:1787119521.660357:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633628672:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.661481:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633628544 00000100:00100000:2.0:1787119521.661491:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633628544 00000100:00100000:2.0:1787119521.661538:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5353 00000100:00100000:2.0:1787119521.661546:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633628544:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.661559:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.661578:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471661a expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.661611:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.661621:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 41) 00010000:00010000:2.0:1787119521.661626:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 41) 00010000:00010000:2.0:1787119521.661631:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.661666:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.661692:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.661705:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653630336:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119521.661778:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119521.664399:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633628672:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4035us (4239us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119521.664412:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10652 00002000:00100000:3.0:1787119521.664424:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->253951) req@ffff92a5098a4e00 x1873929633628672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119521.664435:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633628672 ext(217088->253951) 00010000:00010000:3.0:1787119521.664480:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.664520:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119521.664528:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4e00 00000100:00100000:1.0:1787119521.672768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.672808:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.673040:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653630336:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119521.673075:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.673099:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:2.0:1787119521.673163:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633628544:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11618us (13077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.673177:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5353 00000100:00100000:2.0:1787119521.673208:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633628928 00000100:00100000:2.0:1787119521.673214:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633628928 00000100:00100000:2.0:1787119521.673252:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5354 00000100:00100000:2.0:1787119521.673260:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633628928:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.673275:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.673292:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716621 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.673316:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 41) 00010000:00010000:2.0:1787119521.673324:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.673331:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 41) 00010000:00010000:2.0:1787119521.673336:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.673369:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.673381:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 18 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.673390:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119521.673411:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633628928:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 152us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.673417:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5354 00000100:00100000:3.0:1787119521.673580:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633628800 00000100:00100000:3.0:1787119521.673585:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633628800 00010000:00010000:3.0:1787119521.673606:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.673640:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5422 00000100:00100000:3.0:1787119521.673648:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633628800:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119521.673657:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119521.673677:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.673701:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.673722:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e3f7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716613 expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.673736:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(258 41) 00010000:00010000:3.0:1787119521.673740:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(258 41) 00010000:00010000:3.0:1787119521.673746:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.673755:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.673778:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.673792:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 33 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.673805:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653630592:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119521.673853:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.683912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.683953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.683986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.684011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.684045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.684066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.684165:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653630592:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119521.684192:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119521.684252:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633628800:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10603us (11494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.684263:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5422 00000100:00100000:3.0:1787119521.684302:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633629440 00000100:00100000:3.0:1787119521.684309:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633629440 00000100:00080000:3.0:1787119521.684336:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119521.684365:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633629696 00000100:00100000:3.0:1787119521.684368:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633629696 00000100:00080000:3.0:1787119521.684381:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119521.684405:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 596 00000100:00100000:3.0:1787119521.684415:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633629440:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119521.684475:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633629440:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 61us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.684482:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 596 00000100:00100000:3.0:1787119521.684493:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 597 00000100:00100000:3.0:1787119521.684499:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633629696:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119521.684537:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633629696:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 37us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.684544:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 597 00000100:00100000:0.0:1787119521.684872:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633629056 00000100:00100000:0.0:1787119521.684888:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633629056 00002000:00100000:0.0:1787119521.684921:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a511632a00 x1873929633629056/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.684932:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633629056 ext(217088->221183) 00010000:00010000:0.0:1787119521.684940:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.684967:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.684974:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511632a00 00000100:00100000:0.0:1787119521.684998:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1251 00000100:00100000:0.0:1787119521.685005:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633629056:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119521.685164:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633629056:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 159us (1261us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119521.685171:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1251 00002000:00100000:0.0:1787119521.685177:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a511632a00 x1873929633629056/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.685185:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633629056 ext(217088->221183) 00010000:00010000:0.0:1787119521.685190:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.685203:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.685210:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511632a00 00000100:00100000:0.0:1787119521.685231:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633629312 00000100:00100000:0.0:1787119521.685235:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633629312 00000100:00100000:0.0:1787119521.685264:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633629568 00000100:00100000:0.0:1787119521.685266:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633629568 00000100:00100000:0.0:1787119521.685283:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 701 00000100:00100000:0.0:1787119521.685289:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633629312:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119521.685314:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633629312:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.685320:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 701 00000100:00100000:0.0:1787119521.685331:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 702 00000100:00100000:0.0:1787119521.685337:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+17:2375:x1873929633629568:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119521.685362:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+17:2375:x1873929633629568:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.685368:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 702 00000100:00080000:0.0:1787119521.685392:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119521.685632:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633629184 00000100:00100000:2.0:1787119521.685638:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633629184 00000100:00100000:2.0:1787119521.685673:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 524 00000100:00100000:2.0:1787119521.685680:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633629184:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119521.685707:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633629184:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 27us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.685713:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 524 00000100:00100000:1.0:1787119521.690586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.690631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.690806:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633629824 00000100:00100000:2.0:1787119521.690817:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633629824 00000100:00100000:2.0:1787119521.690885:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5355 00000100:00100000:2.0:1787119521.690896:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633629824:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.690913:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.690933:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716628 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.690964:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(258 41) 00010000:00010000:2.0:1787119521.690972:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.690979:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 41) 00010000:00010000:2.0:1787119521.690984:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 35 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.691037:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.691054:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 35 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.691067:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119521.691128:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633629824:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 233us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.691135:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5355 00000100:00100000:0.0:1787119521.694396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633629952 00000100:00100000:0.0:1787119521.694412:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633629952 00010000:00010000:0.0:1787119521.694488:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 35 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.694547:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5423 00000100:00100000:0.0:1787119521.694557:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2373:x1873929633629952:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.694575:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.694627:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 35 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.694659:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 35 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.694686:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471661a expref: 35 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.694703:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 41) 00010000:00010000:0.0:1787119521.694709:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 41) 00010000:00010000:0.0:1787119521.694718:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.694728:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.694765:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 16 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.694780:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 16 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.694794:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653630848:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.694872:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.706172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.706426:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653630848:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.706485:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.706546:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2373:x1873929633629952:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11989us (15913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.706558:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5423 00000100:00100000:0.0:1787119521.706588:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633630080 00000100:00100000:0.0:1787119521.706595:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633630080 00010000:00010000:0.0:1787119521.706622:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 17 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.706660:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5424 00000100:00100000:0.0:1787119521.706669:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633630080:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.706681:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.706703:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 17 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.706726:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 17 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.706750:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e3f88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716621 expref: 17 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.706766:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 41) 00010000:00010000:0.0:1787119521.706771:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 41) 00010000:00010000:0.0:1787119521.706779:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.706794:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.706830:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.706843:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653630976:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.707148:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462600 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.717422:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653630976:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.717495:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.717550:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633630080:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10880us (11388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.717563:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5424 00000100:00100000:1.0:1787119521.720700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.720789:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633630208 00000100:00100000:0.0:1787119521.720799:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633630208 00000100:00100000:0.0:1787119521.720860:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5356 00000100:00100000:0.0:1787119521.720870:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:33946:x1873929633630208:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.720887:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.720908:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471662f expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.720943:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.720960:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 41) 00010000:00010000:0.0:1787119521.720965:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 41) 00010000:00010000:0.0:1787119521.720970:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.721006:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.721044:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 33 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.721058:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653631104:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119521.721137:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.735098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.738120:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633630336 00000100:00100000:0.0:1787119521.738137:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633630336 00002000:00100000:0.0:1787119521.738199:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a511631c00 x1873929633630336/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.738212:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631c00 with x1873929633630336 ext(217088->221183) 00010000:00010000:0.0:1787119521.738221:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.738253:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.738268:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511631c00 00000100:00100000:0.0:1787119521.738315:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1252 00000100:00100000:0.0:1787119521.738324:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633630336:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119521.738566:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633630336:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 241us (3481us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119521.738574:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1252 00002000:00100000:0.0:1787119521.738581:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a511631c00 x1873929633630336/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.738590:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631c00 with x1873929633630336 ext(217088->221183) 00010000:00010000:0.0:1787119521.738596:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.738610:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.738618:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511631c00 00010000:00010000:2.0:1787119521.762043:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119521.762328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.762547:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653631104:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119521.762584:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633630464 00010000:00010000:0.0:1787119521.762587:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 17 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.762594:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633630464 00010000:00010000:0.0:1787119521.762614:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39c00, rc 0) 00002000:00100000:3.0:1787119521.762643:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a509231180 x1873929633630464/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119521.762654:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633630464 ext(221184->225279) 00010000:00010000:3.0:1787119521.762664:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.762699:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119521.762708:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231180 00000100:00100000:0.0:1787119521.762736:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633630208:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 41865us (42041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.762747:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5356 00000100:00100000:3.0:1787119521.762752:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1253 00000100:00100000:3.0:1787119521.762764:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633630464:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119521.781689:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633630464:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 18915us (19362us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119521.781705:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1253 00002000:00100000:3.0:1787119521.781719:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a509231180 x1873929633630464/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119521.781730:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633630464 ext(221184->225279) 00010000:00010000:3.0:1787119521.781741:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.781789:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119521.781797:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231180 00000100:00100000:1.0:1787119521.782147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.782189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.782286:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633630592 00000100:00100000:2.0:1787119521.782294:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633630592 00002000:00100000:2.0:1787119521.782342:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509230380 x1873929633630592/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 4584/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.782351:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230380 with x1873929633630592 ext(217088->221183) 00010000:00010000:2.0:1787119521.782357:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.782372:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 34 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.782379:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230380 00000100:00100000:2.0:1787119521.782402:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1254 00000100:00100000:2.0:1787119521.782411:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633630592:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119521.782982:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2375:x1873929633630592:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 570us (833us total) trans 4294969240 rc 0/0 00000100:00100000:2.0:1787119521.782990:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1254 00002000:00100000:2.0:1787119521.782997:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509230380 x1873929633630592/t4294969240(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 4584/448 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.783006:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230380 with x1873929633630592 ext(217088->221183) 00010000:00010000:2.0:1787119521.783023:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 36 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.783042:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 36 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.783049:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230380 00000100:00100000:3.0:1787119521.786050:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633630720 00000100:00100000:3.0:1787119521.786071:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633630720 00000100:00100000:2.0:1787119521.786348:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5357 00000100:00100000:2.0:1787119521.786359:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+36:33957:x1873929633630720:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.786379:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.786399:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716636 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.786472:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 41) 00010000:00010000:2.0:1787119521.786479:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(262 41) 00010000:00010000:2.0:1787119521.786485:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.786500:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.786520:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:2.0:1787119521.786602:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+37:33957:x1873929633630720:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 244us (4411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119521.786610:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5357 00000100:00100000:1.0:1787119521.786811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.786878:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633630848 00000100:00100000:3.0:1787119521.786883:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633630848 00010000:00010000:3.0:1787119521.786910:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 37 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.786945:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5425 00000100:00100000:3.0:1787119521.786953:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2373:x1873929633630848:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119521.786963:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787119521.786980:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119519 -> 1787119520 00002000:00010000:3.0:1787119521.786982:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119519 -> 1787119520 00010000:00010000:3.0:1787119521.786988:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 37 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.787025:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 37 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.787095:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3f8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716628 expref: 37 pid: 6695 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.787110:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(262 41) 00010000:00010000:3.0:1787119521.787114:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(262 41) 00010000:00010000:3.0:1787119521.787125:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.787136:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.787146:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(262 41) 00010000:00010000:3.0:1787119521.787149:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(262 41) 00010000:00010000:3.0:1787119521.787154:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.787163:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.787200:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.787216:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653631232:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119521.787310:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 16 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.787321:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653631360:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119521.787345:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.792903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.793170:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653631232:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119521.793184:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653631360:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119521.793208:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119521.793269:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2373:x1873929633630848:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6316us (6458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119521.793280:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5425 00000100:00100000:2.0:1787119521.793485:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633630976 00000100:00100000:2.0:1787119521.793496:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633630976 00002000:00100000:2.0:1787119521.793543:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509233480 x1873929633630976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.793554:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233480 with x1873929633630976 ext(217088->221183) 00002000:00010000:2.0:1787119521.793559:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233480 00000100:00100000:2.0:1787119521.793587:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10653 00000100:00100000:2.0:1787119521.793596:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633630976:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.793776:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633630976:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 180us (883us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119521.793783:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10653 00002000:00100000:2.0:1787119521.793789:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a509233480 x1873929633630976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.793798:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233480 with x1873929633630976 ext(217088->221183) 00002000:00010000:2.0:1787119521.793801:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233480 00000100:00100000:1.0:1787119521.806661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.806713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.806820:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633631104 00000100:00100000:0.0:1787119521.806830:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633631104 00000100:00100000:0.0:1787119521.806893:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5358 00000100:00100000:0.0:1787119521.806903:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:33946:x1873929633631104:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.806922:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.806941:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471663d expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.806977:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.806987:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(262 41) 00010000:00010000:0.0:1787119521.806992:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(263 41) 00010000:00010000:0.0:1787119521.806997:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.807049:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.807075:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 35 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.807091:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653631488:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119521.807189:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462600 going to sleep for 11 seconds 00000100:00100000:2.0:1787119521.809914:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633631232 00000100:00100000:2.0:1787119521.809930:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633631232 00002000:00100000:2.0:1787119521.809989:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a508da6d80 x1873929633631232/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.810007:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6d80 with x1873929633631232 ext(221184->225279) 00010000:00010000:2.0:1787119521.810044:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.810078:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.810087:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6d80 00000100:00100000:2.0:1787119521.810123:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1255 00000100:00100000:2.0:1787119521.810132:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633631232:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.810338:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633631232:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 206us (3624us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119521.810345:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1255 00002000:00100000:2.0:1787119521.810351:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a508da6d80 x1873929633631232/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.810359:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6d80 with x1873929633631232 ext(221184->225279) 00010000:00010000:2.0:1787119521.810364:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.810377:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.810383:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6d80 00000100:00100000:0.0:1787119521.819251:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653631488:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119521.819290:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.819314:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119521.819380:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633631104:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 12477us (12730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.819389:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5358 00000100:00100000:1.0:1787119521.823023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.826390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.839774:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633631360 00000100:00100000:2.0:1787119521.840890:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633631360 00002000:00100000:2.0:1787119521.840956:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (225280->229375) req@ffff92a508da5c00 x1873929633631360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.840970:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5c00 with x1873929633631360 ext(225280->229375) 00010000:00010000:2.0:1787119521.840980:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.841023:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 36 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.841032:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5c00 00000100:00100000:2.0:1787119521.841073:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633631488 00000100:00100000:2.0:1787119521.841077:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633631488 00002000:00100000:2.0:1787119521.841096:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a508da6680 x1873929633631488/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 4584/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787119521.841106:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1256 00002000:00100000:2.0:1787119521.841111:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6680 with x1873929633631488 ext(221184->225279) 00010000:00010000:2.0:1787119521.841118:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 37 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.841125:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2373:x1873929633631360:12345-192.168.201.59@tcp:3:kworker.0 00010000:00010000:2.0:1787119521.841141:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 37 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.841149:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6680 00000100:00100000:2.0:1787119521.841220:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1257 00000100:00100000:2.0:1787119521.841230:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2374:x1873929633631488:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119521.841372:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2373:x1873929633631360:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 253us (18370us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119521.841380:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1256 00002000:00100000:3.0:1787119521.841389:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (225280->229375) req@ffff92a508da5c00 x1873929633631360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119521.841399:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5c00 with x1873929633631360 ext(225280->229375) 00010000:00010000:3.0:1787119521.841406:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 37 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.841435:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 37 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119521.841462:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5c00 00000100:00100000:2.0:1787119521.844200:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2374:x1873929633631488:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 2961us (17808us total) trans 4294969241 rc 0/0 00000100:00100000:2.0:1787119521.844214:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1257 00002000:00100000:2.0:1787119521.844224:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a508da6680 x1873929633631488/t4294969241(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 4584/448 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.844235:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6680 with x1873929633631488 ext(221184->225279) 00010000:00010000:2.0:1787119521.844244:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 38 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.844274:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 38 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.844282:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6680 00000100:00100000:1.0:1787119521.862796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.862900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.863151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633631744 00000100:00100000:0.0:1787119521.863161:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633631744 00010000:00010000:0.0:1787119521.863206:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 38 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.863258:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5426 00000100:00100000:0.0:1787119521.863269:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2374:x1873929633631744:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119521.863285:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119521.863310:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 38 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.863337:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 38 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.863365:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e3f9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716636 expref: 38 pid: 8267 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.863383:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(263 41) 00010000:00010000:0.0:1787119521.863390:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(263 41) 00010000:00010000:0.0:1787119521.863399:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.863410:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.863514:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119521.863530:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653631616:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.863633:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462600 going to sleep for 11 seconds 00000100:00100000:2.0:1787119521.863701:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633631616 00000100:00100000:2.0:1787119521.863707:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633631616 00000100:00100000:2.0:1787119521.863749:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5359 00000100:00100000:2.0:1787119521.863759:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633631616:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119521.863773:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119521.863788:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716644 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.863809:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.863816:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(263 41) 00010000:00010000:2.0:1787119521.863820:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 41) 00010000:00010000:2.0:1787119521.863825:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.863847:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 17 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.863863:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 17 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.863874:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653631744:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119521.863900:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.871915:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653631616:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.871945:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.872067:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2374:x1873929633631744:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8799us (9165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.872079:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5426 00000100:00100000:2.0:1787119521.878555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.879036:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633631872 00000100:00100000:1.0:1787119521.879047:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633631872 00002000:00100000:1.0:1787119521.879101:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (221184->258047) req@ffff92a63403b800 x1873929633631872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.879113:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633631872 ext(221184->258047) 00010000:00010000:1.0:1787119521.879123:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.879154:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119521.879162:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b800 00000100:00100000:1.0:1787119521.879200:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1258 00000100:00100000:1.0:1787119521.879210:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633631872:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119521.884556:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653631744:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119521.884598:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 38 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.884623:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:0.0:1787119521.884766:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633631616:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 21008us (21979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.884776:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5359 00000100:00100000:2.0:1787119521.892783:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633631872:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 13558us (14222us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119521.892811:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1258 00002000:00100000:2.0:1787119521.892826:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (221184->258047) req@ffff92a63403b800 x1873929633631872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/440 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.892837:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633631872 ext(221184->258047) 00010000:00010000:2.0:1787119521.892849:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.893019:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119521.893034:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b800 00000100:00100000:2.0:1787119521.898226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.898379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119521.898491:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633632128 00000100:00100000:1.0:1787119521.898502:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633632128 00010000:00010000:1.0:1787119521.898546:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.898596:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5427 00000100:00100000:1.0:1787119521.898606:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633632128:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119521.898623:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119521.898648:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.898675:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.898702:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e3fa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->18446744073709551615] (req 221184->225279) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471663d expref: 18 pid: 20843 timeout: 1147 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.898721:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 41) 00010000:00010000:1.0:1787119521.898725:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 41) 00010000:00010000:1.0:1787119521.898733:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.898743:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.898780:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119521.898796:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653631872:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119521.898898:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6088b6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.899378:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633632000 00000100:00100000:0.0:1787119521.899385:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633632000 00000100:00100000:0.0:1787119521.899452:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5360 00000100:00100000:0.0:1787119521.899462:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633632000:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.899477:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.899491:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471664b expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.899511:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 41) 00010000:00010000:0.0:1787119521.899516:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 41) 00010000:00010000:0.0:1787119521.899524:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471664b expref: 19 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.899539:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471664b expref: 19 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.899561:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38c00, rc 0) 00000100:00100000:0.0:1787119521.899610:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633632000:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 149us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.899617:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5360 00000100:00100000:1.0:1787119521.902583:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653631872:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119521.902612:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119521.902672:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633632128:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4066us (4292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.902685:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5427 00000100:00100000:2.0:1787119521.916835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.916929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.916964:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633632256 00000100:00100000:0.0:1787119521.916977:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633632256 00002000:00100000:0.0:1787119521.917045:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (225280->229375) req@ffff92a634039f80 x1873929633632256/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.917057:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039f80 with x1873929633632256 ext(225280->229375) 00002000:00010000:0.0:1787119521.917064:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039f80 00000100:00100000:0.0:1787119521.917099:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633632384 00000100:00100000:0.0:1787119521.917104:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633632384 00002000:00100000:0.0:1787119521.917124:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a634039c00 x1873929633632384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.917132:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039c00 with x1873929633632384 ext(221184->225279) 00002000:00010000:0.0:1787119521.917136:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039c00 00000100:00100000:0.0:1787119521.917268:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10654 00000100:00100000:0.0:1787119521.917279:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2373:x1873929633632256:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119521.917663:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10655 00000100:00100000:1.0:1787119521.917675:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633632384:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119521.917956:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633632384:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 283us (1026us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119521.917965:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10655 00002000:00100000:1.0:1787119521.917973:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a634039c00 x1873929633632384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.917981:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039c00 with x1873929633632384 ext(221184->225279) 00002000:00010000:1.0:1787119521.917985:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039c00 00000100:00100000:0.0:1787119521.918733:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2373:x1873929633632256:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1453us (1908us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119521.918744:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10654 00002000:00100000:0.0:1787119521.918764:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (225280->229375) req@ffff92a634039f80 x1873929633632256/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.918772:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039f80 with x1873929633632256 ext(225280->229375) 00002000:00010000:0.0:1787119521.918776:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634039f80 00000100:00100000:3.0:1787119521.925531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.925775:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633632512 00000100:00100000:2.0:1787119521.925797:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633632512 00002000:00100000:2.0:1787119521.925851:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff92a63eb2a680 x1873929633632512/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.925865:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a680 with x1873929633632512 ext(229376->233471) 00002000:00010000:2.0:1787119521.925871:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2a680 00000100:00100000:2.0:1787119521.925980:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10656 00000100:00100000:2.0:1787119521.925991:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2374:x1873929633632512:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.926586:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2374:x1873929633632512:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 594us (1064us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119521.926595:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10656 00002000:00100000:2.0:1787119521.926602:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff92a63eb2a680 x1873929633632512/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.926613:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a680 with x1873929633632512 ext(229376->233471) 00002000:00010000:2.0:1787119521.926617:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2a680 00000100:00100000:2.0:1787119521.930072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119521.930661:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633632640 00000100:00100000:3.0:1787119521.930674:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633632640 00000100:00100000:3.0:1787119521.930739:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5361 00000100:00100000:3.0:1787119521.930749:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:33946:x1873929633632640:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119521.930769:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119521.930798:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716652 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.930832:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.930846:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(264 41) 00010000:00010000:3.0:1787119521.930851:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 264) 00010000:00010000:3.0:1787119521.930856:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.930900:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119521.930936:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 37 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119521.930952:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653632000:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119521.935581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.936583:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119521.936673:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633632768 00000100:00100000:1.0:1787119521.936685:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633632768 00002000:00100000:1.0:1787119521.936744:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff92a5098a6d80 x1873929633632768/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.936757:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633632768 ext(233472->237567) 00010000:00010000:1.0:1787119521.936766:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 38 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.938976:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 38 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119521.939002:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a6d80 00000100:00100000:1.0:1787119521.939062:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1259 00000100:00100000:1.0:1787119521.939082:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2373:x1873929633632768:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119521.939607:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2373:x1873929633632768:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 534us (4037us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119521.939616:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1259 00002000:00100000:1.0:1787119521.939626:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff92a5098a6d80 x1873929633632768/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.939635:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633632768 ext(233472->237567) 00010000:00010000:1.0:1787119521.939644:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 38 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.939661:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 38 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119521.939668:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a6d80 00000100:00100000:3.0:1787119521.944134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.944485:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633632896 00000100:00100000:0.0:1787119521.944495:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633632896 00002000:00100000:0.0:1787119521.944547:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (225280->233471) req@ffff92a63eb29c00 x1873929633632896/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 8680/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.944559:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29c00 with x1873929633632896 ext(225280->233471) 00010000:00010000:0.0:1787119521.944568:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 38 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.944603:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 38 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.944613:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb29c00 00000100:00100000:0.0:1787119521.944640:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1260 00000100:00100000:0.0:1787119521.944649:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633632896:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119521.945278:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653632000:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119521.945308:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119521.945467:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fbe00, rc 0) 00000100:00100000:1.0:1787119521.945534:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633632640:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 14785us (15758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119521.945544:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5361 00000100:00100000:0.0:1787119521.947628:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633632896:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 2968us (3491us total) trans 4294969242 rc 0/0 00000100:00100000:0.0:1787119521.947644:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1260 00002000:00100000:0.0:1787119521.947658:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (225280->233471) req@ffff92a63eb29c00 x1873929633632896/t4294969242(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 8680/448 e 0 to 0 dl 1787119532 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.947670:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29c00 with x1873929633632896 ext(225280->233471) 00010000:00010000:0.0:1787119521.947680:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 40 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.947710:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 40 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119521.947718:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb29c00 00000100:00100000:1.0:1787119521.956063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.956290:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633633024 00000100:00100000:0.0:1787119521.956302:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633633024 00000100:00100000:3.0:1787119521.957135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.957631:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5362 00000100:00100000:0.0:1787119521.957645:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+40:33957:x1873929633633024:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119521.957666:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119521.957686:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716659 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.957720:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 264) 00010000:00010000:0.0:1787119521.957725:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 264) 00010000:00010000:0.0:1787119521.957730:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.957745:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119521.957760:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38800, rc 0) 00000100:00100000:0.0:1787119521.957907:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633633024:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 265us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.957915:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5362 00000100:00100000:2.0:1787119521.958518:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633633152 00000100:00100000:2.0:1787119521.958526:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633633152 00010000:00010000:2.0:1787119521.958556:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 41 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.958592:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5428 00000100:00100000:2.0:1787119521.958601:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2374:x1873929633633152:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119521.958612:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119521.958634:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 41 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.958660:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 41 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.958683:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e3fab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [225280->18446744073709551615] (req 225280->229375) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716644 expref: 41 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.958699:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 264) 00010000:00010000:2.0:1787119521.958703:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 264) 00010000:00010000:2.0:1787119521.958711:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.958721:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.958729:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 264) 00010000:00010000:2.0:1787119521.958732:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 264) 00010000:00010000:2.0:1787119521.958737:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.958745:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119521.958779:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.958808:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653632128:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119521.959111:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 18 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119521.959123:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653632256:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119521.959152:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119521.968525:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653632128:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119521.968545:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653632256:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119521.968571:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119521.968642:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2374:x1873929633633152:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10040us (11509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119521.968654:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5428 00000100:00100000:3.0:1787119521.973260:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.973815:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633633280 00000100:00100000:0.0:1787119521.973826:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633633280 00002000:00100000:0.0:1787119521.973872:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (225280->233471) req@ffff92a63eb28380 x1873929633633280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.973891:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633633280 ext(225280->233471) 00002000:00010000:0.0:1787119521.973897:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28380 00000100:00100000:1.0:1787119521.974083:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10657 00000100:00100000:1.0:1787119521.974095:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633633280:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119521.974343:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2374:x1873929633633280:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 249us (1092us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1787119521.974351:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10657 00002000:00100000:1.0:1787119521.974358:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (225280->233471) req@ffff92a63eb28380 x1873929633633280/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:557/0 lens 488/8632 e 0 to 0 dl 1787119532 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119521.974367:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633633280 ext(225280->233471) 00002000:00010000:1.0:1787119521.974370:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb28380 00000100:00100000:2.0:1787119521.981548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119521.982193:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633633408 00000100:00100000:0.0:1787119521.982207:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633633408 00002000:00100000:0.0:1787119521.982267:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff92a5066dd180 x1873929633633408/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119521.982279:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633633408 ext(233472->237567) 00002000:00010000:0.0:1787119521.982287:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:2.0:1787119521.982493:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10658 00000100:00100000:2.0:1787119521.982506:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633633408:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.983578:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633633408:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1069us (2035us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119521.983589:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10658 00002000:00100000:2.0:1787119521.983598:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff92a5066dd180 x1873929633633408/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.984402:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633633408 ext(233472->237567) 00002000:00010000:2.0:1787119521.984409:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:3.0:1787119521.994098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119521.994487:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633633536 00000100:00100000:2.0:1787119521.994498:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633633536 00002000:00100000:2.0:1787119521.994552:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff92a63eb29f80 x1873929633633536/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/0 e 0 to 0 dl 1787119532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.994565:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633633536 ext(237568->241663) 00002000:00010000:2.0:1787119521.994572:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29f80 00000100:00100000:2.0:1787119521.994753:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10659 00000100:00100000:2.0:1787119521.994765:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633633536:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119521.996252:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633633536:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1481us (2156us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119521.996264:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10659 00002000:00100000:2.0:1787119521.996275:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff92a63eb29f80 x1873929633633536/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787119532 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119521.996285:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633633536 ext(237568->241663) 00002000:00010000:2.0:1787119521.996291:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29f80 00000100:00100000:1.0:1787119522.003212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.004273:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633633664 00000100:00100000:0.0:1787119522.004288:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633633664 00000100:00100000:0.0:1787119522.005613:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5363 00000100:00100000:0.0:1787119522.005629:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:33946:x1873929633633664:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.005648:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.005669:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716660 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.005704:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 39 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.005715:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 264) 00010000:00010000:0.0:1787119522.005719:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 264) 00010000:00010000:0.0:1787119522.005725:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.005758:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 39 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.005796:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 39 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.005813:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653632384:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119522.005906:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462540 going to sleep for 11 seconds 00000100:00080000:3.0:1787119522.007610:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119522.007990:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.008109:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633633792 00000100:00100000:0.0:1787119522.008118:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633633792 00002000:00100000:0.0:1787119522.008349:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (241664->245759) req@ffff92a5066ded80 x1873929633633792/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.008362:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633633792 ext(241664->245759) 00010000:00010000:0.0:1787119522.008372:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.008400:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119522.008408:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066ded80 00000100:00100000:0.0:1787119522.008471:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1261 00000100:00100000:0.0:1787119522.008481:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2374:x1873929633633792:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119522.008952:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2374:x1873929633633792:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 471us (966us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119522.008960:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1261 00002000:00100000:0.0:1787119522.008967:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (241664->245759) req@ffff92a5066ded80 x1873929633633792/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.008977:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633633792 ext(241664->245759) 00010000:00010000:0.0:1787119522.008983:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.008999:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119522.009017:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066ded80 00000100:00080000:3.0:1787119522.010545:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119522.012084:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653632384:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119522.012123:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 20 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.012167:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38a00, rc 0) 00000100:00100000:0.0:1787119522.012240:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633633664:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6614us (9040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.012251:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5363 00000100:00100000:1.0:1787119522.014243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.014569:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633633920 00000100:00100000:0.0:1787119522.014584:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633633920 00002000:00100000:0.0:1787119522.014707:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a508da6300 x1873929633633920/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.014719:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6300 with x1873929633633920 ext(245760->249855) 00010000:00010000:0.0:1787119522.014728:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.014764:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119522.014772:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6300 00000100:00100000:0.0:1787119522.014817:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1262 00000100:00100000:0.0:1787119522.014827:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633633920:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119522.015487:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633633920:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 657us (1249us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119522.015495:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1262 00002000:00100000:0.0:1787119522.015503:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a508da6300 x1873929633633920/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.015511:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6300 with x1873929633633920 ext(245760->249855) 00010000:00010000:0.0:1787119522.015518:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.015536:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 40 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119522.015545:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6300 00000100:00100000:3.0:1787119522.022099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.022181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.022265:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633634176 00000100:00100000:0.0:1787119522.022275:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633634176 00000100:00100000:0.0:1787119522.022408:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5364 00000100:00100000:0.0:1787119522.022419:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+40:33957:x1873929633634176:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.022466:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.022488:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716667 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.022523:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 264) 00010000:00010000:0.0:1787119522.022529:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 264) 00010000:00010000:0.0:1787119522.022535:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.022550:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.022564:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:2.0:1787119522.023146:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633634048 00000100:00100000:2.0:1787119522.023155:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633634048 00002000:00100000:2.0:1787119522.023199:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (233472->245759) req@ffff92a63eb2ad80 x1873929633634048/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 12776/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.023210:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633634048 ext(233472->245759) 00010000:00010000:2.0:1787119522.023219:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 42 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.023264:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 42 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.023273:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2ad80 00000100:00100000:2.0:1787119522.023307:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1263 00000100:00100000:2.0:1787119522.023697:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633634048:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119522.024134:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633634176:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1715us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.024143:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5364 00000100:00100000:2.0:1787119522.028026:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2376:x1873929633634048:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 4688us (5904us total) trans 4294969243 rc 0/0 00000100:00100000:2.0:1787119522.028041:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1263 00002000:00100000:2.0:1787119522.028056:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (233472->245759) req@ffff92a63eb2ad80 x1873929633634048/t4294969243(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 12776/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.028066:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633634048 ext(233472->245759) 00010000:00010000:2.0:1787119522.028078:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 43 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.028114:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 43 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.028123:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2ad80 00000100:00100000:1.0:1787119522.031857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.032161:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633634304 00000100:00100000:0.0:1787119522.032172:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633634304 00010000:00010000:0.0:1787119522.032226:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 43 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.032275:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5429 00000100:00100000:0.0:1787119522.032285:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633634304:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119522.032302:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119522.032327:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 43 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.032358:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 43 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.032385:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716659 expref: 43 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.032409:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 264) 00010000:00010000:0.0:1787119522.032414:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 264) 00010000:00010000:0.0:1787119522.032423:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.032433:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.032504:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 264) 00010000:00010000:0.0:1787119522.032508:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 264) 00010000:00010000:0.0:1787119522.032514:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.032524:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.032566:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.032589:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653632512:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.033850:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.033883:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653632640:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119522.033912:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506462540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.040776:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653632512:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.040860:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653632640:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.041059:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.041124:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633634304:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8839us (9278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.041215:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5429 00000100:00100000:1.0:1787119522.041988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.042058:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633634432 00000100:00100000:0.0:1787119522.042067:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633634432 00002000:00100000:0.0:1787119522.042116:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (233472->245759) req@ffff92a519d26a00 x1873929633634432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.042127:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26a00 with x1873929633634432 ext(233472->245759) 00002000:00010000:0.0:1787119522.042132:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d26a00 00000100:00100000:0.0:1787119522.042162:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10660 00000100:00100000:0.0:1787119522.042172:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633634432:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119522.043509:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2376:x1873929633634432:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1328us (1512us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1787119522.043525:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10660 00002000:00100000:0.0:1787119522.043537:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (233472->245759) req@ffff92a519d26a00 x1873929633634432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/12728 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.043547:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26a00 with x1873929633634432 ext(233472->245759) 00002000:00010000:0.0:1787119522.043553:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d26a00 00000100:00100000:1.0:1787119522.050774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.051037:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633634560 00000100:00100000:2.0:1787119522.051049:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633634560 00000100:00100000:2.0:1787119522.051150:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5365 00000100:00100000:2.0:1787119522.051162:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:33946:x1873929633634560:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.051185:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.051221:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471666e expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.051259:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.051270:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 264) 00010000:00010000:2.0:1787119522.051276:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 264) 00010000:00010000:2.0:1787119522.051281:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.051321:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.051352:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 41 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.051371:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653632768:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.051496:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.051620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.052171:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633634688 00000100:00100000:2.0:1787119522.052177:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633634688 00002000:00100000:2.0:1787119522.052214:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a519d27100 x1873929633634688/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.052225:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27100 with x1873929633634688 ext(245760->249855) 00010000:00010000:2.0:1787119522.052234:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 42 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.052256:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 42 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.052264:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d27100 00000100:00100000:2.0:1787119522.052296:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1264 00000100:00100000:2.0:1787119522.052304:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633634688:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.052536:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633634688:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 231us (914us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119522.052543:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1264 00002000:00100000:2.0:1787119522.052550:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a519d27100 x1873929633634688/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.052559:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27100 with x1873929633634688 ext(245760->249855) 00010000:00010000:2.0:1787119522.052564:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 42 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.052579:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 42 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.052586:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d27100 00000100:00100000:2.0:1787119522.058576:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653632768:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.058630:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.058658:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119522.058728:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:33946:x1873929633634560:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7567us (7964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.058737:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5365 00000100:00100000:1.0:1787119522.062562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.062622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.063809:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633634944 00000100:00100000:3.0:1787119522.063822:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633634944 00002000:00100000:3.0:1787119522.063881:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a6358ec450 x1873929633634944/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.063894:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358ec450 with x1873929633634944 ext(245760->249855) 00010000:00010000:3.0:1787119522.063905:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 42 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.064063:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 42 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.064073:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6358ec450 00000100:00100000:3.0:1787119522.064104:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633634816 00000100:00100000:3.0:1787119522.064109:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633634816 00002000:00100000:3.0:1787119522.064127:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (249856->253951) req@ffff92a519d26300 x1873929633634816/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.064137:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26300 with x1873929633634816 ext(249856->253951) 00010000:00010000:3.0:1787119522.064142:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 43 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.064154:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 43 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.064160:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d26300 00000100:00100000:3.0:1787119522.064188:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1265 00000100:00100000:3.0:1787119522.064208:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6358ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633634944:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119522.064689:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6358ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2375:x1873929633634944:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 491us (2140us total) trans 4294969244 rc 0/0 00000100:00100000:3.0:1787119522.064698:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1265 00002000:00100000:3.0:1787119522.064705:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a6358ec450 x1873929633634944/t4294969244(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.064714:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358ec450 with x1873929633634944 ext(245760->249855) 00010000:00010000:3.0:1787119522.064720:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 45 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.064734:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 45 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.064740:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6358ec450 00000100:00100000:1.0:1787119522.065043:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1266 00000100:00100000:1.0:1787119522.065055:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2373:x1873929633634816:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.065163:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2373:x1873929633634816:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 111us (2540us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119522.065171:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1266 00002000:00100000:1.0:1787119522.065176:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (249856->253951) req@ffff92a519d26300 x1873929633634816/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.065185:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26300 with x1873929633634816 ext(249856->253951) 00010000:00010000:1.0:1787119522.065191:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 44 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.065206:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 44 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.065213:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d26300 00000100:00100000:0.0:1787119522.074410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.074622:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633635072 00000100:00100000:1.0:1787119522.074634:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633635072 00010000:00010000:1.0:1787119522.074685:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 44 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.074738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5430 00000100:00100000:1.0:1787119522.074749:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2374:x1873929633635072:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.074767:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.074942:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 44 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.074971:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 44 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.075004:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e3fce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716667 expref: 44 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.075037:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 264) 00010000:00010000:1.0:1787119522.075041:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 264) 00010000:00010000:1.0:1787119522.075051:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.075065:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.075107:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.075122:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d26680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653632896:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.075287:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6088b6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.078618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.078769:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d26680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653632896:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.078806:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.078866:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2374:x1873929633635072:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4117us (4469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.078878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5430 00000100:00100000:2.0:1787119522.079910:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633635200 00000100:00100000:2.0:1787119522.079920:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633635200 00000100:00100000:2.0:1787119522.079997:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5366 00000100:00100000:2.0:1787119522.080017:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633635200:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.080037:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.080057:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716675 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.080092:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.080103:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 264) 00010000:00010000:2.0:1787119522.080109:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 264) 00010000:00010000:2.0:1787119522.080115:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 44 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.080149:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.080175:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 20 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.080192:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653633024:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.080269:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.091971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.092147:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633635328 00000100:00100000:2.0:1787119522.092157:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633635328 00002000:00100000:2.0:1787119522.092219:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (245760->282623) req@ffff92a5098a5180 x1873929633635328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.092231:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5180 with x1873929633635328 ext(245760->282623) 00010000:00010000:2.0:1787119522.092240:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.092270:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.092278:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5180 00000100:00100000:2.0:1787119522.092310:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1267 00000100:00100000:2.0:1787119522.092321:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633635328:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.096097:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653633024:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119522.096137:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 44 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.096163:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119522.096754:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633635328:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4431us (4793us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119522.096767:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1267 00002000:00100000:2.0:1787119522.096779:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (245760->282623) req@ffff92a5098a5180 x1873929633635328/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.096802:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5180 with x1873929633635328 ext(245760->282623) 00010000:00010000:2.0:1787119522.096812:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.096839:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.096847:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5180 00000100:00100000:0.0:1787119522.097038:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+44:33957:x1873929633635200:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 17031us (18430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.097046:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5366 00000100:00100000:3.0:1787119522.111614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.111671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.112024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633635584 00000100:00100000:2.0:1787119522.112035:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633635584 00010000:00010000:2.0:1787119522.112080:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.112128:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5431 00000100:00100000:2.0:1787119522.112137:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633635584:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119522.112153:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119522.112180:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.112403:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.112434:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [245760->18446744073709551615] (req 245760->249855) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471666e expref: 21 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.112494:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 264) 00010000:00010000:2.0:1787119522.112499:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 264) 00010000:00010000:2.0:1787119522.112509:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 43 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.112519:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 43 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.112562:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 43 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.112578:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653633152:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119522.112667:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.112968:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633635456 00000100:00100000:0.0:1787119522.112984:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633635456 00000100:00100000:0.0:1787119522.113034:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5367 00000100:00100000:0.0:1787119522.113041:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:33946:x1873929633635456:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.113056:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.113070:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471667c expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.113088:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 264) 00010000:00010000:0.0:1787119522.113091:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 264) 00010000:00010000:0.0:1787119522.113109:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471667c expref: 22 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.113124:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471667c expref: 22 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.113133:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38800, rc 0) 00000100:00100000:0.0:1787119522.113179:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:33946:x1873929633635456:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 137us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.113186:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5367 00000100:00100000:0.0:1787119522.115796:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653633152:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.115827:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119522.116602:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633635584:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4458us (4923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.116617:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5431 00000100:00100000:0.0:1787119522.137177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.137215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.137615:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633635712 00000100:00100000:3.0:1787119522.137626:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633635712 00002000:00100000:3.0:1787119522.137687:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (249856->253951) req@ffff92a5098a7480 x1873929633635712/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.137700:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7480 with x1873929633635712 ext(249856->253951) 00002000:00010000:3.0:1787119522.137708:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a7480 00000100:00100000:2.0:1787119522.137708:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633635840 00000100:00100000:2.0:1787119522.137716:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633635840 00002000:00100000:2.0:1787119522.137754:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a5098a6300 x1873929633635840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.137765:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6300 with x1873929633635840 ext(245760->249855) 00002000:00010000:2.0:1787119522.137769:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6300 00000100:00100000:3.0:1787119522.137788:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10661 00000100:00100000:3.0:1787119522.137800:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2375:x1873929633635712:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.137804:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10662 00000100:00100000:2.0:1787119522.137817:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633635840:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.138046:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2374:x1873929633635840:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 231us (830us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119522.138054:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10662 00002000:00100000:2.0:1787119522.138061:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a5098a6300 x1873929633635840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.138074:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6300 with x1873929633635840 ext(245760->249855) 00002000:00010000:2.0:1787119522.138077:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6300 00000100:00100000:3.0:1787119522.138988:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2375:x1873929633635712:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1186us (1818us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119522.138999:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10661 00002000:00100000:3.0:1787119522.139021:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (249856->253951) req@ffff92a5098a7480 x1873929633635712/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.139031:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7480 with x1873929633635712 ext(249856->253951) 00002000:00010000:3.0:1787119522.139035:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a7480 00000100:00100000:0.0:1787119522.146165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.146618:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633635968 00000100:00100000:2.0:1787119522.146629:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633635968 00000100:00100000:2.0:1787119522.146696:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5368 00000100:00100000:2.0:1787119522.146708:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:33946:x1873929633635968:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.146727:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.146749:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716683 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.146786:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 43 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.146797:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 264) 00010000:00010000:2.0:1787119522.146802:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 264) 00010000:00010000:2.0:1787119522.146808:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.146846:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 43 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.146998:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 43 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.147027:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653633280:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.147164:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066900 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.152471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.153468:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633636096 00000100:00100000:2.0:1787119522.153489:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633636096 00002000:00100000:2.0:1787119522.153550:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (253952->258047) req@ffff92a5098a4a80 x1873929633636096/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.153564:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633636096 ext(253952->258047) 00010000:00010000:2.0:1787119522.153574:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 44 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.153608:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 44 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.153618:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4a80 00000100:00100000:2.0:1787119522.153655:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1268 00000100:00100000:2.0:1787119522.153666:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2375:x1873929633636096:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.154129:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2375:x1873929633636096:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 463us (1697us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119522.154138:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1268 00002000:00100000:2.0:1787119522.154146:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (253952->258047) req@ffff92a5098a4a80 x1873929633636096/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.154155:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633636096 ext(253952->258047) 00010000:00010000:2.0:1787119522.154161:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 44 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.154184:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 44 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.154191:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4a80 00000100:00100000:2.0:1787119522.159900:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653633280:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.159936:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.159959:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119522.160028:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:33946:x1873929633635968:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13322us (13876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.160038:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5368 00000100:00100000:0.0:1787119522.161881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.161958:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633636224 00000100:00100000:3.0:1787119522.161968:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633636224 00002000:00100000:3.0:1787119522.162026:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (249856->258047) req@ffff92a5098a4000 x1873929633636224/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 8680/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.162037:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4000 with x1873929633636224 ext(249856->258047) 00010000:00010000:3.0:1787119522.162046:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 44 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.162078:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 44 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.162086:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4000 00000100:00100000:3.0:1787119522.162120:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1269 00000100:00100000:3.0:1787119522.162130:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2375:x1873929633636224:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119522.162579:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633636224:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 450us (712us total) trans 4294969245 rc 0/0 00000100:00100000:3.0:1787119522.162590:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1269 00002000:00100000:3.0:1787119522.162597:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (249856->258047) req@ffff92a5098a4000 x1873929633636224/t4294969245(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 8680/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.162604:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4000 with x1873929633636224 ext(249856->258047) 00010000:00010000:3.0:1787119522.162610:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.162626:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.162633:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4000 00000100:00100000:0.0:1787119522.165536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.165692:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633636352 00000100:00100000:1.0:1787119522.165703:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633636352 00002000:00100000:1.0:1787119522.165756:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (258048->262143) req@ffff92a5098a5880 x1873929633636352/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.165767:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5880 with x1873929633636352 ext(258048->262143) 00010000:00010000:1.0:1787119522.165778:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.165807:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.165815:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5880 00000100:00100000:1.0:1787119522.165853:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1270 00000100:00100000:1.0:1787119522.165863:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2373:x1873929633636352:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.166086:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2373:x1873929633636352:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 224us (560us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119522.166094:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1270 00002000:00100000:1.0:1787119522.166101:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (258048->262143) req@ffff92a5098a5880 x1873929633636352/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.166109:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5880 with x1873929633636352 ext(258048->262143) 00010000:00010000:1.0:1787119522.166114:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.166129:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.166137:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5880 00000100:00100000:1.0:1787119522.170736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.171625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.171799:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633636608 00000100:00100000:3.0:1787119522.171811:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633636608 00010000:00010000:3.0:1787119522.171853:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.171901:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5432 00000100:00100000:3.0:1787119522.171912:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2373:x1873929633636608:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.171927:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.171952:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.171979:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.172022:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e3fdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716675 expref: 46 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.172041:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 264) 00010000:00010000:3.0:1787119522.172046:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 264) 00010000:00010000:3.0:1787119522.172054:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.172066:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.172111:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.172128:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653633408:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.172224:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119522.177015:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633636480 00000100:00100000:2.0:1787119522.177034:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633636480 00000100:00100000:2.0:1787119522.177140:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5369 00000100:00100000:2.0:1787119522.177151:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633636480:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.177171:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.177191:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471668a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.177227:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.177238:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 264) 00010000:00010000:2.0:1787119522.177244:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 264) 00010000:00010000:2.0:1787119522.177250:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.177286:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.177314:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 21 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.177330:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653633536:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.177423:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066900 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.184222:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653633408:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.184250:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.184396:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653633536:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119522.184421:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.184473:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:3.0:1787119522.185637:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+47:2373:x1873929633636608:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13717us (14005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.185653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5432 00000100:00100000:1.0:1787119522.188429:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633636480:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11266us (17691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.188465:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5369 00000100:00100000:0.0:1787119522.203057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.203151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.211711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.211794:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633636992 00000100:00100000:3.0:1787119522.211804:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633636992 00000100:00100000:3.0:1787119522.211863:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5370 00000100:00100000:3.0:1787119522.211883:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633636992:12345-192.168.201.59@tcp:16:kworker.0 00000100:00100000:3.0:1787119522.211993:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633636992:12345-192.168.201.59@tcp:16:kworker.0 Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.212002:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5370 00000100:00100000:3.0:1787119522.216680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.216739:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633636736 00000100:00100000:2.0:1787119522.216750:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633636736 00002000:00100000:2.0:1787119522.216803:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (249856->286719) req@ffff92a5098a7b80 x1873929633636736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.216815:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7b80 with x1873929633636736 ext(249856->286719) 00010000:00010000:2.0:1787119522.216824:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 22 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.216855:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 22 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.216863:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a7b80 00000100:00100000:2.0:1787119522.216903:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633636864 00000100:00100000:2.0:1787119522.216907:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633636864 00002000:00100000:2.0:1787119522.216926:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x29:0x0] (0->9) req@ffff92a5098a4e00 x1873929633636864/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 504/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119522.216934:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633636864 ext(0->9) 00002000:00010000:2.0:1787119522.216938:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:2.0:1787119522.216958:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1271 00000100:00100000:2.0:1787119522.216968:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633636736:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.217221:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10663 00000100:00100000:2.0:1787119522.217229:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633636864:12345-192.168.201.59@tcp:4:diff.0 00000100:00100000:2.0:1787119522.217606:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633636864:12345-192.168.201.59@tcp:4:diff.0 Request processed in 375us (14453us total) trans 4294969246 rc 0/0 00000100:00100000:2.0:1787119522.217615:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10663 00002000:00100000:2.0:1787119522.217623:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x29:0x0] (0->9) req@ffff92a5098a4e00 x1873929633636864/t4294969246(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 504/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 0/0 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119522.217630:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633636864 ext(0->9) 00002000:00010000:2.0:1787119522.217635:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:2.0:1787119522.224307:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633637120 00000100:00100000:2.0:1787119522.224327:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633637120 00002000:00100000:2.0:1787119522.224394:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2b:0x0] (0->94159) req@ffff92a63eb28a80 x1873929633637120/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119522.224407:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633637120 ext(0->94159) 00002000:00010000:2.0:1787119522.224413:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb28a80 00000100:00100000:2.0:1787119522.224520:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10664 00000100:00100000:2.0:1787119522.224530:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633637120:12345-192.168.201.59@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1787119522.224830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.228852:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633637248 00000100:00100000:1.0:1787119522.228879:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633637248 00000100:00100000:1.0:1787119522.228961:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5371 00000100:00100000:1.0:1787119522.228975:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633637248:12345-192.168.201.59@tcp:16:kworker.0 00000100:00100000:1.0:1787119522.229128:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633637248:12345-192.168.201.59@tcp:16:kworker.0 Request processed in 157us (4299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.229136:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5371 00000100:00100000:2.0:1787119522.231782:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633636736:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 14802us (28724us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119522.231796:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1271 00002000:00100000:2.0:1787119522.231808:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (249856->286719) req@ffff92a5098a7b80 x1873929633636736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.231821:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7b80 with x1873929633636736 ext(249856->286719) 00010000:00010000:2.0:1787119522.231831:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 24 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.231862:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 24 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.231876:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a7b80 00000100:00100000:3.0:1787119522.236709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.236749:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633637504 00000100:00100000:3.0:1787119522.236759:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633637504 00000100:00100000:3.0:1787119522.236804:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5372 00000100:00100000:3.0:1787119522.236812:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2376:x1873929633637504:12345-192.168.201.59@tcp:16:kworker.0 00000100:00100000:3.0:1787119522.236893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.239897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.239924:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633637632 00000100:00100000:3.0:1787119522.239934:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633637632 00000100:00100000:3.0:1787119522.240031:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5373 00000100:00100000:3.0:1787119522.240041:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:33946:x1873929633637632:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119522.240058:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119522.240077:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716691 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240112:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 264) 00010000:00010000:3.0:1787119522.240118:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 264) 00010000:00010000:3.0:1787119522.240125:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240140:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240156:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb000, rc 0) 00000100:00100000:3.0:1787119522.240209:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:33946:x1873929633637632:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 170us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.240217:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5373 00000100:00100000:3.0:1787119522.240256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.240279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633637760 00000100:00100000:3.0:1787119522.240282:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633637760 00010000:00010000:3.0:1787119522.240297:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 26 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.240320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5433 00000100:00100000:3.0:1787119522.240327:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2373:x1873929633637760:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.240337:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787119522.240353:0:5835:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb blocks from disk: 263 -> 519 00010000:00010000:3.0:1787119522.240360:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 26 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240385:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 26 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240408:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e3fea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716683 expref: 26 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240422:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 264) 00010000:00010000:3.0:1787119522.240426:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 264) 00010000:00010000:3.0:1787119522.240433:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240475:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240484:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 264) 00010000:00010000:3.0:1787119522.240487:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 264) 00010000:00010000:3.0:1787119522.240492:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240501:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.240534:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.240548:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653633664:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.240623:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.240633:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653633792:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.240656:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.242148:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633637376 00000100:00100000:0.0:1787119522.242161:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633637376 00002000:00100000:0.0:1787119522.242580:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (86016->249855) req@ffff92a63eb2a300 x1873929633637376/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.242593:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a300 with x1873929633637376 ext(86016->249855) 00002000:00010000:0.0:1787119522.242611:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2a300 00000100:00100000:0.0:1787119522.242647:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10665 00000100:00100000:0.0:1787119522.242656:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2376:x1873929633637376:12345-192.168.201.59@tcp:4:kworker.0 00000100:00100000:3.0:1787119522.245145:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653633664:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.245197:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653633792:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.245222:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.245272:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2373:x1873929633637760:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4944us (5013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.245284:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5433 00000100:00100000:2.0:1787119522.250165:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633637120:12345-192.168.201.59@tcp:4:mmap_sanity.0 Request processed in 25624us (33485us total) trans 4294968931 rc 0/0 00000100:00100000:2.0:1787119522.250180:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10664 00002000:00100000:2.0:1787119522.250193:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2b:0x0] (0->94159) req@ffff92a63eb28a80 x1873929633637120/t4294968931(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787119522.250203:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28a80 with x1873929633637120 ext(0->94159) 00002000:00010000:2.0:1787119522.250209:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb28a80 00000100:00100000:1.0:1787119522.260259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.260294:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633637888 00000100:00100000:1.0:1787119522.260304:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633637888 00002000:00100000:1.0:1787119522.260354:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (258048->262143) req@ffff92a519d25880 x1873929633637888/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.260366:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25880 with x1873929633637888 ext(258048->262143) 00002000:00010000:1.0:1787119522.260373:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25880 00000100:00100000:1.0:1787119522.260402:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10666 00000100:00100000:1.0:1787119522.260412:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2373:x1873929633637888:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.262119:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2373:x1873929633637888:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1700us (1861us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119522.262131:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10666 00002000:00100000:1.0:1787119522.262141:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (258048->262143) req@ffff92a519d25880 x1873929633637888/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.262151:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25880 with x1873929633637888 ext(258048->262143) 00002000:00010000:1.0:1787119522.262157:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25880 00000100:00100000:2.0:1787119522.262855:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633637376:12345-192.168.201.59@tcp:4:kworker.0 Request processed in 20196us (25958us total) trans 4294969247 rc 0/0 00000100:00100000:2.0:1787119522.262868:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10665 00002000:00100000:2.0:1787119522.262876:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (86016->249855) req@ffff92a63eb2a300 x1873929633637376/t4294969247(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 0/0 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.262884:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a300 with x1873929633637376 ext(86016->249855) 00002000:00010000:2.0:1787119522.262904:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2a300 00000100:00100000:1.0:1787119522.281233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.281284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.281913:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633638144 00000100:00100000:2.0:1787119522.281925:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633638144 00002000:00100000:2.0:1787119522.281978:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (262144->266239) req@ffff92a519d27800 x1873929633638144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.281991:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27800 with x1873929633638144 ext(262144->266239) 00002000:00010000:2.0:1787119522.281996:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27800 00000100:00100000:2.0:1787119522.282041:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633638016 00000100:00100000:2.0:1787119522.282045:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633638016 00002000:00100000:2.0:1787119522.282063:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (249856->258047) req@ffff92a519d24e00 x1873929633638016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.282072:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24e00 with x1873929633638016 ext(249856->258047) 00002000:00010000:2.0:1787119522.282076:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d24e00 00000100:00100000:2.0:1787119522.282095:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10667 00000100:00100000:2.0:1787119522.282105:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2374:x1873929633638144:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.282364:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2374:x1873929633638144:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 259us (1140us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119522.282372:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10667 00002000:00100000:2.0:1787119522.282379:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (262144->266239) req@ffff92a519d27800 x1873929633638144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.282387:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27800 with x1873929633638144 ext(262144->266239) 00002000:00010000:2.0:1787119522.282392:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d27800 00000100:00100000:2.0:1787119522.282413:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10668 00000100:00100000:2.0:1787119522.282420:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633638016:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.282540:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633638016:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 120us (1255us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119522.282547:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10668 00002000:00100000:2.0:1787119522.282552:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (249856->258047) req@ffff92a519d24e00 x1873929633638016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/8632 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.282561:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d24e00 with x1873929633638016 ext(249856->258047) 00002000:00010000:2.0:1787119522.282564:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d24e00 00000100:00100000:3.0:1787119522.289547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.289648:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633638272 00000100:00100000:0.0:1787119522.289659:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633638272 00000100:00100000:0.0:1787119522.289723:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5374 00000100:00100000:0.0:1787119522.289733:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633638272:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.289752:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.289770:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716698 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.289804:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.289814:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 264) 00010000:00010000:0.0:1787119522.289819:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 264) 00010000:00010000:0.0:1787119522.289825:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.289856:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.289893:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 45 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.289909:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653633920:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119522.289998:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.293927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.294061:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653633920:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119522.294096:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.294124:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39600, rc 0) 00000100:00100000:0.0:1787119522.294179:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633638272:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4448us (4644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.294200:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5374 00000100:00100000:3.0:1787119522.296689:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633638400 00000100:00100000:3.0:1787119522.296706:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633638400 00002000:00100000:0.0:1787119522.296879:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a5098a5f80 x1873929633638400/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.296891:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5f80 with x1873929633638400 ext(266240->270335) 00010000:00010000:0.0:1787119522.296902:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 46 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.296934:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 46 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119522.296943:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5f80 00000100:00100000:0.0:1787119522.296985:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1272 00000100:00100000:0.0:1787119522.296995:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2373:x1873929633638400:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119522.297652:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2373:x1873929633638400:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 655us (3732us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119522.297661:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1272 00002000:00100000:0.0:1787119522.297671:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a5098a5f80 x1873929633638400/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.297680:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5f80 with x1873929633638400 ext(266240->270335) 00010000:00010000:0.0:1787119522.297687:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 46 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.297707:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 46 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119522.297715:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5f80 00000001:00080000:3.0:1787119522.306778:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969242 is committed 00000001:00080000:3.0:1787119522.306839:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969246 is committed 00000001:00080000:3.0:1787119522.306848:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969243 is committed 00000001:00080000:3.0:1787119522.307020:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969245 is committed 00000100:00100000:2.0:1787119522.307508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.308614:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633638528 00000100:00100000:1.0:1787119522.308626:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633638528 00002000:00100000:1.0:1787119522.308686:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (258048->266239) req@ffff92a5066ddf80 x1873929633638528/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 8680/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.308698:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddf80 with x1873929633638528 ext(258048->266239) 00010000:00010000:1.0:1787119522.308709:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 16 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.308743:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 16 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.308758:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066ddf80 00000100:00100000:1.0:1787119522.308812:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1273 00000100:00100000:1.0:1787119522.308823:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2375:x1873929633638528:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119522.309322:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633638528:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 498us (1816us total) trans 4294969248 rc 0/0 00000100:00100000:1.0:1787119522.309331:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1273 00002000:00100000:1.0:1787119522.309339:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (258048->266239) req@ffff92a5066ddf80 x1873929633638528/t4294969248(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 8680/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.309348:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddf80 with x1873929633638528 ext(258048->266239) 00010000:00010000:1.0:1787119522.309354:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 18 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.309372:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 18 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.309380:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066ddf80 00000100:00100000:3.0:1787119522.312907:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2376:x1873929633637504:12345-192.168.201.59@tcp:16:kworker.0 Request processed in 76080us (76194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.312923:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5372 00000100:00100000:2.0:1787119522.314710:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.315274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.315420:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633638784 00000100:00100000:1.0:1787119522.315431:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633638784 00010000:00010000:1.0:1787119522.315489:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 18 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.315534:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5434 00000100:00100000:1.0:1787119522.315544:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633638784:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.315561:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.315586:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 18 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.315613:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 18 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.315642:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e3ff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471668a expref: 18 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.315665:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 264) 00010000:00010000:1.0:1787119522.315671:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 264) 00010000:00010000:1.0:1787119522.315680:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 24 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.315691:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 24 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.315733:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 24 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.315749:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653634048:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.315824:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.316736:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633638656 00000100:00100000:3.0:1787119522.316745:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633638656 00000100:00100000:3.0:1787119522.316839:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5375 00000100:00100000:3.0:1787119522.316849:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33957:x1873929633638656:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119522.316982:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119522.317013:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471669f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.317042:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 24 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.317052:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 264) 00010000:00010000:3.0:1787119522.317056:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 264) 00010000:00010000:3.0:1787119522.317061:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.317091:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 24 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.317114:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 24 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.317127:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653634176:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119522.317182:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.328564:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653634048:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.328595:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.328878:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+19:2373:x1873929633638784:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13332us (13603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.328891:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5434 00000100:00100000:0.0:1787119522.334917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.335053:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633638912 00000100:00100000:1.0:1787119522.335064:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633638912 00002000:00100000:1.0:1787119522.335123:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (258048->294911) req@ffff92a5098a6a00 x1873929633638912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.335133:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6a00 with x1873929633638912 ext(258048->294911) 00010000:00010000:1.0:1787119522.335143:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 25 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.335173:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 25 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.335182:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a6a00 00000100:00100000:1.0:1787119522.335219:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1274 00000100:00100000:1.0:1787119522.335230:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633638912:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119522.337719:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653634176:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119522.337757:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.337779:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa600, rc 0) 00000100:00100000:3.0:1787119522.337838:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33957:x1873929633638656:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 20990us (23135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.337847:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5375 00000100:00100000:1.0:1787119522.341548:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633638912:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6308us (6630us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119522.341562:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1274 00002000:00100000:1.0:1787119522.341576:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (258048->294911) req@ffff92a5098a6a00 x1873929633638912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.341587:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6a00 with x1873929633638912 ext(258048->294911) 00010000:00010000:1.0:1787119522.341599:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 25 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.341628:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 25 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.341636:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a6a00 00000100:00100000:0.0:1787119522.356767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.356824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.356955:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633639040 00000100:00100000:3.0:1787119522.356966:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633639040 00000100:00100000:3.0:1787119522.357039:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5376 00000100:00100000:3.0:1787119522.357049:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:33946:x1873929633639040:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119522.357069:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119522.357089:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166a6 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.357124:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 264) 00010000:00010000:3.0:1787119522.357130:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 264) 00010000:00010000:3.0:1787119522.357137:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.357150:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.357163:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa200, rc 0) 00000100:00100000:3.0:1787119522.357247:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:33946:x1873929633639040:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 199us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.357255:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5376 00000100:00100000:1.0:1787119522.357817:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633639168 00000100:00100000:1.0:1787119522.357824:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633639168 00010000:00010000:1.0:1787119522.357850:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 26 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.357893:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5435 00000100:00100000:1.0:1787119522.357901:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2376:x1873929633639168:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.357912:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.357937:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 26 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.357962:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 26 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.357984:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e3fff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [258048->18446744073709551615] (req 258048->262143) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716698 expref: 26 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.358000:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 264) 00010000:00010000:1.0:1787119522.358016:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 264) 00010000:00010000:1.0:1787119522.358025:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.358036:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.358045:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 264) 00010000:00010000:1.0:1787119522.358047:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 264) 00010000:00010000:1.0:1787119522.358052:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.358061:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.358095:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.358109:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653634304:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.358710:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.358724:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d27100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653634432:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.358774:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb900 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.367485:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653634304:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.367506:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d27100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653634432:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.367532:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.367596:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2376:x1873929633639168:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9694us (10770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.367608:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5435 00000100:00100000:3.0:1787119522.380635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.380739:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633639296 00000100:00100000:2.0:1787119522.380749:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633639296 00002000:00100000:2.0:1787119522.380800:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (258048->266239) req@ffff92a63eb29c00 x1873929633639296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.380811:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29c00 with x1873929633639296 ext(258048->266239) 00002000:00010000:2.0:1787119522.380817:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29c00 00000100:00100000:2.0:1787119522.380852:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10669 00000100:00100000:2.0:1787119522.380862:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2376:x1873929633639296:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.381117:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2376:x1873929633639296:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 255us (492us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119522.381124:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10669 00002000:00100000:2.0:1787119522.381132:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (258048->266239) req@ffff92a63eb29c00 x1873929633639296/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/8632 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.381140:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29c00 with x1873929633639296 ext(258048->266239) 00002000:00010000:2.0:1787119522.381144:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb29c00 00000100:00100000:2.0:1787119522.387911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.388023:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633639424 00000100:00100000:1.0:1787119522.388034:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633639424 00002000:00100000:1.0:1787119522.388114:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a5066de300 x1873929633639424/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.388125:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de300 with x1873929633639424 ext(266240->270335) 00002000:00010000:1.0:1787119522.388131:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de300 00000100:00100000:1.0:1787119522.388164:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10670 00000100:00100000:1.0:1787119522.388174:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633639424:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.388392:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633639424:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 219us (493us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119522.388401:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10670 00002000:00100000:1.0:1787119522.388408:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a5066de300 x1873929633639424/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.388416:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066de300 with x1873929633639424 ext(266240->270335) 00002000:00010000:1.0:1787119522.388418:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066de300 00000100:00100000:0.0:1787119522.392772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.392862:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633639552 00000100:00100000:3.0:1787119522.392883:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633639552 00000100:00100000:3.0:1787119522.392948:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5377 00000100:00100000:3.0:1787119522.392958:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:33946:x1873929633639552:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119522.392977:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119522.393000:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166ad expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.393047:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.393064:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 264) 00010000:00010000:3.0:1787119522.393069:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 264) 00010000:00010000:3.0:1787119522.393075:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.393113:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.393140:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 17 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.393156:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653634560:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119522.393421:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119522.405093:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.405370:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633639680 00000100:00100000:3.0:1787119522.405380:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633639680 00002000:00100000:3.0:1787119522.405431:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a5066dd880 x1873929633639680/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.405485:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd880 with x1873929633639680 ext(270336->274431) 00010000:00010000:3.0:1787119522.405495:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 18 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.405525:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 18 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.405539:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dd880 00000100:00100000:3.0:1787119522.405569:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1275 00000100:00100000:3.0:1787119522.405580:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633639680:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119522.405782:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633639680:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 203us (700us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119522.405790:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1275 00002000:00100000:3.0:1787119522.405798:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a5066dd880 x1873929633639680/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.405806:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd880 with x1873929633639680 ext(270336->274431) 00010000:00010000:3.0:1787119522.405812:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 18 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.405826:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 18 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.405833:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dd880 00000100:00100000:3.0:1787119522.414697:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653634560:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119522.414739:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.414765:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fb600, rc 0) 00000100:00100000:3.0:1787119522.414825:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:33946:x1873929633639552:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 21868us (22062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.414834:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5377 00000100:00100000:2.0:1787119522.425193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.425327:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633639808 00000100:00100000:0.0:1787119522.425338:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633639808 00000100:00100000:0.0:1787119522.425402:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5378 00000100:00100000:0.0:1787119522.425413:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33957:x1873929633639808:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.425434:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.425495:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166b4 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.425530:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 264) 00010000:00010000:0.0:1787119522.425536:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 264) 00010000:00010000:0.0:1787119522.425543:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 19 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.425557:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 19 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.425576:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38000, rc 0) 00000100:00100000:0.0:1787119522.425639:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33957:x1873929633639808:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 228us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.425646:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5378 00000100:00100000:1.0:1787119522.431817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.432045:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633639936 00000100:00100000:3.0:1787119522.432056:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633639936 00002000:00100000:3.0:1787119522.432103:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a519d25500 x1873929633639936/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.432114:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25500 with x1873929633639936 ext(266240->270335) 00010000:00010000:3.0:1787119522.432123:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 19 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.432152:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 19 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.432159:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d25500 00000100:00100000:3.0:1787119522.432199:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1276 00000100:00100000:3.0:1787119522.432210:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+19:2376:x1873929633639936:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119522.432669:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2376:x1873929633639936:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 459us (860us total) trans 4294969249 rc 0/0 00000100:00100000:3.0:1787119522.432678:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1276 00002000:00100000:3.0:1787119522.432685:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a519d25500 x1873929633639936/t4294969249(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.432694:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25500 with x1873929633639936 ext(266240->270335) 00010000:00010000:3.0:1787119522.432701:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 21 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.432722:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 21 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.432730:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d25500 00000100:00100000:3.0:1787119522.447476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.447701:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633640064 00000100:00100000:0.0:1787119522.447712:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633640064 00010000:00010000:0.0:1787119522.447757:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 21 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.447806:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5436 00000100:00100000:0.0:1787119522.447817:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2373:x1873929633640064:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119522.447833:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787119522.447853:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119520 -> 1787119521 00002000:00010000:0.0:1787119522.447857:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119520 -> 1787119521 00010000:00010000:0.0:1787119522.447864:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 21 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.447905:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 21 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.447931:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [266240->18446744073709551615] (req 266240->270335) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471669f expref: 21 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.447950:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 264) 00010000:00010000:0.0:1787119522.447957:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 264) 00010000:00010000:0.0:1787119522.447966:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.447978:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.447986:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 264) 00010000:00010000:0.0:1787119522.447989:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 264) 00010000:00010000:0.0:1787119522.447993:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 20 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.448013:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 20 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.448051:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 20 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.448067:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653634688:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.448180:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.448191:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511632a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653634816:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119522.448217:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119522.455952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.456127:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633640192 00000100:00100000:1.0:1787119522.456137:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633640192 00002000:00100000:1.0:1787119522.456187:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a5066df100 x1873929633640192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.456209:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df100 with x1873929633640192 ext(266240->270335) 00002000:00010000:1.0:1787119522.456216:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df100 00000100:00100000:1.0:1787119522.456245:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10671 00000100:00100000:1.0:1787119522.456254:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2373:x1873929633640192:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119522.457226:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653634688:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119522.457245:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511632a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653634816:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.457405:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119522.457486:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2373:x1873929633640064:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9670us (10060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.457497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5436 00000100:00100000:1.0:1787119522.458504:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2373:x1873929633640192:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2246us (2558us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119522.458516:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10671 00002000:00100000:1.0:1787119522.458528:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a5066df100 x1873929633640192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.458538:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df100 with x1873929633640192 ext(266240->270335) 00002000:00010000:1.0:1787119522.458543:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df100 00000100:00100000:2.0:1787119522.462333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.462476:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633640320 00000100:00100000:3.0:1787119522.462488:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633640320 00000100:00100000:3.0:1787119522.462550:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5379 00000100:00100000:3.0:1787119522.462560:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:33946:x1873929633640320:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119522.462579:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119522.462598:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166bb expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.462633:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 19 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.462644:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 264) 00010000:00010000:3.0:1787119522.462649:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 264) 00010000:00010000:3.0:1787119522.462654:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.462687:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 19 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.462712:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 19 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.462726:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653634944:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119522.462816:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.465532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.465617:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633640448 00000100:00100000:2.0:1787119522.465627:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633640448 00002000:00100000:2.0:1787119522.465676:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a511632a00 x1873929633640448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.465688:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633640448 ext(270336->274431) 00010000:00010000:2.0:1787119522.465697:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 20 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.465725:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 20 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.465733:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511632a00 00000100:00100000:2.0:1787119522.465750:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1277 00000100:00100000:2.0:1787119522.465758:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2373:x1873929633640448:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.466057:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2373:x1873929633640448:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 297us (533us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119522.466068:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1277 00002000:00100000:2.0:1787119522.466075:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a511632a00 x1873929633640448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.466084:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633640448 ext(270336->274431) 00010000:00010000:2.0:1787119522.466090:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 20 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.466104:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 20 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.466111:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511632a00 00000100:00100000:3.0:1787119522.468916:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653634944:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119522.468955:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.468978:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fba00, rc 0) 00000100:00100000:3.0:1787119522.469060:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633640320:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6501us (6738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.469069:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5379 00000100:00100000:1.0:1787119522.472151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.472297:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633640576 00000100:00100000:2.0:1787119522.472308:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633640576 00000100:00100000:2.0:1787119522.472373:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5380 00000100:00100000:2.0:1787119522.472382:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+20:33957:x1873929633640576:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.472404:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.472423:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166c2 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.472493:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 264) 00010000:00010000:2.0:1787119522.472502:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.472510:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 264) 00010000:00010000:2.0:1787119522.472516:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.472564:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.472579:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.472592:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119522.472647:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+21:33957:x1873929633640576:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 267us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.472654:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5380 00000100:00100000:0.0:1787119522.475747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.475845:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633640704 00000100:00100000:1.0:1787119522.475856:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633640704 00010000:00010000:1.0:1787119522.475909:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 21 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.475953:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5437 00000100:00100000:1.0:1787119522.475964:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2375:x1873929633640704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.475993:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.476029:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 21 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.476058:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 21 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.476090:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e401b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166b4 expref: 21 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.476110:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 264) 00010000:00010000:1.0:1787119522.476115:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 264) 00010000:00010000:1.0:1787119522.476123:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.476134:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.476175:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.476203:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 26 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.476217:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653635200:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.476316:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb780 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.480909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.481069:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653635200:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.481097:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119522.481159:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2375:x1873929633640704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5195us (5423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.481170:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5437 00000100:00100000:2.0:1787119522.481607:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633640832 00000100:00100000:2.0:1787119522.481616:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633640832 00002000:00100000:2.0:1787119522.481658:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (270336->307199) req@ffff92a5098a5500 x1873929633640832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.481669:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633640832 ext(270336->307199) 00010000:00010000:2.0:1787119522.481678:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.481705:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.481713:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5500 00000100:00100000:2.0:1787119522.481744:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1278 00000100:00100000:2.0:1787119522.481754:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633640832:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.486272:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633640832:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4508us (5361us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119522.486287:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1278 00002000:00100000:2.0:1787119522.486301:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (270336->307199) req@ffff92a5098a5500 x1873929633640832/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.486312:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633640832 ext(270336->307199) 00010000:00010000:2.0:1787119522.486322:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.486352:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.486361:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5500 00000100:00100000:3.0:1787119522.490721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.490771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.490865:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633640960 00000100:00100000:1.0:1787119522.490885:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633640960 00000100:00100000:1.0:1787119522.490945:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5381 00000100:00100000:1.0:1787119522.490955:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633640960:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.490981:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119522.491011:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166c9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.491044:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 264) 00010000:00010000:1.0:1787119522.491053:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.491061:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 264) 00010000:00010000:1.0:1787119522.491066:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.491109:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.491124:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.491137:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:1.0:1787119522.491214:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633640960:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 259us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.491221:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5381 00000100:00100000:2.0:1787119522.492177:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633641088 00000100:00100000:2.0:1787119522.492196:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633641088 00010000:00010000:2.0:1787119522.492229:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.492272:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5438 00000100:00100000:2.0:1787119522.492282:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633641088:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119522.492292:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119522.492317:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.492348:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.492372:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4022 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166bb expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.492389:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 264) 00010000:00010000:2.0:1787119522.492393:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 264) 00010000:00010000:2.0:1787119522.492402:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.492412:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.492490:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.492507:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 19 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.492521:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653635456:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119522.492608:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119522.496423:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653635456:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119522.496493:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119522.496554:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633641088:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4272us (5781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.496565:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5438 00000100:00100000:3.0:1787119522.500103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.500300:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633641216 00000100:00100000:0.0:1787119522.500310:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633641216 00010000:00010000:0.0:1787119522.500352:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 20 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.500395:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5439 00000100:00100000:0.0:1787119522.500405:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2374:x1873929633641216:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119522.500420:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119522.500484:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 20 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.500513:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 20 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.500544:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4029 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c2 expref: 20 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.500561:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 264) 00010000:00010000:0.0:1787119522.500566:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 264) 00010000:00010000:0.0:1787119522.500575:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.500585:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.500623:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.500638:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653635584:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119522.500725:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.503819:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653635584:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.503846:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119522.503920:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+19:2374:x1873929633641216:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3516us (3826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.503931:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5439 00000100:00100000:1.0:1787119522.511217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.511405:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633641344 00000100:00100000:2.0:1787119522.511416:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633641344 00000100:00100000:2.0:1787119522.511503:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5382 00000100:00100000:2.0:1787119522.511514:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33957:x1873929633641344:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.511534:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.511557:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166d0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.511591:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.511601:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 264) 00010000:00010000:2.0:1787119522.511606:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 264) 00010000:00010000:2.0:1787119522.511611:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.511647:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.511674:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 26 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.511697:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653635712:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.511787:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.515172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.515218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.515321:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633641472 00000100:00100000:0.0:1787119522.515332:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633641472 00010000:00010000:0.0:1787119522.515372:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 27 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.515420:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5440 00000100:00100000:0.0:1787119522.515430:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633641472:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119522.515471:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119522.515499:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 27 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.515529:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 27 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.515558:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 264) 00010000:00010000:0.0:1787119522.515563:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 264) 00010000:00010000:0.0:1787119522.515572:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.515582:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.515621:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.515637:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653635840:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119522.515720:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.515937:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633641600 00000100:00100000:1.0:1787119522.515942:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633641600 00000100:00100000:1.0:1787119522.515984:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5383 00000100:00100000:1.0:1787119522.515993:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633641600:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.516018:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119522.516032:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166d7 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.516053:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.516060:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 264) 00010000:00010000:1.0:1787119522.516063:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 264) 00010000:00010000:1.0:1787119522.516068:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.516092:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.516106:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.516117:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653635968:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119522.516146:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb780 going to sleep for 11 seconds 00010000:00010000:2.0:1787119522.517039:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4030 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166c9 expref: 29 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.517059:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653635712:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.517087:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.517097:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.517107:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119522.517161:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+20:33957:x1873929633641344:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5649us (5952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.517170:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5382 00000100:00100000:1.0:1787119522.520781:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653635840:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.520811:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.520887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633641472:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5457us (5725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.520902:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5440 00000100:00100000:3.0:1787119522.521725:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653635968:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119522.521752:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.521774:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:3.0:1787119522.521820:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633641600:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5828us (6601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.521827:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5383 00000100:00100000:0.0:1787119522.528133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.528313:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633641728 00000100:00100000:1.0:1787119522.528325:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633641728 00002000:00100000:1.0:1787119522.528381:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a511633480 x1873929633641728/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.528392:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633480 with x1873929633641728 ext(270336->274431) 00010000:00010000:1.0:1787119522.528403:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.528436:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.528476:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633480 00000100:00100000:1.0:1787119522.528512:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1279 00000100:00100000:1.0:1787119522.528522:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2375:x1873929633641728:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.528727:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2375:x1873929633641728:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 204us (602us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119522.528735:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1279 00002000:00100000:1.0:1787119522.528742:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a511633480 x1873929633641728/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.528750:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633480 with x1873929633641728 ext(270336->274431) 00010000:00010000:1.0:1787119522.528756:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.528776:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 20 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.528783:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633480 00000100:00100000:1.0:1787119522.532689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.532735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.532833:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633641856 00000100:00100000:0.0:1787119522.532843:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633641856 00000100:00100000:0.0:1787119522.532915:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5384 00000100:00100000:0.0:1787119522.532924:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+20:33957:x1873929633641856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.532944:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.532963:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166de expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.533016:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 264) 00010000:00010000:0.0:1787119522.533025:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.533031:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 264) 00010000:00010000:0.0:1787119522.533036:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.533079:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.533092:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.533105:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119522.533168:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+21:33957:x1873929633641856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 244us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.533175:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5384 00000100:00100000:2.0:1787119522.533921:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633641984 00000100:00100000:2.0:1787119522.533929:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633641984 00010000:00010000:2.0:1787119522.533957:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 21 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.534106:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5441 00000100:00100000:2.0:1787119522.534116:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2376:x1873929633641984:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119522.534128:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119522.534149:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 21 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.534173:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 21 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.534205:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4037 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d0 expref: 21 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.534219:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 264) 00010000:00010000:2.0:1787119522.534224:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 264) 00010000:00010000:2.0:1787119522.534232:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.534242:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.534273:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.534286:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 26 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.534299:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653636224:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119522.534415:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.539812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.540157:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653636224:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119522.540182:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119522.540257:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2376:x1873929633641984:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6142us (7521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.540269:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5441 00000100:00100000:1.0:1787119522.540402:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633642112 00000100:00100000:1.0:1787119522.540409:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633642112 00002000:00100000:1.0:1787119522.540494:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (270336->307199) req@ffff92a511631500 x1873929633642112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.540504:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633642112 ext(270336->307199) 00010000:00010000:1.0:1787119522.540512:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.540539:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.540547:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511631500 00000100:00100000:1.0:1787119522.540574:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1280 00000100:00100000:1.0:1787119522.540583:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633642112:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.546840:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633642112:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6244us (7028us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119522.546855:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1280 00002000:00100000:1.0:1787119522.546880:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (270336->307199) req@ffff92a511631500 x1873929633642112/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.546892:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633642112 ext(270336->307199) 00010000:00010000:1.0:1787119522.546905:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.546935:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.546943:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511631500 00000100:00100000:0.0:1787119522.551581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.551637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.551762:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633642240 00000100:00100000:1.0:1787119522.551775:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633642240 00000100:00100000:1.0:1787119522.551850:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5385 00000100:00100000:1.0:1787119522.551870:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633642240:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.551892:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119522.551914:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166e5 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.551953:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 264) 00010000:00010000:1.0:1787119522.551963:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.551970:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 264) 00010000:00010000:1.0:1787119522.551985:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.552048:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.552063:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.552076:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119522.552145:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633642240:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 285us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.552152:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5385 00000100:00100000:3.0:1787119522.553888:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633642368 00000100:00100000:3.0:1787119522.553909:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633642368 00010000:00010000:3.0:1787119522.553958:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.554021:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5442 00000100:00100000:3.0:1787119522.554032:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2373:x1873929633642368:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.554049:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.554078:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.554109:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.554137:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e403e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166d7 expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.554157:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 264) 00010000:00010000:3.0:1787119522.554163:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 264) 00010000:00010000:3.0:1787119522.554172:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.554249:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.554293:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 19 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.554311:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 19 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.554325:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653636480:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.554638:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.559509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.559775:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633642496 00000100:00100000:1.0:1787119522.559785:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633642496 00010000:00010000:1.0:1787119522.559825:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 20 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.559881:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5443 00000100:00100000:1.0:1787119522.559892:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2374:x1873929633642496:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.559907:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.559929:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 20 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.559956:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 20 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.560014:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 264) 00010000:00010000:1.0:1787119522.560020:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 264) 00010000:00010000:1.0:1787119522.560029:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.560040:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.560079:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.560096:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653636608:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.560184:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb600 going to sleep for 11 seconds 00010000:00010000:3.0:1787119522.562755:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4045 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166de expref: 20 pid: 12469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.562783:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653636480:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.562807:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.563424:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653636608:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.563471:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.563520:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+19:2374:x1873929633642496:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3629us (4021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.563529:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5443 00000100:00100000:2.0:1787119522.564773:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2373:x1873929633642368:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10733us (13195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.564786:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5442 00000100:00100000:0.0:1787119522.569598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.569811:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633642624 00000100:00100000:2.0:1787119522.569821:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633642624 00000100:00100000:2.0:1787119522.569919:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5386 00000100:00100000:2.0:1787119522.569930:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33957:x1873929633642624:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.569950:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.569971:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166ec expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.570020:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 26 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.570030:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 264) 00010000:00010000:2.0:1787119522.570035:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 264) 00010000:00010000:2.0:1787119522.570039:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.570076:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 26 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.570109:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 26 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.570125:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653636736:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.570221:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.573840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.574016:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633642752 00000100:00100000:1.0:1787119522.574026:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633642752 00010000:00010000:1.0:1787119522.574066:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 27 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.574107:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5444 00000100:00100000:1.0:1787119522.574117:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633642752:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.574132:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.574154:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 27 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.574178:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 27 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.574314:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 264) 00010000:00010000:1.0:1787119522.574319:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 264) 00010000:00010000:1.0:1787119522.574329:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.574340:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.574378:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.574497:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e404c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166e5 expref: 27 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.574513:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653636736:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.574539:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 20 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.574549:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:1.0:1787119522.574683:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653636864:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119522.574740:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+20:33957:x1873929633642624:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4811us (5151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.574748:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5386 00000100:00100000:1.0:1787119522.575694:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb600 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.576300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.579827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.579857:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633643008 00000100:00100000:2.0:1787119522.579872:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633643008 00002000:00100000:2.0:1787119522.579920:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a5066df480 x1873929633643008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.579939:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633643008 ext(270336->274431) 00002000:00010000:2.0:1787119522.579945:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:2.0:1787119522.579976:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10672 00000100:00100000:2.0:1787119522.579984:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2376:x1873929633643008:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.580209:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2376:x1873929633643008:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 224us (390us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119522.580216:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10672 00002000:00100000:2.0:1787119522.580223:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a5066df480 x1873929633643008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.580231:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633643008 ext(270336->274431) 00002000:00010000:2.0:1787119522.580234:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:3.0:1787119522.581340:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653636864:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.581366:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.581415:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633642752:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7299us (7584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.581426:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5444 00000100:00100000:1.0:1787119522.582076:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633642880 00000100:00100000:1.0:1787119522.582084:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633642880 00000100:00100000:1.0:1787119522.582171:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5387 00000100:00100000:1.0:1787119522.582180:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:33946:x1873929633642880:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.582208:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119522.582228:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166f3 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.582258:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.582269:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 264) 00010000:00010000:1.0:1787119522.582273:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 264) 00010000:00010000:1.0:1787119522.582278:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.582313:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 19 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.582341:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 19 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.582356:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653636992:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119522.582428:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.590026:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653636992:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119522.590073:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.590096:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:1.0:1787119522.590160:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633642880:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7980us (13863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.590170:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5387 00000100:00100000:2.0:1787119522.590361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.591956:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633643136 00000100:00100000:1.0:1787119522.591970:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633643136 00002000:00100000:1.0:1787119522.592038:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a5066dea00 x1873929633643136/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.592049:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633643136 ext(270336->274431) 00010000:00010000:1.0:1787119522.592057:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 20 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.592087:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 20 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.592095:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dea00 00000100:00100000:1.0:1787119522.592131:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1281 00000100:00100000:1.0:1787119522.592141:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+20:2375:x1873929633643136:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119522.592582:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633643136:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 440us (2220us total) trans 4294969250 rc 0/0 00000100:00100000:1.0:1787119522.592591:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1281 00002000:00100000:1.0:1787119522.592598:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a5066dea00 x1873929633643136/t4294969250(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.592607:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dea00 with x1873929633643136 ext(270336->274431) 00010000:00010000:1.0:1787119522.592613:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 22 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.592629:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 22 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.592637:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dea00 00000100:00100000:2.0:1787119522.594675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.594984:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633643264 00000100:00100000:3.0:1787119522.594991:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633643264 00000100:00100000:3.0:1787119522.595060:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5388 00000100:00100000:3.0:1787119522.595069:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633643264:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119522.595086:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119522.595104:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047166fa expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.595141:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 264) 00010000:00010000:3.0:1787119522.595149:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.595155:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 264) 00010000:00010000:3.0:1787119522.595161:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 23 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.595786:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.595804:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 23 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.595818:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fa600, rc 0) 00000100:00100000:3.0:1787119522.595878:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633643264:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 798us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.595885:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5388 00000100:00100000:2.0:1787119522.598622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.598704:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633643392 00000100:00100000:3.0:1787119522.598714:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633643392 00010000:00010000:3.0:1787119522.598756:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 23 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.598799:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5445 00000100:00100000:3.0:1787119522.598809:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2373:x1873929633643392:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.598827:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.598852:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 23 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.598889:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 23 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.598916:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4053 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ec expref: 23 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.598934:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 264) 00010000:00010000:3.0:1787119522.598939:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 264) 00010000:00010000:3.0:1787119522.598948:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.598959:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.599226:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.599241:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 26 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.599255:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653637248:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.599342:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.603192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.603280:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653637248:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.603302:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.603359:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2373:x1873929633643392:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4551us (4745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.603370:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5445 00000100:00100000:1.0:1787119522.603565:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633643520 00000100:00100000:1.0:1787119522.603574:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633643520 00002000:00100000:1.0:1787119522.603615:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (270336->307199) req@ffff92a509233800 x1873929633643520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.603625:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233800 with x1873929633643520 ext(270336->307199) 00010000:00010000:1.0:1787119522.603633:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.603662:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.603670:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509233800 00000100:00100000:1.0:1787119522.603699:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1282 00000100:00100000:1.0:1787119522.603709:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633643520:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.607183:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633643520:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3465us (3996us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119522.607197:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1282 00002000:00100000:1.0:1787119522.607210:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (270336->307199) req@ffff92a509233800 x1873929633643520/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.607228:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233800 with x1873929633643520 ext(270336->307199) 00010000:00010000:1.0:1787119522.607239:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.607268:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.607277:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509233800 00000100:00100000:0.0:1787119522.610724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.610845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.611364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633643776 00000100:00100000:2.0:1787119522.611375:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633643776 00010000:00010000:2.0:1787119522.611413:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.611482:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5446 00000100:00100000:2.0:1787119522.611491:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633643776:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119522.611506:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119522.611530:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.611558:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.611586:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e405a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166f3 expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.611603:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 264) 00010000:00010000:2.0:1787119522.611608:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 264) 00010000:00010000:2.0:1787119522.611616:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.611627:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.611664:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.611679:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653637376:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119522.611752:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.613815:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633643648 00000100:00100000:3.0:1787119522.613826:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633643648 00000100:00100000:2.0:1787119522.614091:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5389 00000100:00100000:2.0:1787119522.614100:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633643648:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.614117:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.614136:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716701 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.614168:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.614177:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653637376:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119522.614181:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 264) 00010000:00010000:2.0:1787119522.614185:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 264) 00010000:00010000:2.0:1787119522.614190:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 28 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.614207:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119522.614219:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.614243:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 21 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.614256:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653637504:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119522.614257:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633643776:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2767us (3412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.614266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5446 00000100:00100000:2.0:1787119522.614359:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.616407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.616578:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653637504:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.616606:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.616627:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119522.616674:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633643648:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2574us (5957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.616682:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5389 00000100:00100000:3.0:1787119522.617398:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633643904 00000100:00100000:3.0:1787119522.617407:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633643904 00010000:00010000:3.0:1787119522.617607:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 22 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.617697:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5447 00000100:00100000:1.0:1787119522.617705:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633643904:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.617716:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.617734:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 22 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.617752:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 22 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.617771:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a47501d/0xcaba3de8463e4061 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166fa expref: 22 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.617782:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 264) 00010000:00010000:1.0:1787119522.617785:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 264) 00010000:00010000:1.0:1787119522.617791:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.617798:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.617823:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.617832:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653637632:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.617912:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.620203:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653637632:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.620231:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119522.620289:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2376:x1873929633643904:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2584us (3889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.620300:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5447 00000100:00100000:3.0:1787119522.626879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.627124:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633644032 00000100:00100000:2.0:1787119522.627135:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633644032 00000100:00100000:2.0:1787119522.627299:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5390 00000100:00100000:2.0:1787119522.627311:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+21:33957:x1873929633644032:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.627331:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.627349:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716708 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.627386:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.627396:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 264) 00010000:00010000:2.0:1787119522.627401:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 264) 00010000:00010000:2.0:1787119522.627405:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.627470:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.627496:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 26 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.627510:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653637760:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.627582:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119522.631524:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653637760:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.631569:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.631599:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:2.0:1787119522.631661:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633644032:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4351us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.631671:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5390 00000100:00100000:1.0:1787119522.633594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.633680:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633644160 00000100:00100000:3.0:1787119522.633690:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633644160 00010000:00010000:3.0:1787119522.633729:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 27 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.633763:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5448 00000100:00100000:3.0:1787119522.633773:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633644160:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.633789:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.633813:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 27 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.633838:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 27 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.633873:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4068 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716701 expref: 27 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.633890:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 264) 00010000:00010000:3.0:1787119522.633895:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 264) 00010000:00010000:3.0:1787119522.633903:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.633912:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.633950:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.633965:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653637888:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.634061:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.643133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.643215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.643368:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653637888:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119522.643391:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119522.643464:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633644160:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9691us (9877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.643474:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5448 00000100:00100000:0.0:1787119522.643643:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633644416 00000100:00100000:0.0:1787119522.643651:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633644416 00002000:00100000:0.0:1787119522.643694:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a50512e300 x1873929633644416/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.643705:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512e300 with x1873929633644416 ext(270336->274431) 00002000:00010000:0.0:1787119522.643709:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512e300 00000100:00100000:0.0:1787119522.643742:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10673 00000100:00100000:0.0:1787119522.643751:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633644416:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119522.643930:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633644416:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 179us (713us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119522.643938:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10673 00002000:00100000:0.0:1787119522.643944:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a50512e300 x1873929633644416/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.643952:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512e300 with x1873929633644416 ext(270336->274431) 00002000:00010000:0.0:1787119522.643955:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512e300 00000100:00100000:3.0:1787119522.644812:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633644288 00000100:00100000:3.0:1787119522.644818:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633644288 00000100:00100000:3.0:1787119522.644851:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5391 00000100:00100000:3.0:1787119522.644858:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63e92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:33946:x1873929633644288:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119522.644882:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119522.644901:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471670f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.644938:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.644948:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 264) 00010000:00010000:3.0:1787119522.644953:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 264) 00010000:00010000:3.0:1787119522.644959:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.644995:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.645034:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 21 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.645049:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653638016:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119522.645109:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.665644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.668033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.669748:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653638016:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119522.669787:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.669810:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038fba00, rc 0) 00000100:00100000:1.0:1787119522.669882:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63e92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633644288:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 25022us (26757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.669892:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5391 00000100:00100000:2.0:1787119522.673515:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633644544 00000100:00100000:2.0:1787119522.673534:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633644544 00002000:00100000:2.0:1787119522.673603:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a50512df80 x1873929633644544/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.673614:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512df80 with x1873929633644544 ext(274432->278527) 00010000:00010000:2.0:1787119522.673624:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 22 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.673656:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 22 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.673664:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512df80 00000100:00100000:2.0:1787119522.673814:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633644672 00000100:00100000:2.0:1787119522.673818:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633644672 00002000:00100000:2.0:1787119522.673838:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a509233b80 x1873929633644672/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.673847:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233b80 with x1873929633644672 ext(270336->274431) 00010000:00010000:2.0:1787119522.673853:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 23 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.673876:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 23 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.673883:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509233b80 00000100:00100000:1.0:1787119522.673946:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1283 00000100:00100000:1.0:1787119522.673959:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2374:x1873929633644544:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.674194:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2374:x1873929633644544:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 231us (8555us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119522.674201:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1283 00002000:00100000:1.0:1787119522.674208:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a50512df80 x1873929633644544/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.674217:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512df80 with x1873929633644544 ext(274432->278527) 00010000:00010000:1.0:1787119522.674223:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 23 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.674237:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 23 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.674243:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512df80 00000100:00100000:1.0:1787119522.674264:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1284 00000100:00100000:1.0:1787119522.674270:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633644672:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119522.674742:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2375:x1873929633644672:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 470us (6714us total) trans 4294969251 rc 0/0 00000100:00100000:1.0:1787119522.674749:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1284 00002000:00100000:1.0:1787119522.674756:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a509233b80 x1873929633644672/t4294969251(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.674770:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233b80 with x1873929633644672 ext(270336->274431) 00010000:00010000:1.0:1787119522.674776:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.674790:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.674797:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509233b80 00000100:00100000:0.0:1787119522.678887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.678932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.679128:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633644800 00000100:00100000:3.0:1787119522.679138:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633644800 00000100:00100000:3.0:1787119522.679206:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5392 00000100:00100000:3.0:1787119522.679217:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+24:33957:x1873929633644800:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119522.679235:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119522.679255:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716716 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.679297:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 264) 00010000:00010000:3.0:1787119522.679302:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 264) 00010000:00010000:3.0:1787119522.679309:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.679323:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.679336:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6038faa00, rc 0) 00000100:00100000:3.0:1787119522.679390:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633644800:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 175us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.679398:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5392 00000100:00100000:1.0:1787119522.680756:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633644928 00000100:00100000:1.0:1787119522.680766:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633644928 00010000:00010000:1.0:1787119522.680800:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 25 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.680877:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5449 00000100:00100000:1.0:1787119522.680886:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2374:x1873929633644928:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.680898:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.680924:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 25 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.680951:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 25 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.680988:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e406f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [270336->18446744073709551615] (req 270336->274431) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716708 expref: 25 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.681023:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 264) 00010000:00010000:1.0:1787119522.681028:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 264) 00010000:00010000:1.0:1787119522.681037:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.681046:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.681056:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 264) 00010000:00010000:1.0:1787119522.681059:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 264) 00010000:00010000:1.0:1787119522.681064:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 24 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.681071:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 24 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.681107:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 24 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.681122:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653638144:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.681221:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.681232:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653638272:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.681256:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.685564:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653638144:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.685581:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653638272:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.685616:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.685696:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2374:x1873929633644928:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4809us (6761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.685707:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5449 00000100:00100000:3.0:1787119522.686884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.686969:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633645056 00000100:00100000:2.0:1787119522.686987:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633645056 00002000:00100000:2.0:1787119522.687162:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a519cd7800 x1873929633645056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.687174:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd7800 with x1873929633645056 ext(270336->274431) 00002000:00010000:2.0:1787119522.687179:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd7800 00000100:00100000:2.0:1787119522.687223:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10674 00000100:00100000:2.0:1787119522.687233:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633645056:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.687414:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2376:x1873929633645056:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 182us (536us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119522.687421:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10674 00002000:00100000:2.0:1787119522.687427:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a519cd7800 x1873929633645056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.687434:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd7800 with x1873929633645056 ext(270336->274431) 00002000:00010000:2.0:1787119522.687468:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd7800 00000100:00100000:3.0:1787119522.690805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.690938:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633645184 00000100:00100000:2.0:1787119522.690948:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633645184 00000100:00100000:2.0:1787119522.691007:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5393 00000100:00100000:2.0:1787119522.691018:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633645184:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.691042:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.691061:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471671d expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.691094:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 23 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.691109:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 264) 00010000:00010000:2.0:1787119522.691114:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 264) 00010000:00010000:2.0:1787119522.691119:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 28 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.691152:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 23 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.691182:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 23 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.691380:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653638400:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.691525:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.698155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.698285:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633645312 00000100:00100000:1.0:1787119522.698296:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633645312 00010000:00010000:1.0:1787119522.698342:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 24 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.698395:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5450 00000100:00100000:1.0:1787119522.698406:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2376:x1873929633645312:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.698422:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.698465:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 24 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.698492:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 24 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.698520:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 264) 00010000:00010000:1.0:1787119522.698525:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 264) 00010000:00010000:1.0:1787119522.698533:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 28 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.698548:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 28 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.698587:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 28 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.698601:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653638528:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.698680:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb600 going to sleep for 11 seconds 00010000:00010000:2.0:1787119522.701317:0:20843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c575773d/0xcaba3de8463e407d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716716 expref: 24 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.701346:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653638400:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.701374:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 28 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.701388:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119522.701481:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633645184:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10464us (10685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.701490:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5393 00000100:00100000:0.0:1787119522.701760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.703769:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633645440 00000100:00100000:2.0:1787119522.703783:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633645440 00000100:00100000:2.0:1787119522.703838:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5394 00000100:00100000:2.0:1787119522.703846:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+24:33957:x1873929633645440:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.703874:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.703895:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716724 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.703931:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.703942:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 264) 00010000:00010000:2.0:1787119522.703947:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 264) 00010000:00010000:2.0:1787119522.703952:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.703992:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.704032:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 27 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.704047:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653638656:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.704126:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.708868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.709147:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653638656:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119522.709193:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.709217:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:3.0:1787119522.709286:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633645440:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5438us (7524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.709294:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5394 00000100:00100000:0.0:1787119522.710829:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633645568 00000100:00100000:0.0:1787119522.710841:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633645568 00002000:00100000:0.0:1787119522.710897:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (274432->311295) req@ffff92a509230a80 x1873929633645568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.710909:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633645568 ext(274432->311295) 00010000:00010000:0.0:1787119522.710918:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 28 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.710948:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 28 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119522.710956:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230a80 00000100:00100000:0.0:1787119522.710987:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1285 00000100:00100000:0.0:1787119522.711008:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2376:x1873929633645568:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.711821:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653638528:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119522.711849:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119522.711948:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2376:x1873929633645312:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13541us (13802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.711957:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5450 00000100:00100000:1.0:1787119522.718770:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2376:x1873929633645568:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7760us (9904us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119522.718786:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1285 00002000:00100000:1.0:1787119522.718800:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (274432->311295) req@ffff92a509230a80 x1873929633645568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.718812:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633645568 ext(274432->311295) 00010000:00010000:1.0:1787119522.718823:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 28 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.718853:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 28 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.718862:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230a80 00000100:00100000:2.0:1787119522.721813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.721858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.722073:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633645696 00000100:00100000:1.0:1787119522.722084:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633645696 00000100:00100000:1.0:1787119522.722145:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5395 00000100:00100000:1.0:1787119522.722155:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633645696:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.722173:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787119522.722283:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633645824 00000100:00100000:3.0:1787119522.722288:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633645824 00010000:00010000:3.0:1787119522.722315:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 29 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.722345:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5451 00000100:00100000:3.0:1787119522.722353:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2373:x1873929633645824:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.722367:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.722393:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 29 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.722418:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 29 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.722465:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e4084 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471671d expref: 29 pid: 20843 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.722483:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 264) 00010000:00010000:3.0:1787119522.722489:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 264) 00010000:00010000:3.0:1787119522.722497:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.722509:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.722550:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.722570:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653638784:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.722646:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00010000:00010000:1.0:1787119522.722750:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471672b expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.722772:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.722779:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 264) 00010000:00010000:1.0:1787119522.722782:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 264) 00010000:00010000:1.0:1787119522.722787:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.722807:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.722823:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 23 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.722834:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653638912:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119522.722861:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.725564:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653638912:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119522.725602:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.725630:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:1.0:1787119522.725686:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633645696:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3532us (3881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.725694:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5395 00000100:00100000:3.0:1787119522.725785:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653638784:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.725797:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.725820:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2373:x1873929633645824:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3469us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.725829:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5451 00000100:00100000:0.0:1787119522.728355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.728648:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633645952 00000100:00100000:2.0:1787119522.728658:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633645952 00002000:00100000:2.0:1787119522.728706:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a509231c00 x1873929633645952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.728717:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633645952 ext(274432->278527) 00010000:00010000:2.0:1787119522.728726:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.728759:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.728765:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231c00 00000100:00100000:2.0:1787119522.728803:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1286 00000100:00100000:2.0:1787119522.728812:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2376:x1873929633645952:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.729023:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2376:x1873929633645952:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 210us (676us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119522.729031:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1286 00002000:00100000:2.0:1787119522.729038:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a509231c00 x1873929633645952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.729046:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633645952 ext(274432->278527) 00010000:00010000:2.0:1787119522.729052:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.729065:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.729072:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231c00 00000100:00100000:2.0:1787119522.732879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.733011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.733333:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633646208 00000100:00100000:3.0:1787119522.733343:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633646208 00010000:00010000:3.0:1787119522.733381:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.733424:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5452 00000100:00100000:3.0:1787119522.733434:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2374:x1873929633646208:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.733471:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.733494:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.733518:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.733543:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e408b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716724 expref: 24 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.733565:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 264) 00010000:00010000:3.0:1787119522.733569:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 264) 00010000:00010000:3.0:1787119522.733577:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.733587:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.733624:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.733640:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653639040:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.733720:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.734322:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633646080 00000100:00100000:0.0:1787119522.734328:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633646080 00000100:00100000:0.0:1787119522.734419:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5396 00000100:00100000:0.0:1787119522.734429:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+24:33957:x1873929633646080:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.734465:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.734481:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716732 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.734506:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.734515:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 264) 00010000:00010000:0.0:1787119522.734519:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 264) 00010000:00010000:0.0:1787119522.734524:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.734550:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.734569:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 27 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.734581:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653639168:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119522.734618:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.738030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.738245:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653639168:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119522.738282:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.738307:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39600, rc 0) 00000100:00100000:1.0:1787119522.738380:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633646080:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3951us (5515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.738390:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5396 00000100:00100000:3.0:1787119522.738536:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653639040:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.738548:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.738569:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2374:x1873929633646208:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5138us (5559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.738578:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5452 00000100:00100000:3.0:1787119522.738597:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633646336 00000100:00100000:3.0:1787119522.738602:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633646336 00010000:00010000:3.0:1787119522.738629:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.738654:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5453 00000100:00100000:3.0:1787119522.738664:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2374:x1873929633646336:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.738678:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.738701:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.738729:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.738758:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4092 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471672b expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.738772:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 264) 00010000:00010000:3.0:1787119522.738777:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 264) 00010000:00010000:3.0:1787119522.738785:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.738797:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.738831:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.738846:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653639296:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.738912:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.742796:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653639296:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.742826:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.742903:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2374:x1873929633646336:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4239us (4884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.742915:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5453 00000100:00100000:0.0:1787119522.751594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.754604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.754714:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633646592 00000100:00100000:3.0:1787119522.754725:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633646592 00002000:00100000:3.0:1787119522.754773:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a509232300 x1873929633646592/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.754785:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232300 with x1873929633646592 ext(274432->278527) 00002000:00010000:3.0:1787119522.754790:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509232300 00000100:00100000:3.0:1787119522.754816:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10675 00000100:00100000:3.0:1787119522.754825:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2376:x1873929633646592:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119522.755042:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2376:x1873929633646592:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 218us (448us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119522.755051:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10675 00002000:00100000:3.0:1787119522.755058:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a509232300 x1873929633646592/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.755065:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232300 with x1873929633646592 ext(274432->278527) 00002000:00010000:3.0:1787119522.755069:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509232300 00000100:00100000:2.0:1787119522.758929:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633646464 00000100:00100000:2.0:1787119522.758944:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633646464 00000100:00100000:3.0:1787119522.760673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.760856:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633646720 00000100:00100000:1.0:1787119522.760873:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633646720 00002000:00100000:1.0:1787119522.760922:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a519cd6a00 x1873929633646720/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.760935:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633646720 ext(278528->282623) 00002000:00010000:1.0:1787119522.760941:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6a00 00000100:00100000:1.0:1787119522.760980:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10676 00000100:00100000:1.0:1787119522.760989:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2374:x1873929633646720:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.761314:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2374:x1873929633646720:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 325us (651us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119522.761326:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10676 00002000:00100000:1.0:1787119522.761333:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a519cd6a00 x1873929633646720/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.761340:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633646720 ext(278528->282623) 00002000:00010000:1.0:1787119522.761344:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6a00 00000100:00100000:0.0:1787119522.762463:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5397 00000100:00100000:0.0:1787119522.762474:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:33946:x1873929633646464:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.762488:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.762505:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716739 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.762536:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.762546:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 264) 00010000:00010000:0.0:1787119522.762550:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 264) 00010000:00010000:0.0:1787119522.762556:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 28 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.762587:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.762612:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 23 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.762627:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653639424:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119522.762696:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.764392:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653639424:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119522.764435:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 28 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.764495:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38200, rc 0) 00000100:00100000:0.0:1787119522.764557:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633646464:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2083us (12972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.764566:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5397 00000100:00100000:2.0:1787119522.767105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.767478:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633646848 00000100:00100000:3.0:1787119522.767489:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633646848 00002000:00100000:3.0:1787119522.767540:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a5066dc000 x1873929633646848/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.767557:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633646848 ext(274432->278527) 00010000:00010000:3.0:1787119522.767566:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 24 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.767594:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 24 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.767603:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dc000 00000100:00100000:3.0:1787119522.767634:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1287 00000100:00100000:3.0:1787119522.767644:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2376:x1873929633646848:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119522.768435:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633646848:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 789us (1337us total) trans 4294969252 rc 0/0 00000100:00100000:3.0:1787119522.768483:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1287 00002000:00100000:3.0:1787119522.768491:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a5066dc000 x1873929633646848/t4294969252(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 4584/448 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.768499:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633646848 ext(274432->278527) 00010000:00010000:3.0:1787119522.768506:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 26 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.768526:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 26 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.768534:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dc000 00000100:00100000:2.0:1787119522.778662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.780018:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633646976 00000100:00100000:0.0:1787119522.780032:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633646976 00000100:00100000:0.0:1787119522.780101:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5398 00000100:00100000:0.0:1787119522.780112:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633646976:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.780131:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.780152:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716740 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.780256:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 264) 00010000:00010000:0.0:1787119522.780263:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 264) 00010000:00010000:0.0:1787119522.780270:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.780285:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.780300:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119522.780371:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633646976:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 262us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.780378:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5398 00000100:00100000:2.0:1787119522.785804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.785887:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633647104 00000100:00100000:3.0:1787119522.785897:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633647104 00010000:00010000:3.0:1787119522.785937:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 27 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.785985:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5454 00000100:00100000:3.0:1787119522.786005:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2373:x1873929633647104:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.786021:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.786043:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 27 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.786069:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 27 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.786095:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e4099 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [274432->18446744073709551615] (req 274432->278527) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716732 expref: 27 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.786114:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 264) 00010000:00010000:3.0:1787119522.786119:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 264) 00010000:00010000:3.0:1787119522.786128:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.786137:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.786146:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 264) 00010000:00010000:3.0:1787119522.786150:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 264) 00010000:00010000:3.0:1787119522.786155:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.786163:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.786318:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.786334:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653639552:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.786429:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 27 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.786470:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653639680:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.786496:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119522.789142:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653639552:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.790211:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119522.791959:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653639680:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.792015:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.792084:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2373:x1873929633647104:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6089us (6288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.792097:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5454 00000100:00100000:3.0:1787119522.796357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.796501:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633647232 00000100:00100000:0.0:1787119522.796512:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633647232 00002000:00100000:0.0:1787119522.796563:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a512846d80 x1873929633647232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.796574:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846d80 with x1873929633647232 ext(274432->278527) 00002000:00010000:0.0:1787119522.796579:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846d80 00000100:00100000:0.0:1787119522.796611:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10677 00000100:00100000:0.0:1787119522.796620:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633647232:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119522.796842:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633647232:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 221us (496us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119522.796849:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10677 00002000:00100000:0.0:1787119522.796855:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a512846d80 x1873929633647232/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.797635:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846d80 with x1873929633647232 ext(274432->278527) 00002000:00010000:0.0:1787119522.797643:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846d80 00000100:00100000:1.0:1787119522.803630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.805383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.805584:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633647488 00000100:00100000:1.0:1787119522.805594:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633647488 00000100:00100000:1.0:1787119522.805654:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5399 00000100:00100000:1.0:1787119522.805664:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633647488:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.805682:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119522.805701:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716747 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.805733:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.805744:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 264) 00010000:00010000:1.0:1787119522.805748:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 264) 00010000:00010000:1.0:1787119522.805752:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.805786:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.805818:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 25 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.805831:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653639808:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119522.805923:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.806212:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633647360 00000100:00100000:0.0:1787119522.806218:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633647360 00002000:00100000:0.0:1787119522.806251:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a50512dc00 x1873929633647360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.806262:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512dc00 with x1873929633647360 ext(278528->282623) 00010000:00010000:0.0:1787119522.806269:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 26 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.806284:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 26 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119522.806292:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512dc00 00000100:00100000:0.0:1787119522.806319:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1288 00000100:00100000:0.0:1787119522.806328:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633647360:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119522.806549:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633647360:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 221us (2927us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119522.806558:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1288 00002000:00100000:0.0:1787119522.806566:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a50512dc00 x1873929633647360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119522.806574:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512dc00 with x1873929633647360 ext(278528->282623) 00010000:00010000:0.0:1787119522.806580:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 26 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.806593:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 26 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119522.806599:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512dc00 00000100:00100000:3.0:1787119522.811615:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.811742:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653639808:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119522.811790:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.811813:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119522.811880:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633647488:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6216us (6505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.811888:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5399 00000100:00100000:1.0:1787119522.811924:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633647616 00000100:00100000:1.0:1787119522.811931:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633647616 00000100:00100000:1.0:1787119522.811981:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5400 00000100:00100000:1.0:1787119522.811989:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633647616:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.812016:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119522.812032:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471674e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.812057:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 264) 00010000:00010000:1.0:1787119522.812065:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.812072:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 264) 00010000:00010000:1.0:1787119522.812077:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.812111:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.812121:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.812130:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119522.812153:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633647616:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 164us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.812159:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5400 00000100:00100000:1.0:1787119522.815588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.815682:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633647744 00000100:00100000:0.0:1787119522.815692:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633647744 00010000:00010000:0.0:1787119522.815733:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 27 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.815780:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5455 00000100:00100000:0.0:1787119522.815789:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633647744:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119522.815805:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119522.815829:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 27 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.815855:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 27 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.815890:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e40a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716740 expref: 27 pid: 6693 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.815911:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 264) 00010000:00010000:0.0:1787119522.815917:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 264) 00010000:00010000:0.0:1787119522.815926:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.815938:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.816004:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.816020:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.816035:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653640064:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119522.816125:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.824781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.825037:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633647872 00000100:00100000:2.0:1787119522.825049:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633647872 00002000:00100000:2.0:1787119522.825102:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a512844a80 x1873929633647872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.825114:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633647872 ext(278528->315391) 00010000:00010000:2.0:1787119522.825125:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 29 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.825159:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 29 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.825168:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844a80 00000100:00100000:2.0:1787119522.825215:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1289 00000100:00100000:2.0:1787119522.825226:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633647872:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119522.827848:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653640064:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.827889:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119522.827951:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633647744:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12162us (12372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.827962:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5455 00000100:00100000:2.0:1787119522.832038:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633647872:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6803us (7260us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119522.832052:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1289 00002000:00100000:2.0:1787119522.832066:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a512844a80 x1873929633647872/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119522.832078:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633647872 ext(278528->315391) 00010000:00010000:2.0:1787119522.832089:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 29 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.832120:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 29 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119522.832129:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844a80 00000100:00100000:3.0:1787119522.835290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.835487:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633648000 00000100:00100000:1.0:1787119522.835499:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633648000 00000100:00100000:1.0:1787119522.835553:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5401 00000100:00100000:1.0:1787119522.835563:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633648000:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.835584:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119522.835604:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716755 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.835642:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 264) 00010000:00010000:1.0:1787119522.835650:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.835657:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 264) 00010000:00010000:1.0:1787119522.835662:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.835711:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.835725:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.835739:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119522.835808:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633648000:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 245us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.835815:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5401 00000100:00100000:1.0:1787119522.838356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.838485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633648128 00000100:00100000:3.0:1787119522.838495:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633648128 00010000:00010000:3.0:1787119522.838535:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 30 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.838576:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5456 00000100:00100000:3.0:1787119522.838587:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2373:x1873929633648128:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.838602:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.838631:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 30 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.838659:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 30 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.838689:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e40ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716747 expref: 30 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.838709:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 264) 00010000:00010000:3.0:1787119522.838714:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 264) 00010000:00010000:3.0:1787119522.838723:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.838734:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.838783:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.838801:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 25 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.838817:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653640320:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119522.839225:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.842605:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653640320:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.842634:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.842699:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2373:x1873929633648128:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4112us (4353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.842711:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5456 00000100:00100000:3.0:1787119522.846585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.846698:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633648256 00000100:00100000:2.0:1787119522.846708:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633648256 00010000:00010000:2.0:1787119522.846749:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 26 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.846794:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5457 00000100:00100000:2.0:1787119522.846805:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2374:x1873929633648256:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119522.846821:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119522.846848:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 26 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.846988:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 26 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.847024:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e40b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471674e expref: 26 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.847041:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 264) 00010000:00010000:2.0:1787119522.847047:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 264) 00010000:00010000:2.0:1787119522.847054:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.847064:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.847104:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.847119:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653640448:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119522.847205:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:2.0:1787119522.850402:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653640448:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119522.850428:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119522.850514:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2374:x1873929633648256:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3709us (3937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.850525:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5457 00000100:00100000:1.0:1787119522.857487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.857723:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633648384 00000100:00100000:2.0:1787119522.857733:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633648384 00000100:00100000:2.0:1787119522.857793:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5402 00000100:00100000:2.0:1787119522.857803:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633648384:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.857823:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.857845:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471675c expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.857891:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.857904:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 264) 00010000:00010000:2.0:1787119522.857908:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 264) 00010000:00010000:2.0:1787119522.857914:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.857947:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 28 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.857972:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 28 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.857987:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653640576:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.858086:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.865087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.865127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.865228:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633648512 00000100:00100000:0.0:1787119522.865239:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633648512 00010000:00010000:0.0:1787119522.865281:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 29 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.865329:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5458 00000100:00100000:0.0:1787119522.865339:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633648512:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119522.865356:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119522.865390:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 29 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.865419:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 29 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.865484:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 264) 00010000:00010000:0.0:1787119522.865490:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 264) 00010000:00010000:0.0:1787119522.865500:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.865513:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.865556:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.865572:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653640704:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119522.865655:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.865990:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633648640 00000100:00100000:1.0:1787119522.866006:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633648640 00000100:00100000:1.0:1787119522.866052:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5403 00000100:00100000:1.0:1787119522.866060:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633648640:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.866074:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119522.866089:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716763 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.866112:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.866120:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 264) 00010000:00010000:1.0:1787119522.866123:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 264) 00010000:00010000:1.0:1787119522.866128:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.866150:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.866166:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.866176:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653640832:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119522.866220:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb600 going to sleep for 11 seconds 00010000:00010000:2.0:1787119522.866911:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e40bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716755 expref: 31 pid: 20841 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.866931:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653640576:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.866957:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.866966:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.867007:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:2.0:1787119522.867065:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633648384:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9262us (9632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.867073:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5402 00000100:00100000:2.0:1787119522.877865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.878043:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653640832:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119522.878086:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 30 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.878114:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119522.878179:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633648640:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 12119us (13051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.878199:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5403 00000100:00100000:3.0:1787119522.878348:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633648768 00000100:00100000:3.0:1787119522.878356:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633648768 00002000:00100000:3.0:1787119522.878410:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a5066ded80 x1873929633648768/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.878420:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633648768 ext(278528->282623) 00010000:00010000:3.0:1787119522.878428:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.878478:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.878487:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066ded80 00000100:00100000:3.0:1787119522.878519:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1290 00000100:00100000:3.0:1787119522.878531:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633648768:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119522.878696:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633648768:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 167us (851us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119522.878704:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1290 00002000:00100000:3.0:1787119522.878710:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a5066ded80 x1873929633648768/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.878718:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ded80 with x1873929633648768 ext(278528->282623) 00010000:00010000:3.0:1787119522.878724:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.878739:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 26 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.878746:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066ded80 00000100:00100000:2.0:1787119522.881972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.882208:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633648896 00000100:00100000:1.0:1787119522.882218:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633648896 00000100:00100000:1.0:1787119522.882285:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5404 00000100:00100000:1.0:1787119522.882295:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633648896:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119522.882316:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119522.882338:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471676a expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.882371:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 264) 00010000:00010000:1.0:1787119522.882390:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.882399:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 264) 00010000:00010000:1.0:1787119522.882405:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 27 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.882494:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.882511:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 27 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.882524:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:1.0:1787119522.882574:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633648896:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 282us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.882581:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5404 00000100:00100000:0.0:1787119522.885331:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653640704:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.885363:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119522.885465:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633648512:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 20125us (20390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.885476:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5458 00000100:00100000:2.0:1787119522.887274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.887359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633649024 00000100:00100000:1.0:1787119522.887368:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633649024 00010000:00010000:1.0:1787119522.887412:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 27 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.887476:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5459 00000100:00100000:1.0:1787119522.887487:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633649024:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.887504:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.887529:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 27 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.887558:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 27 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.887587:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e40c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471675c expref: 27 pid: 6695 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.887607:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 264) 00010000:00010000:1.0:1787119522.887613:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 264) 00010000:00010000:1.0:1787119522.887622:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.887634:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.887682:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.887699:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 28 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.887712:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653641088:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.887805:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.893336:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653641088:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.893372:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.893472:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633649024:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5986us (6208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.893483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5459 00000100:00100000:3.0:1787119522.894362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.894839:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633649152 00000100:00100000:1.0:1787119522.894848:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633649152 00002000:00100000:1.0:1787119522.894910:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a512844e00 x1873929633649152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.894922:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844e00 with x1873929633649152 ext(278528->315391) 00010000:00010000:1.0:1787119522.894932:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 29 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.894969:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 29 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.894978:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844e00 00000100:00100000:1.0:1787119522.895021:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1291 00000100:00100000:1.0:1787119522.895031:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633649152:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119522.901675:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633649152:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6630us (7302us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119522.901691:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1291 00002000:00100000:1.0:1787119522.901706:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a512844e00 x1873929633649152/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.901718:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844e00 with x1873929633649152 ext(278528->315391) 00010000:00010000:1.0:1787119522.901730:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 29 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.901764:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 29 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.901773:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844e00 00000100:00100000:3.0:1787119522.904832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.904991:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633649280 00000100:00100000:0.0:1787119522.905013:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633649280 00000100:00100000:0.0:1787119522.905077:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5405 00000100:00100000:0.0:1787119522.905088:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633649280:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.905107:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.905130:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716771 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.905166:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 264) 00010000:00010000:0.0:1787119522.905175:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.905192:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 264) 00010000:00010000:0.0:1787119522.905198:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 30 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.905238:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.905253:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 30 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.905265:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119522.905329:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633649280:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 243us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.905336:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5405 00000100:00100000:2.0:1787119522.908633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.908734:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633649408 00000100:00100000:3.0:1787119522.908746:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633649408 00010000:00010000:3.0:1787119522.908789:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 30 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.908834:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5460 00000100:00100000:3.0:1787119522.908844:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2376:x1873929633649408:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.908872:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.908897:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 30 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.908930:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 30 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.908958:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e40ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716763 expref: 30 pid: 6696 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.908975:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 264) 00010000:00010000:3.0:1787119522.908979:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 264) 00010000:00010000:3.0:1787119522.908988:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.909011:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.909051:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 25 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.909066:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 25 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.909080:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653641344:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.909169:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.912533:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653641344:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.912567:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.912629:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633649408:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3785us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.912641:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5460 00000100:00100000:0.0:1787119522.916296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.916600:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633649536 00000100:00100000:2.0:1787119522.916610:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633649536 00010000:00010000:2.0:1787119522.916651:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 26 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.916695:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5461 00000100:00100000:2.0:1787119522.916704:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2373:x1873929633649536:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119522.916719:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119522.916743:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 26 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.916770:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 26 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.916795:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e40d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471676a expref: 26 pid: 8267 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.916818:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 264) 00010000:00010000:2.0:1787119522.916822:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 264) 00010000:00010000:2.0:1787119522.916830:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.916841:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.916892:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.916906:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653641472:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119522.917013:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.920473:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653641472:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119522.920501:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119522.920564:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2373:x1873929633649536:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3860us (4278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119522.920575:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5461 00000100:00100000:1.0:1787119522.927766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.927884:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633649664 00000100:00100000:3.0:1787119522.927896:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633649664 00000100:00100000:3.0:1787119522.927960:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5406 00000100:00100000:3.0:1787119522.927971:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633649664:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119522.927990:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119522.928023:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716778 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.928062:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.928073:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(50 264) 00010000:00010000:3.0:1787119522.928077:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 264) 00010000:00010000:3.0:1787119522.928083:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.928118:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.928146:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.928168:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653641600:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119522.928320:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.933602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.933697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.933773:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633649920 00000100:00100000:2.0:1787119522.933783:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633649920 00000100:00100000:2.0:1787119522.933845:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5407 00000100:00100000:2.0:1787119522.933855:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633649920:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.933882:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.933903:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471677f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.933941:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 264) 00010000:00010000:2.0:1787119522.933950:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.933963:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 264) 00010000:00010000:2.0:1787119522.933969:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 30 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.934035:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.934050:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 30 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.934064:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:2.0:1787119522.934117:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633649920:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 265us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.934125:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5407 00000100:00100000:1.0:1787119522.935149:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633649792 00000100:00100000:1.0:1787119522.935160:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633649792 00010000:00010000:1.0:1787119522.935209:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.935287:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5462 00000100:00100000:1.0:1787119522.935296:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2375:x1873929633649792:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.935311:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.935333:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.935359:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.935395:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 264) 00010000:00010000:1.0:1787119522.935400:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 264) 00010000:00010000:1.0:1787119522.935408:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.935418:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.935477:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.935492:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.935512:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653641856:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.935581:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00010000:00010000:3.0:1787119522.936595:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716771 expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.936617:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653641600:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119522.936643:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.936653:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.936665:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80000, rc 0) 00000100:00100000:3.0:1787119522.936723:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633649664:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8754us (8970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.936731:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5406 00000100:00100000:3.0:1787119522.938790:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653641856:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119522.938816:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119522.938881:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633649792:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3585us (5289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119522.938891:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5462 00000100:00100000:0.0:1787119522.942762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.942853:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633650048 00000100:00100000:3.0:1787119522.942874:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633650048 00002000:00100000:3.0:1787119522.942926:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a509231f80 x1873929633650048/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.942937:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231f80 with x1873929633650048 ext(278528->282623) 00010000:00010000:3.0:1787119522.942947:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.942980:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.942989:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231f80 00000100:00100000:3.0:1787119522.943055:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1292 00000100:00100000:3.0:1787119522.943066:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633650048:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119522.943273:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633650048:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 208us (520us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119522.943281:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1292 00002000:00100000:3.0:1787119522.943289:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a509231f80 x1873929633650048/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:558/0 lens 488/4536 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119522.943297:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231f80 with x1873929633650048 ext(278528->282623) 00010000:00010000:3.0:1787119522.943303:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.943318:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 26 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119522.943331:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231f80 00000100:00100000:1.0:1787119522.946760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.946871:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633650176 00000100:00100000:2.0:1787119522.946882:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633650176 00000100:00100000:2.0:1787119522.946942:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5408 00000100:00100000:2.0:1787119522.946951:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633650176:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.946972:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.947007:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716786 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.947042:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 264) 00010000:00010000:2.0:1787119522.947051:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.947060:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 264) 00010000:00010000:2.0:1787119522.947065:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.947106:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.947121:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 27 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.947133:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92a00, rc 0) 00000100:00100000:2.0:1787119522.947205:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633650176:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 254us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.947212:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5408 00000100:00100000:0.0:1787119522.950587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.950677:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633650304 00000100:00100000:3.0:1787119522.950688:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633650304 00010000:00010000:3.0:1787119522.950735:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 27 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.950786:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5463 00000100:00100000:3.0:1787119522.950796:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633650304:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.950811:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.950836:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 27 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.950875:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 27 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.950905:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e40df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716778 expref: 27 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.950924:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 264) 00010000:00010000:3.0:1787119522.950929:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 264) 00010000:00010000:3.0:1787119522.950938:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.950948:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.950990:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.951019:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 28 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.951033:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653642112:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.951125:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119522.955231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.955378:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633650432 00000100:00100000:1.0:1787119522.955400:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633650432 00002000:00100000:1.0:1787119522.955495:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a512844000 x1873929633650432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/0 e 0 to 0 dl 1787119533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.955509:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633650432 ext(278528->315391) 00010000:00010000:1.0:1787119522.955519:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.955554:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.955565:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844000 00000100:00100000:1.0:1787119522.955600:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1293 00000100:00100000:1.0:1787119522.955613:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633650432:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119522.957349:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653642112:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119522.957378:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119522.957430:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633650304:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6635us (6852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.957476:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5463 00000100:00100000:1.0:1787119522.960658:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633650432:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5034us (5424us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119522.960675:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1293 00002000:00100000:1.0:1787119522.960690:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a512844000 x1873929633650432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:558/0 lens 488/440 e 0 to 0 dl 1787119533 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119522.960708:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633650432 ext(278528->315391) 00010000:00010000:1.0:1787119522.960719:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.960752:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119522.960761:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512844000 00000100:00100000:3.0:1787119522.963701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.964607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119522.964704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633650688 00000100:00100000:1.0:1787119522.964715:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633650688 00010000:00010000:1.0:1787119522.964763:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.964816:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5464 00000100:00100000:1.0:1787119522.964827:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633650688:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119522.964844:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119522.964879:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.964908:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.964936:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e40e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471677f expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.964958:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 264) 00010000:00010000:1.0:1787119522.964963:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 264) 00010000:00010000:1.0:1787119522.964972:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.965003:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119522.965043:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119522.965057:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653642240:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119522.965142:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cccb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.967834:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653642240:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.967872:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.967921:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633650688:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3095us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.967932:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5464 00000100:00100000:2.0:1787119522.969061:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633650560 00000100:00100000:2.0:1787119522.969074:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633650560 00000100:00100000:2.0:1787119522.969190:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5409 00000100:00100000:2.0:1787119522.969201:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633650560:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119522.969221:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119522.969242:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471678d expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.969276:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.969286:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 264) 00010000:00010000:2.0:1787119522.969291:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 264) 00010000:00010000:2.0:1787119522.969297:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 29 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.969329:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 25 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.969352:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 25 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.969367:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653642368:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119522.969476:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119522.973776:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119522.973861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633650816 00000100:00100000:3.0:1787119522.973872:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633650816 00010000:00010000:3.0:1787119522.973917:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 26 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.973970:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5465 00000100:00100000:3.0:1787119522.974000:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633650816:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119522.974020:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119522.974045:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 26 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.974074:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 26 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.974108:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 264) 00010000:00010000:3.0:1787119522.974113:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 264) 00010000:00010000:3.0:1787119522.974122:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 29 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.974132:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 29 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119522.974172:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 29 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119522.974198:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653642496:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119522.974277:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00010000:00010000:2.0:1787119522.976796:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe247cf3/0xcaba3de8463e40ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716786 expref: 26 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.976821:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653642368:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.976867:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 29 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.976888:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:2.0:1787119522.976940:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633650560:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7740us (13250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.976949:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5409 00000100:00100000:3.0:1787119522.980412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119522.980526:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633650944 00000100:00100000:0.0:1787119522.980536:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633650944 00000100:00100000:0.0:1787119522.980595:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5410 00000100:00100000:0.0:1787119522.980605:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633650944:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119522.980623:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119522.980642:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716794 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.980676:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.980686:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 264) 00010000:00010000:0.0:1787119522.980690:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 264) 00010000:00010000:0.0:1787119522.980695:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.980728:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119522.980755:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 28 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119522.980769:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653642624:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119522.980841:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61976d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119522.981012:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653642496:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119522.981030:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119522.981199:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633650816:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7210us (7433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119522.981208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5465 00000100:00100000:2.0:1787119522.988748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119522.988775:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633651072 00000100:00100000:2.0:1787119522.988784:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633651072 00010000:00010000:2.0:1787119522.988821:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 29 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.988853:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5466 00000100:00100000:2.0:1787119522.988861:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633651072:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119522.988877:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119522.988898:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 29 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.988926:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 29 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.988955:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 264) 00010000:00010000:2.0:1787119522.988960:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 264) 00010000:00010000:2.0:1787119522.988969:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.988987:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.989040:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.989056:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653642752:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119522.989138:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787119522.990798:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e40f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471678d expref: 29 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119522.990821:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653642624:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119522.990862:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119522.990878:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:2.0:1787119522.990940:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633650944:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10335us (10538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119522.990949:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5410 00000100:00100000:1.0:1787119523.003156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.003238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.003334:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633651200 00000100:00100000:3.0:1787119523.003344:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633651200 00000100:00100000:3.0:1787119523.003404:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5411 00000100:00100000:3.0:1787119523.003415:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633651200:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.003435:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.003475:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471679b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.003512:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.003528:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 264) 00010000:00010000:3.0:1787119523.003533:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 264) 00010000:00010000:3.0:1787119523.003538:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 30 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.003572:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.003599:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 25 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.003614:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653642880:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119523.003698:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.003718:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633651328 00000100:00100000:3.0:1787119523.003722:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633651328 00002000:00100000:3.0:1787119523.003752:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a50512c000 x1873929633651328/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.003762:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c000 with x1873929633651328 ext(278528->282623) 00010000:00010000:3.0:1787119523.003769:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.003783:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.003796:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c000 00000100:00100000:3.0:1787119523.003817:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1294 00000100:00100000:3.0:1787119523.003825:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633651328:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.004018:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633651328:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 192us (778us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119523.004027:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1294 00002000:00100000:3.0:1787119523.004035:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a50512c000 x1873929633651328/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.004043:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c000 with x1873929633651328 ext(278528->282623) 00010000:00010000:3.0:1787119523.004049:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.004062:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.004069:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c000 00000100:00100000:1.0:1787119523.006813:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653642752:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.006844:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119523.006913:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2376:x1873929633651072:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 18051us (18176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.006924:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5466 00000100:00100000:3.0:1787119523.007984:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653642880:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119523.008027:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 29 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.008052:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80800, rc 0) 00000100:00100000:3.0:1787119523.013876:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633651200:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10440us (10710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.013889:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5411 00000100:00100000:0.0:1787119523.017770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.017885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.018121:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633651584 00000100:00100000:1.0:1787119523.018132:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633651584 00010000:00010000:1.0:1787119523.018175:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.018332:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5467 00000100:00100000:1.0:1787119523.018342:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633651584:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.018357:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.018382:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.018408:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.018432:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e40fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716794 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.018475:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 264) 00010000:00010000:1.0:1787119523.018481:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 264) 00010000:00010000:1.0:1787119523.018490:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.018501:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.018541:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.018559:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653643008:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.018636:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.024971:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633651456 00000100:00100000:3.0:1787119523.024988:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633651456 00000100:00100000:3.0:1787119523.025177:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5412 00000100:00100000:3.0:1787119523.025202:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633651456:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.025222:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.025243:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167a2 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.025280:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.025289:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 264) 00010000:00010000:3.0:1787119523.025294:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 264) 00010000:00010000:3.0:1787119523.025299:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.025336:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.025364:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 28 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.025380:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653643136:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119523.025621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.025663:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653643008:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.025684:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.025715:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633651584:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7375us (7831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.025724:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5467 00000100:00100000:3.0:1787119523.025787:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.029174:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653643136:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119523.029220:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.029245:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80000, rc 0) 00000100:00100000:1.0:1787119523.029312:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633651456:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4112us (11551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.029321:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5412 00000100:00100000:2.0:1787119523.035237:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633651712 00000100:00100000:2.0:1787119523.035255:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633651712 00002000:00100000:2.0:1787119523.035320:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a512845880 x1873929633651712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.035338:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845880 with x1873929633651712 ext(278528->315391) 00010000:00010000:2.0:1787119523.035349:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.035383:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.035392:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845880 00000100:00100000:2.0:1787119523.035430:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1295 00000100:00100000:2.0:1787119523.035461:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633651712:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.043981:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633651712:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 8531us (18349us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119523.044006:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1295 00002000:00100000:2.0:1787119523.044019:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a512845880 x1873929633651712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.044030:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845880 with x1873929633651712 ext(278528->315391) 00010000:00010000:2.0:1787119523.044040:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.044071:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.044080:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845880 00000001:00080000:0.0:1787119523.048896:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968930 is committed 00000001:00080000:0.0:1787119523.048915:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968931 is committed 00000100:00100000:3.0:1787119523.051067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.051229:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633651840 00000100:00100000:2.0:1787119523.051240:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633651840 00000100:00100000:2.0:1787119523.051304:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5413 00000100:00100000:2.0:1787119523.051313:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633651840:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.051335:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.051355:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167a9 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.051385:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 264) 00010000:00010000:2.0:1787119523.051394:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.051401:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 264) 00010000:00010000:2.0:1787119523.051406:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 30 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.051492:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.051507:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 30 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.051521:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92800, rc 0) 00000100:00100000:2.0:1787119523.051581:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633651840:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 269us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.051588:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5413 00000100:00100000:1.0:1787119523.054205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.054529:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633651968 00000100:00100000:3.0:1787119523.054541:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633651968 00010000:00010000:3.0:1787119523.054588:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 30 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.054632:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5468 00000100:00100000:3.0:1787119523.054641:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2376:x1873929633651968:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.054656:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.054679:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 30 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.054706:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 30 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.054733:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e4102 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471679b expref: 30 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.054752:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 264) 00010000:00010000:3.0:1787119523.054757:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 264) 00010000:00010000:3.0:1787119523.054766:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.054777:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.054814:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.054827:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 25 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.054841:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653643392:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.055000:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.057933:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653643392:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.057961:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.058041:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633651968:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3400us (3848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.058053:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5468 00000100:00100000:0.0:1787119523.060381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.060483:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633652096 00000100:00100000:1.0:1787119523.060495:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633652096 00010000:00010000:1.0:1787119523.060542:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 26 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.060589:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5469 00000100:00100000:1.0:1787119523.060599:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633652096:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.060614:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.060636:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 26 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.060664:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 26 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.060692:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db79f08/0xcaba3de8463e4109 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a2 expref: 26 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.060712:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 264) 00010000:00010000:1.0:1787119523.060717:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 264) 00010000:00010000:1.0:1787119523.060726:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.060736:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.060777:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.060791:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653643520:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.060884:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.064237:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653643520:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119523.064266:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119523.064331:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2376:x1873929633652096:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3732us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.064342:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5469 00000100:00100000:3.0:1787119523.069569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.069681:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633652224 00000100:00100000:2.0:1787119523.069691:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633652224 00000100:00100000:2.0:1787119523.069752:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5414 00000100:00100000:2.0:1787119523.069762:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633652224:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.069781:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.069803:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167b0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.069836:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.069845:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 264) 00010000:00010000:2.0:1787119523.069850:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 264) 00010000:00010000:2.0:1787119523.069867:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.069901:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.069926:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 28 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.069947:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653643648:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119523.070050:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.072624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.072699:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633652352 00000100:00100000:3.0:1787119523.072708:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633652352 00010000:00010000:3.0:1787119523.072740:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 29 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.072775:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5470 00000100:00100000:3.0:1787119523.072782:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633652352:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.072794:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.072813:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 29 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.072834:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 29 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.072865:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 264) 00010000:00010000:3.0:1787119523.072869:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 264) 00010000:00010000:3.0:1787119523.072876:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.072884:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.072912:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.072922:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653643776:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.073004:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787119523.073371:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009186abcd/0xcaba3de8463e4110 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167a9 expref: 29 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.073386:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653643648:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119523.073417:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.073428:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93400, rc 0) 00000100:00100000:2.0:1787119523.073527:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633652224:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3767us (3970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.073535:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5414 00000100:00100000:0.0:1787119523.075491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.075613:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633652480 00000100:00100000:3.0:1787119523.075625:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633652480 00000100:00100000:3.0:1787119523.075692:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5415 00000100:00100000:3.0:1787119523.075701:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633652480:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.075722:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.075743:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167b7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.075779:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.075789:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 264) 00010000:00010000:3.0:1787119523.075794:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 264) 00010000:00010000:3.0:1787119523.075800:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 30 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.075834:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.075876:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 25 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.075892:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653643904:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119523.075967:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.077427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.077613:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633652608 00000100:00100000:2.0:1787119523.077621:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633652608 00002000:00100000:2.0:1787119523.077669:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a50512ed80 x1873929633652608/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.077681:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ed80 with x1873929633652608 ext(278528->282623) 00010000:00010000:2.0:1787119523.077689:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.077715:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.077730:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512ed80 00000100:00100000:2.0:1787119523.077767:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1296 00000100:00100000:2.0:1787119523.077777:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633652608:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.078063:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633652608:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 286us (642us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119523.078072:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1296 00002000:00100000:2.0:1787119523.078079:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a50512ed80 x1873929633652608/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.078087:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ed80 with x1873929633652608 ext(278528->282623) 00010000:00010000:2.0:1787119523.078093:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.078108:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.078115:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512ed80 00000100:00100000:3.0:1787119523.079566:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653643776:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.079594:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.079765:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2376:x1873929633652352:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6979us (7148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.079779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5470 00000100:00100000:3.0:1787119523.080231:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653643904:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119523.080257:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 29 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.080284:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80800, rc 0) 00000100:00100000:3.0:1787119523.080325:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633652480:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4624us (4885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.080331:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5415 00000100:00100000:2.0:1787119523.083493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.083585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.083658:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633652864 00000100:00100000:3.0:1787119523.083668:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633652864 00010000:00010000:3.0:1787119523.083711:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.083757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5471 00000100:00100000:3.0:1787119523.083768:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633652864:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.083785:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.083809:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.083837:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.083864:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c699eb51/0xcaba3de8463e4117 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b0 expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.083880:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 264) 00010000:00010000:3.0:1787119523.083885:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 264) 00010000:00010000:3.0:1787119523.083893:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.083904:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.083945:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.083961:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653644032:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.084081:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.084828:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633652736 00000100:00100000:1.0:1787119523.084835:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633652736 00000100:00100000:1.0:1787119523.085090:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5416 00000100:00100000:1.0:1787119523.085100:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633652736:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.085115:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.085131:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167be expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.085155:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.085164:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 264) 00010000:00010000:1.0:1787119523.085168:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 264) 00010000:00010000:1.0:1787119523.085173:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.085202:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.085225:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 28 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.085238:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653644160:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119523.085302:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986000 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.087689:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653644160:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119523.087727:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.087751:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119523.087811:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633652736:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2712us (4329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.087820:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5416 00000100:00100000:3.0:1787119523.088033:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653644032:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.088046:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.088068:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633652864:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4303us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.088077:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5471 00000100:00100000:0.0:1787119523.091717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.091840:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633652992 00000100:00100000:2.0:1787119523.091849:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633652992 00002000:00100000:2.0:1787119523.091970:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a634038000 x1873929633652992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.092076:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633652992 ext(278528->315391) 00010000:00010000:2.0:1787119523.092088:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.092117:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.092125:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634038000 00000100:00100000:2.0:1787119523.092261:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1297 00000100:00100000:2.0:1787119523.092273:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633652992:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.096680:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633652992:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4397us (4962us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119523.096694:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1297 00002000:00100000:2.0:1787119523.096708:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (278528->315391) req@ffff92a634038000 x1873929633652992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.096719:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038000 with x1873929633652992 ext(278528->315391) 00010000:00010000:2.0:1787119523.096730:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.096761:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.096770:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634038000 00000100:00100000:0.0:1787119523.099986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.100080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.100169:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633653248 00000100:00100000:2.0:1787119523.100180:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633653248 00010000:00010000:2.0:1787119523.100228:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.100269:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5472 00000100:00100000:2.0:1787119523.100279:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2374:x1873929633653248:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119523.100293:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119523.100317:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.100345:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.100374:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006056a8c6/0xcaba3de8463e411e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167b7 expref: 29 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.100393:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 264) 00010000:00010000:2.0:1787119523.100399:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 264) 00010000:00010000:2.0:1787119523.100408:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.100417:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.100508:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.100530:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653644288:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119523.100615:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.101662:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633653120 00000100:00100000:3.0:1787119523.101672:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633653120 00000100:00100000:2.0:1787119523.101939:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5417 00000100:00100000:2.0:1787119523.101949:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633653120:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.101965:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.101982:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167c5 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.102023:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.102033:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 264) 00010000:00010000:2.0:1787119523.102036:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 264) 00010000:00010000:2.0:1787119523.102040:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 30 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.102067:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 25 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.102091:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 25 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.102102:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653644416:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119523.102188:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.106154:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653644416:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119523.106209:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 30 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.106232:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00000100:00100000:3.0:1787119523.106300:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633653120:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4352us (6323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.106310:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5417 00000100:00100000:2.0:1787119523.106509:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653644288:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119523.106525:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119523.106559:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2374:x1873929633653248:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6281us (6479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.106570:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5472 00000100:00100000:0.0:1787119523.108251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.108395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633653376 00000100:00100000:1.0:1787119523.108406:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633653376 00010000:00010000:1.0:1787119523.108472:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 26 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.108503:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5473 00000100:00100000:1.0:1787119523.108513:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633653376:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.108526:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.108548:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 26 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.108575:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 26 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.108601:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4125 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167be expref: 26 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.108619:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 264) 00010000:00010000:1.0:1787119523.108624:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 264) 00010000:00010000:1.0:1787119523.108633:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 28 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.108645:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 28 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.108686:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 28 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.108700:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653644544:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.108785:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986000 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.113985:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653644544:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.114025:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.114088:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2376:x1873929633653376:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5576us (5844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.114099:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5473 00000100:00100000:2.0:1787119523.123416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.123483:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633653504 00000100:00100000:0.0:1787119523.123493:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633653504 00000100:00100000:0.0:1787119523.123650:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5418 00000100:00100000:0.0:1787119523.123661:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633653504:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.123680:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.123701:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167cc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.123735:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 28 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.123746:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 264) 00010000:00010000:0.0:1787119523.123752:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 264) 00010000:00010000:0.0:1787119523.123758:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.123794:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 28 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.123820:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 28 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.123835:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653644672:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.123944:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.126376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.126473:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633653632 00000100:00100000:3.0:1787119523.126483:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633653632 00010000:00010000:3.0:1787119523.126521:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 29 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.126570:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5474 00000100:00100000:3.0:1787119523.126580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633653632:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.126594:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.126617:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 29 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.126644:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 29 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.126672:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 264) 00010000:00010000:3.0:1787119523.126677:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 264) 00010000:00010000:3.0:1787119523.126685:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.126703:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.126744:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.126758:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653644800:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.126828:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00010000:00010000:0.0:1787119523.126976:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e412c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167c5 expref: 29 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.127003:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653644672:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.127028:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 26 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.127040:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119523.127071:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633653504:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3412us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.127078:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5418 00000100:00100000:3.0:1787119523.130636:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653644800:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.130664:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.130723:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2376:x1873929633653632:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4144us (4356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.130734:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5474 00000100:00100000:1.0:1787119523.133561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.133694:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633653760 00000100:00100000:2.0:1787119523.133704:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633653760 00002000:00100000:2.0:1787119523.133766:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a50512d500 x1873929633653760/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.133779:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633653760 ext(278528->282623) 00002000:00010000:2.0:1787119523.133785:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d500 00000100:00100000:2.0:1787119523.133819:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10678 00000100:00100000:2.0:1787119523.133829:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633653760:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.134051:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633653760:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 222us (499us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119523.134058:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10678 00002000:00100000:2.0:1787119523.134065:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a50512d500 x1873929633653760/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.134073:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512d500 with x1873929633653760 ext(278528->282623) 00002000:00010000:2.0:1787119523.134076:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512d500 00000100:00100000:1.0:1787119523.137209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.137298:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633653888 00000100:00100000:3.0:1787119523.137308:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633653888 00000100:00100000:3.0:1787119523.137366:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5419 00000100:00100000:3.0:1787119523.137377:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:33946:x1873929633653888:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.137396:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.137416:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167d3 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.137482:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.137492:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 264) 00010000:00010000:3.0:1787119523.137497:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 264) 00010000:00010000:3.0:1787119523.137502:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 29 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.137536:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 25 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.137561:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 25 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.137575:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653644928:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119523.137655:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.140532:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.140672:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633654016 00000100:00100000:3.0:1787119523.140681:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633654016 00002000:00100000:3.0:1787119523.140726:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a519d26a00 x1873929633654016/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.140738:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26a00 with x1873929633654016 ext(282624->286719) 00010000:00010000:3.0:1787119523.140747:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.140774:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.140782:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d26a00 00000100:00100000:3.0:1787119523.140812:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1298 00000100:00100000:3.0:1787119523.140820:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633654016:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.141012:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633654016:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 192us (489us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119523.141020:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1298 00002000:00100000:3.0:1787119523.141026:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a519d26a00 x1873929633654016/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.141035:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26a00 with x1873929633654016 ext(282624->286719) 00010000:00010000:3.0:1787119523.141040:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.141053:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 26 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.141060:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d26a00 00000100:00100000:2.0:1787119523.142821:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653644928:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119523.142855:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 29 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.142879:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d81600, rc 0) 00000100:00100000:2.0:1787119523.142954:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633653888:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5578us (5758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.142962:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5419 00000100:00100000:1.0:1787119523.145054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.146373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.146477:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633654272 00000100:00100000:3.0:1787119523.146487:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633654272 00000100:00100000:3.0:1787119523.146533:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5420 00000100:00100000:3.0:1787119523.146542:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633654272:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.146558:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.146577:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167da expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.146608:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 264) 00010000:00010000:3.0:1787119523.146613:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 264) 00010000:00010000:3.0:1787119523.146619:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.146632:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.146645:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80200, rc 0) 00000100:00100000:3.0:1787119523.146707:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633654272:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 165us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.146717:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5420 00000100:00100000:2.0:1787119523.147274:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633654144 00000100:00100000:2.0:1787119523.147280:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633654144 00002000:00100000:2.0:1787119523.147315:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a519d25180 x1873929633654144/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.147325:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25180 with x1873929633654144 ext(278528->282623) 00010000:00010000:2.0:1787119523.147331:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 27 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.147359:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 27 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.147367:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d25180 00000100:00100000:2.0:1787119523.147402:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1299 00000100:00100000:2.0:1787119523.147411:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633654144:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119523.147811:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633654144:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 400us (2766us total) trans 4294969253 rc 0/0 00000100:00100000:2.0:1787119523.147818:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1299 00002000:00100000:2.0:1787119523.147824:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a519d25180 x1873929633654144/t4294969253(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/448 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.147837:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25180 with x1873929633654144 ext(278528->282623) 00010000:00010000:2.0:1787119523.147843:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.147857:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.147865:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d25180 00000100:00100000:1.0:1787119523.151478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.151580:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633654400 00000100:00100000:0.0:1787119523.151591:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633654400 00010000:00010000:0.0:1787119523.151635:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.151679:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5475 00000100:00100000:0.0:1787119523.151689:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2373:x1873929633654400:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.151704:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.151728:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.151756:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.151785:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4133 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [278528->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167cc expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.151806:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 264) 00010000:00010000:0.0:1787119523.151811:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 264) 00010000:00010000:0.0:1787119523.151820:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.151831:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.151841:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 264) 00010000:00010000:0.0:1787119523.151844:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 264) 00010000:00010000:0.0:1787119523.151848:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.151873:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.151910:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.151926:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653645056:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.152041:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.152051:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653645184:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.152075:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.158758:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653645056:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.158776:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653645184:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.158809:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.158890:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2373:x1873929633654400:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7199us (7465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.158901:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5475 00000100:00100000:2.0:1787119523.161780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.161893:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633654528 00000100:00100000:1.0:1787119523.161902:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633654528 00002000:00100000:1.0:1787119523.161953:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a63eb2ad80 x1873929633654528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.161965:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633654528 ext(278528->282623) 00002000:00010000:1.0:1787119523.161971:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ad80 00000100:00100000:1.0:1787119523.162023:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10679 00000100:00100000:1.0:1787119523.162033:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633654528:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.162253:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633654528:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 221us (485us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119523.162261:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10679 00002000:00100000:1.0:1787119523.162267:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a63eb2ad80 x1873929633654528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.162275:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2ad80 with x1873929633654528 ext(278528->282623) 00002000:00010000:1.0:1787119523.162279:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2ad80 00000100:00100000:1.0:1787119523.166269:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.166370:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633654656 00000100:00100000:3.0:1787119523.166383:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633654656 00000100:00100000:3.0:1787119523.166489:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5421 00000100:00100000:3.0:1787119523.166499:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633654656:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.166519:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.166541:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167e1 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.166576:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.166587:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 264) 00010000:00010000:3.0:1787119523.166592:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 264) 00010000:00010000:3.0:1787119523.166597:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.166631:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.166658:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 27 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.166673:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653645312:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119523.166816:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.168834:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.170809:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633654784 00000100:00100000:0.0:1787119523.170824:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633654784 00002000:00100000:0.0:1787119523.170897:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a63eb29f80 x1873929633654784/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.170916:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633654784 ext(282624->286719) 00010000:00010000:0.0:1787119523.170927:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.170960:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.170969:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb29f80 00000100:00100000:0.0:1787119523.171014:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1300 00000100:00100000:0.0:1787119523.171025:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633654784:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.171269:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633654784:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 246us (2449us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.171277:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1300 00002000:00100000:0.0:1787119523.171284:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a63eb29f80 x1873929633654784/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.171293:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29f80 with x1873929633654784 ext(282624->286719) 00010000:00010000:0.0:1787119523.171299:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.171312:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.171319:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb29f80 00000100:00100000:2.0:1787119523.174759:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653645312:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119523.174803:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.174831:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d80e00, rc 0) 00000100:00100000:2.0:1787119523.174910:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633654656:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8411us (8651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.174919:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5421 00000100:00100000:1.0:1787119523.176708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.176873:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633654912 00000100:00100000:2.0:1787119523.176886:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633654912 00002000:00100000:2.0:1787119523.176935:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff92a5098a6680 x1873929633654912/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.176946:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6680 with x1873929633654912 ext(286720->290815) 00010000:00010000:2.0:1787119523.176959:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.177005:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.177014:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a6680 00000100:00100000:2.0:1787119523.177058:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1301 00000100:00100000:2.0:1787119523.177069:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2374:x1873929633654912:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.178573:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2374:x1873929633654912:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1495us (1865us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119523.178584:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1301 00002000:00100000:2.0:1787119523.178595:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff92a5098a6680 x1873929633654912/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.178606:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6680 with x1873929633654912 ext(286720->290815) 00010000:00010000:2.0:1787119523.178616:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.178641:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.178649:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a6680 00000100:00100000:1.0:1787119523.180384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.182348:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633655040 00000100:00100000:0.0:1787119523.182365:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633655040 00002000:00100000:0.0:1787119523.182423:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a5098a7800 x1873929633655040/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.182435:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7800 with x1873929633655040 ext(282624->286719) 00010000:00010000:0.0:1787119523.182471:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.182502:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 28 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.182510:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a7800 00000100:00100000:0.0:1787119523.182547:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1302 00000100:00100000:0.0:1787119523.182557:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633655040:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119523.182955:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633655040:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 399us (2581us total) trans 4294969254 rc 0/0 00000100:00100000:0.0:1787119523.182963:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1302 00002000:00100000:0.0:1787119523.182970:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a5098a7800 x1873929633655040/t4294969254(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/448 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.182978:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a7800 with x1873929633655040 ext(282624->286719) 00010000:00010000:0.0:1787119523.182983:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.183013:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.183021:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a7800 00000100:00100000:1.0:1787119523.185624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.185788:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633655168 00000100:00100000:0.0:1787119523.185800:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633655168 00010000:00010000:0.0:1787119523.185843:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.185893:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5476 00000100:00100000:0.0:1787119523.185902:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633655168:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.185916:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.185942:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.185971:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.186121:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022f06d50/0xcaba3de8463e4141 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167da expref: 30 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.186139:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 264) 00010000:00010000:0.0:1787119523.186143:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 264) 00010000:00010000:0.0:1787119523.186151:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 29 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.186160:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 29 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.186261:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 29 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.186276:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653645440:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.186404:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.187847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.188421:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633655296 00000100:00100000:0.0:1787119523.188432:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633655296 00000100:00100000:0.0:1787119523.188515:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5422 00000100:00100000:0.0:1787119523.188526:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+30:33957:x1873929633655296:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.188544:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.188564:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167e8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.188593:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 29 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.188603:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 264) 00010000:00010000:0.0:1787119523.188608:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 264) 00010000:00010000:0.0:1787119523.188613:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.188645:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 29 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.188675:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 29 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.188690:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653645568:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.188778:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.194008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.194109:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633655424 00000100:00100000:2.0:1787119523.194119:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633655424 00002000:00100000:2.0:1787119523.194166:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (282624->319487) req@ffff92a634038a80 x1873929633655424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.194194:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038a80 with x1873929633655424 ext(282624->319487) 00010000:00010000:2.0:1787119523.194205:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.194237:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.194245:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634038a80 00000100:00100000:2.0:1787119523.194279:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1303 00000100:00100000:2.0:1787119523.194289:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2375:x1873929633655424:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.194760:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653645440:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.194785:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119523.194828:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+31:2375:x1873929633655168:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8926us (9212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.194837:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5476 00000100:00100000:2.0:1787119523.196909:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653645568:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119523.196948:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 30 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.196971:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:2.0:1787119523.197036:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+30:33957:x1873929633655296:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8511us (9196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.197044:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5422 00000100:00100000:2.0:1787119523.199846:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2375:x1873929633655424:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5548us (5850us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119523.199871:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1303 00002000:00100000:2.0:1787119523.199884:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (282624->319487) req@ffff92a634038a80 x1873929633655424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.199902:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038a80 with x1873929633655424 ext(282624->319487) 00010000:00010000:2.0:1787119523.199913:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.199944:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.199953:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634038a80 00000100:00100000:0.0:1787119523.205292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.205486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.205573:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633655680 00000100:00100000:3.0:1787119523.205584:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633655680 00010000:00010000:3.0:1787119523.205626:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.205662:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5477 00000100:00100000:3.0:1787119523.205672:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2376:x1873929633655680:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.205689:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.205716:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.205743:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.205773:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d479a01/0xcaba3de8463e4148 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [282624->18446744073709551615] (req 282624->286719) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e1 expref: 30 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.205792:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 264) 00010000:00010000:3.0:1787119523.205797:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 264) 00010000:00010000:3.0:1787119523.205805:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.205815:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.205853:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.205869:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653645696:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.205958:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.208615:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653645696:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.208644:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119523.208699:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2376:x1873929633655680:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3028us (3213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.208712:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5477 00000100:00100000:2.0:1787119523.209412:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633655552 00000100:00100000:2.0:1787119523.209420:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633655552 00000100:00100000:2.0:1787119523.209499:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5423 00000100:00100000:2.0:1787119523.209509:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:33946:x1873929633655552:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.209528:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.209549:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167ef expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.209581:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 264) 00010000:00010000:2.0:1787119523.209587:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 264) 00010000:00010000:2.0:1787119523.209599:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167ef expref: 30 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.209615:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167ef expref: 30 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.209627:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92200, rc 0) 00000100:00100000:2.0:1787119523.209722:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633655552:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 215us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.209729:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5423 00000100:00100000:3.0:1787119523.230905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.230972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.231077:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633655936 00000100:00100000:2.0:1787119523.231089:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633655936 00002000:00100000:2.0:1787119523.231142:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff92a512846680 x1873929633655936/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.231153:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846680 with x1873929633655936 ext(286720->290815) 00002000:00010000:2.0:1787119523.231159:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846680 00000100:00100000:2.0:1787119523.231185:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633655808 00000100:00100000:2.0:1787119523.231189:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633655808 00002000:00100000:2.0:1787119523.231204:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a512844700 x1873929633655808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.231211:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844700 with x1873929633655808 ext(282624->286719) 00002000:00010000:2.0:1787119523.231214:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844700 00000100:00100000:2.0:1787119523.231241:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10680 00000100:00100000:2.0:1787119523.231250:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633655936:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.231272:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10681 00000100:00100000:3.0:1787119523.231281:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2373:x1873929633655808:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.231480:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2373:x1873929633655808:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 200us (507us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119523.231487:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10681 00002000:00100000:3.0:1787119523.231493:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a512844700 x1873929633655808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.231501:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844700 with x1873929633655808 ext(282624->286719) 00002000:00010000:3.0:1787119523.231504:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844700 00000100:00100000:2.0:1787119523.234844:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633655936:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3583us (3939us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119523.234865:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10680 00002000:00100000:2.0:1787119523.234878:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff92a512846680 x1873929633655936/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.234889:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846680 with x1873929633655936 ext(286720->290815) 00002000:00010000:2.0:1787119523.234895:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846680 00000100:00100000:2.0:1787119523.238633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.242291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.242402:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633656192 00000100:00100000:2.0:1787119523.242412:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633656192 00002000:00100000:2.0:1787119523.242505:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a519cd6680 x1873929633656192/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.242519:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6680 with x1873929633656192 ext(290816->294911) 00002000:00010000:2.0:1787119523.242526:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6680 00000100:00100000:2.0:1787119523.242552:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10682 00000100:00100000:2.0:1787119523.242562:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633656192:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.242750:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633656192:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 190us (486us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119523.242755:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10682 00002000:00100000:2.0:1787119523.242760:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a519cd6680 x1873929633656192/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.242765:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6680 with x1873929633656192 ext(290816->294911) 00002000:00010000:2.0:1787119523.242768:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6680 00000100:00100000:0.0:1787119523.243070:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633656064 00000100:00100000:0.0:1787119523.243075:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633656064 00000100:00100000:0.0:1787119523.243122:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5424 00000100:00100000:0.0:1787119523.243131:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:33946:x1873929633656064:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.243142:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.243162:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167f6 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.243203:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.243215:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 264) 00010000:00010000:0.0:1787119523.243219:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 264) 00010000:00010000:0.0:1787119523.243225:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.243274:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 29 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.243309:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 29 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.243326:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653645824:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.243474:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.245410:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653645824:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.245475:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.245497:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39600, rc 0) 00000100:00100000:0.0:1787119523.245561:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:33946:x1873929633656064:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2431us (6941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.245570:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5424 00000100:00100000:3.0:1787119523.247253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.247353:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633656320 00000100:00100000:0.0:1787119523.247362:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633656320 00002000:00100000:0.0:1787119523.247408:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (286720->294911) req@ffff92a62a125f80 x1873929633656320/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 8680/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.247420:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125f80 with x1873929633656320 ext(286720->294911) 00010000:00010000:0.0:1787119523.247430:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 30 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.247489:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 30 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.247497:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a125f80 00000100:00100000:0.0:1787119523.247524:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1304 00000100:00100000:0.0:1787119523.247540:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633656320:12345-192.168.201.59@tcp:4:kworker.0 00000100:00100000:1.0:1787119523.247698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.247892:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633656448 00000100:00100000:2.0:1787119523.247897:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633656448 00000100:00100000:2.0:1787119523.247937:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5425 00000100:00100000:2.0:1787119523.247944:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+32:33957:x1873929633656448:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.247953:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.247968:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047167fd expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.248004:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 264) 00010000:00010000:2.0:1787119523.248010:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 264) 00010000:00010000:2.0:1787119523.248016:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 34 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.248027:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 34 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.248040:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f93c00, rc 0) 00000100:00100000:0.0:1787119523.248116:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633656320:12345-192.168.201.59@tcp:4:kworker.0 Request processed in 578us (906us total) trans 4294969255 rc 0/0 00000100:00100000:0.0:1787119523.248124:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1304 00002000:00100000:0.0:1787119523.248131:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (286720->294911) req@ffff92a62a125f80 x1873929633656320/t4294969255(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 8680/448 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 0/0 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.248140:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125f80 with x1873929633656320 ext(286720->294911) 00010000:00010000:0.0:1787119523.248146:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 34 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.248162:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 34 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.248169:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a125f80 00000100:00100000:2.0:1787119523.250232:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633656448:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2274us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.250244:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5425 00000100:00100000:3.0:1787119523.252338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.252515:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633656576 00000100:00100000:0.0:1787119523.252527:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633656576 00010000:00010000:0.0:1787119523.252572:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 33 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.252625:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5478 00000100:00100000:0.0:1787119523.252635:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2374:x1873929633656576:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.252654:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.252678:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 33 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.252706:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 33 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.252733:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e414f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167e8 expref: 33 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.252751:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 264) 00010000:00010000:0.0:1787119523.252756:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 264) 00010000:00010000:0.0:1787119523.252765:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.252775:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.252784:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 264) 00010000:00010000:0.0:1787119523.252786:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 264) 00010000:00010000:0.0:1787119523.252790:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 32 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.252800:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 32 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.252830:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 32 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.252841:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653645952:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.252935:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.252945:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653646080:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.252968:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.262654:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653645952:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.262669:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653646080:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.262694:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.262751:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2374:x1873929633656576:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10116us (10420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.262762:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5478 00000100:00100000:1.0:1787119523.268578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.270500:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633656704 00000100:00100000:2.0:1787119523.270516:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633656704 00002000:00100000:2.0:1787119523.270578:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff92a5098a6d80 x1873929633656704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.270591:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633656704 ext(286720->290815) 00002000:00010000:2.0:1787119523.270597:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6d80 00000100:00100000:2.0:1787119523.270633:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10683 00000100:00100000:2.0:1787119523.270643:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2376:x1873929633656704:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.270875:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2376:x1873929633656704:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 233us (2307us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119523.270883:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10683 00002000:00100000:2.0:1787119523.270891:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff92a5098a6d80 x1873929633656704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.270900:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6d80 with x1873929633656704 ext(286720->290815) 00002000:00010000:2.0:1787119523.270904:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6d80 00000100:00100000:3.0:1787119523.277864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.277916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.278045:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633656832 00000100:00100000:2.0:1787119523.278056:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633656832 00000100:00100000:2.0:1787119523.278112:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5426 00000100:00100000:2.0:1787119523.278120:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:33946:x1873929633656832:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.278143:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.278161:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716804 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.278192:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.278202:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 264) 00010000:00010000:2.0:1787119523.278206:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 264) 00010000:00010000:2.0:1787119523.278212:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 32 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.278249:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.278270:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 31 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.278296:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653646208:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119523.278368:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.283414:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653646208:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.283480:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633656960 00010000:00010000:2.0:1787119523.283483:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 32 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.283488:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633656960 00010000:00010000:2.0:1787119523.283510:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a505f92c00, rc 0) 00002000:00100000:0.0:1787119523.283536:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a62a127800 x1873929633656960/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.283545:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127800 with x1873929633656960 ext(290816->294911) 00010000:00010000:0.0:1787119523.283552:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.283562:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:33946:x1873929633656832:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5443us (5713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.283571:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5426 00010000:00010000:0.0:1787119523.283575:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.283583:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a127800 00000100:00100000:0.0:1787119523.284944:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1305 00000100:00100000:1.0:1787119523.285026:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2376:x1873929633656960:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.285599:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2376:x1873929633656960:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 639us (7679us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119523.285610:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1305 00002000:00100000:1.0:1787119523.285620:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a62a127800 x1873929633656960/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.285631:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127800 with x1873929633656960 ext(290816->294911) 00010000:00010000:1.0:1787119523.285641:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.285677:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119523.285685:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a127800 00000100:00100000:1.0:1787119523.293045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.293343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.293603:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633657088 00000100:00100000:3.0:1787119523.293614:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633657088 00000100:00100000:3.0:1787119523.293666:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5427 00000100:00100000:3.0:1787119523.293677:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+32:33957:x1873929633657088:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.293696:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.293718:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471680b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.293754:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 264) 00010000:00010000:3.0:1787119523.293763:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.293770:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 264) 00010000:00010000:3.0:1787119523.293774:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.293818:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.293833:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.293847:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:3.0:1787119523.294077:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633657088:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 401us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.294084:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5427 00000100:00100000:0.0:1787119523.294221:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633657216 00000100:00100000:0.0:1787119523.294227:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633657216 00010000:00010000:0.0:1787119523.294252:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 33 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.294321:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5479 00000100:00100000:0.0:1787119523.294330:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633657216:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.294342:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.294368:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 33 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.294406:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 33 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.294428:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac6910e/0xcaba3de8463e4164 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167fd expref: 33 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.294469:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 264) 00010000:00010000:0.0:1787119523.294475:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 264) 00010000:00010000:0.0:1787119523.294482:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.294490:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.294517:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.294531:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 31 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.294545:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653646464:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.294606:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.300809:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653646464:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.300839:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.300913:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2376:x1873929633657216:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6582us (7570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.300924:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5479 00000100:00100000:2.0:1787119523.305585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.305692:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633657344 00000100:00100000:3.0:1787119523.305704:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633657344 00002000:00100000:3.0:1787119523.305757:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (290816->327679) req@ffff92a63eb2a680 x1873929633657344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.305769:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a680 with x1873929633657344 ext(290816->327679) 00010000:00010000:3.0:1787119523.305779:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 32 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.305811:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 32 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.305819:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2a680 00000100:00100000:3.0:1787119523.305906:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1306 00000100:00100000:3.0:1787119523.305918:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2375:x1873929633657344:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.310556:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2375:x1873929633657344:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4358us (4886us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119523.310570:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1306 00002000:00100000:3.0:1787119523.310583:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (290816->327679) req@ffff92a63eb2a680 x1873929633657344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.310594:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2a680 with x1873929633657344 ext(290816->327679) 00010000:00010000:3.0:1787119523.310606:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 32 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.310637:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 32 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.310646:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb2a680 00000100:00100000:2.0:1787119523.319129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.319610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.320567:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633657600 00000100:00100000:0.0:1787119523.320567:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633657472 00000100:00100000:1.0:1787119523.320580:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633657600 00000100:00100000:0.0:1787119523.320580:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633657472 00010000:00010000:1.0:1787119523.320629:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 33 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.320644:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5428 00000100:00100000:1.0:1787119523.320655:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5480 00000100:00100000:0.0:1787119523.320655:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:33946:x1873929633657472:12345-192.168.201.59@tcp:101:mmap_sanity.0 00000100:00100000:1.0:1787119523.320660:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2373:x1873929633657600:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.320671:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.320674:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.320687:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716812 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.320699:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 34 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.320714:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 264) 00010000:00010000:0.0:1787119523.320721:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.320729:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 264) 00010000:00010000:0.0:1787119523.320734:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 34 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.322071:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 34 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.322148:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.322169:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 34 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.322265:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcabc47b/0xcaba3de8463e416b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716804 expref: 34 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.322366:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 264) 00010000:00010000:1.0:1787119523.322371:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 264) 00010000:00010000:1.0:1787119523.322380:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.322391:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.322426:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.322479:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 31 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.322495:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d27100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653646720:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.322641:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986540 going to sleep for 11 seconds 00010000:00010000:0.0:1787119523.322709:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119523.322744:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:33946:x1873929633657472:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2090us (3625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.322753:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5428 00000100:00100000:2.0:1787119523.326378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.326407:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d27100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653646720:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.326434:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.326489:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633657728 00000100:00100000:0.0:1787119523.326497:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633657728 00010000:00010000:0.0:1787119523.326539:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 32 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.326587:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5481 00000100:00100000:0.0:1787119523.326598:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2375:x1873929633657728:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.326618:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.326642:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 32 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.326668:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 32 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.326695:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4172 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471680b expref: 32 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.326710:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 264) 00010000:00010000:0.0:1787119523.326715:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 264) 00010000:00010000:0.0:1787119523.326723:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.326734:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.326772:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.326787:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653646848:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.327077:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.327248:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2373:x1873929633657600:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6586us (7636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.327257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5480 00000100:00100000:0.0:1787119523.338924:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653646848:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.338951:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.339023:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+31:2375:x1873929633657728:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12425us (12655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.339035:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5481 00000100:00100000:2.0:1787119523.341559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.341705:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633657856 00000100:00100000:3.0:1787119523.341718:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633657856 00000100:00100000:3.0:1787119523.341787:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5429 00000100:00100000:3.0:1787119523.341798:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+31:33957:x1873929633657856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.341816:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.341836:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716819 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.344583:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.344605:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 264) 00010000:00010000:3.0:1787119523.344610:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 264) 00010000:00010000:3.0:1787119523.344617:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 32 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.344662:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.344691:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 31 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.344712:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653646976:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119523.344834:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.345113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.345323:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633657984 00000100:00100000:0.0:1787119523.345332:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633657984 00002000:00100000:0.0:1787119523.345380:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (290816->327679) req@ffff92a63eb29500 x1873929633657984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.345391:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633657984 ext(290816->327679) 00010000:00010000:0.0:1787119523.345400:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.345420:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.345428:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb29500 00000100:00100000:0.0:1787119523.345486:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1307 00000100:00100000:0.0:1787119523.345496:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2375:x1873929633657984:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.350125:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653646976:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119523.350168:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 32 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.350210:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:3.0:1787119523.350287:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+32:33957:x1873929633657856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8490us (8738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.350297:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5429 00000100:00100000:0.0:1787119523.352790:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2375:x1873929633657984:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7285us (7668us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119523.352803:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1307 00002000:00100000:0.0:1787119523.352816:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (290816->327679) req@ffff92a63eb29500 x1873929633657984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.352827:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb29500 with x1873929633657984 ext(290816->327679) 00010000:00010000:0.0:1787119523.352837:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.352879:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.352888:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb29500 00000100:00100000:1.0:1787119523.355637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.357029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.357129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633658240 00000100:00100000:1.0:1787119523.357153:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633658240 00010000:00010000:1.0:1787119523.357211:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.357254:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5482 00000100:00100000:1.0:1787119523.357263:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2375:x1873929633658240:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.357279:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.357301:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.357328:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.357355:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4179 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716812 expref: 32 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.357376:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 264) 00010000:00010000:1.0:1787119523.357382:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 264) 00010000:00010000:1.0:1787119523.357392:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.357403:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.357498:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.357516:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653647104:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.357614:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.358826:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633658112 00000100:00100000:0.0:1787119523.358838:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633658112 00000100:00100000:0.0:1787119523.358909:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5430 00000100:00100000:0.0:1787119523.358918:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:33946:x1873929633658112:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.358934:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.358951:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716820 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.358983:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.359007:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 264) 00010000:00010000:0.0:1787119523.359011:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 264) 00010000:00010000:0.0:1787119523.359017:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 33 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.359047:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 31 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.359071:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 31 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.359092:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653647232:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.359229:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.362802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.362898:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633658368 00000100:00100000:0.0:1787119523.362908:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633658368 00002000:00100000:0.0:1787119523.362961:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a5066dc700 x1873929633658368/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.362993:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc700 with x1873929633658368 ext(290816->294911) 00010000:00010000:0.0:1787119523.363005:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.363035:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.363044:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dc700 00000100:00100000:0.0:1787119523.363080:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1308 00000100:00100000:0.0:1787119523.363090:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2376:x1873929633658368:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.363568:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2376:x1873929633658368:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 478us (776us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.363577:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1308 00002000:00100000:0.0:1787119523.363584:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a5066dc700 x1873929633658368/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.363592:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc700 with x1873929633658368 ext(290816->294911) 00010000:00010000:0.0:1787119523.363599:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.363615:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.363622:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dc700 00000100:00100000:1.0:1787119523.366571:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653647104:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.366607:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119523.366666:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2375:x1873929633658240:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9404us (9643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.366677:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5482 00000100:00100000:2.0:1787119523.369493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.369608:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633658624 00000100:00100000:1.0:1787119523.369619:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633658624 00002000:00100000:1.0:1787119523.369673:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a5066df800 x1873929633658624/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.369686:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df800 with x1873929633658624 ext(290816->294911) 00010000:00010000:1.0:1787119523.369742:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.369775:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 32 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119523.369784:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066df800 00000100:00100000:1.0:1787119523.369819:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1309 00000100:00100000:1.0:1787119523.369829:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2375:x1873929633658624:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119523.370253:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633658624:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 423us (770us total) trans 4294969256 rc 0/0 00000100:00100000:1.0:1787119523.370262:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1309 00002000:00100000:1.0:1787119523.370270:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a5066df800 x1873929633658624/t4294969256(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/448 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.370278:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df800 with x1873929633658624 ext(290816->294911) 00010000:00010000:1.0:1787119523.370285:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 34 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.370302:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 34 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119523.370308:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066df800 00000100:00100000:3.0:1787119523.371881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.372014:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653647232:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.372046:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 32 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.372066:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39200, rc 0) 00000100:00100000:0.0:1787119523.372118:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:33946:x1873929633658112:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13201us (16495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.372126:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5430 00000100:00100000:1.0:1787119523.373222:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633658496 00000100:00100000:1.0:1787119523.373234:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633658496 00002000:00100000:1.0:1787119523.373282:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (294912->299007) req@ffff92a62a127480 x1873929633658496/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.373293:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127480 with x1873929633658496 ext(294912->299007) 00010000:00010000:1.0:1787119523.373302:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 34 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.373331:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 34 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119523.373340:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a127480 00000100:00100000:1.0:1787119523.373374:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1310 00000100:00100000:1.0:1787119523.373384:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633658496:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.373676:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633658496:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 292us (1800us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119523.373684:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1310 00002000:00100000:1.0:1787119523.373691:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (294912->299007) req@ffff92a62a127480 x1873929633658496/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.373699:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127480 with x1873929633658496 ext(294912->299007) 00010000:00010000:1.0:1787119523.373704:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 34 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.373719:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 36 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 34 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119523.373726:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a127480 00000100:00100000:3.0:1787119523.378211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.378560:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633658752 00000100:00100000:1.0:1787119523.378574:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633658752 00000100:00100000:1.0:1787119523.378642:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5431 00000100:00100000:1.0:1787119523.378653:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633658752:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.378673:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.378695:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716827 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.378734:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 264) 00010000:00010000:1.0:1787119523.378740:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 264) 00010000:00010000:1.0:1787119523.378747:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 35 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.378761:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 35 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.378774:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:1.0:1787119523.378847:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633658752:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 195us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.378855:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5431 00000100:00100000:2.0:1787119523.380344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.380565:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633658880 00000100:00100000:1.0:1787119523.380578:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633658880 00010000:00010000:1.0:1787119523.380617:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.380658:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5483 00000100:00100000:1.0:1787119523.380668:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2373:x1873929633658880:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.380685:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787119523.380709:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119521 -> 1787119522 00002000:00010000:1.0:1787119523.380713:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119521 -> 1787119522 00010000:00010000:1.0:1787119523.380720:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.380751:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.380788:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4180 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [290816->33845247] (req 290816->294911) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716819 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.380807:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 264) 00010000:00010000:1.0:1787119523.380812:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 264) 00010000:00010000:1.0:1787119523.380821:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.380831:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.380840:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 264) 00010000:00010000:1.0:1787119523.380844:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 264) 00010000:00010000:1.0:1787119523.380920:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.380931:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.381040:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 34 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.381057:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653647360:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.381156:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.381168:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653647488:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.381369:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.384158:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653647360:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.384188:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653647488:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.384211:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119523.384279:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2373:x1873929633658880:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3610us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.384291:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5483 00000100:00100000:2.0:1787119523.400359:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.400529:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633659008 00000100:00100000:0.0:1787119523.400541:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633659008 00002000:00100000:0.0:1787119523.400594:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (294912->299007) req@ffff92a63eabea00 x1873929633659008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.400606:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabea00 with x1873929633659008 ext(294912->299007) 00002000:00010000:0.0:1787119523.400612:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabea00 00000100:00100000:0.0:1787119523.400647:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10684 00000100:00100000:0.0:1787119523.400656:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633659008:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.400917:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633659008:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 260us (568us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.400929:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10684 00002000:00100000:0.0:1787119523.400937:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (294912->299007) req@ffff92a63eabea00 x1873929633659008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.400947:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabea00 with x1873929633659008 ext(294912->299007) 00002000:00010000:0.0:1787119523.400950:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabea00 00000100:00100000:2.0:1787119523.405699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.405835:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633659136 00000100:00100000:0.0:1787119523.405845:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633659136 00002000:00100000:0.0:1787119523.405896:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a63eabc380 x1873929633659136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.405907:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc380 with x1873929633659136 ext(290816->294911) 00002000:00010000:0.0:1787119523.405913:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc380 00000100:00100000:0.0:1787119523.405947:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10685 00000100:00100000:0.0:1787119523.405957:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2376:x1873929633659136:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.406183:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2376:x1873929633659136:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 226us (493us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.406191:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10685 00002000:00100000:0.0:1787119523.406197:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a63eabc380 x1873929633659136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.406206:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc380 with x1873929633659136 ext(290816->294911) 00002000:00010000:0.0:1787119523.406209:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc380 00000100:00100000:3.0:1787119523.412080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.412394:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633659264 00000100:00100000:1.0:1787119523.412404:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633659264 00002000:00100000:1.0:1787119523.412501:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (299008->303103) req@ffff92a62a126d80 x1873929633659264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.412511:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126d80 with x1873929633659264 ext(299008->303103) 00002000:00010000:1.0:1787119523.412517:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126d80 00000100:00100000:1.0:1787119523.412541:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10686 00000100:00100000:1.0:1787119523.412551:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633659264:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.412817:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633659264:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 267us (745us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119523.412825:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10686 00002000:00100000:1.0:1787119523.412833:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (299008->303103) req@ffff92a62a126d80 x1873929633659264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.412842:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126d80 with x1873929633659264 ext(299008->303103) 00002000:00010000:1.0:1787119523.412856:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126d80 00000100:00100000:2.0:1787119523.418842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.418962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.419078:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633659392 00000100:00100000:0.0:1787119523.419087:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633659392 00000100:00100000:0.0:1787119523.419166:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5432 00000100:00100000:0.0:1787119523.419186:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:33946:x1873929633659392:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.419205:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.419227:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471682e expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.419264:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.419275:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 264) 00010000:00010000:0.0:1787119523.419280:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 264) 00010000:00010000:0.0:1787119523.419286:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.419325:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.419351:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 33 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.419367:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653647616:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.419488:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.420648:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633659520 00000100:00100000:3.0:1787119523.420660:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633659520 00002000:00100000:3.0:1787119523.421938:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a63eabc700 x1873929633659520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.421953:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633659520 ext(303104->307199) 00010000:00010000:3.0:1787119523.421964:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 34 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.422006:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 34 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.422014:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabc700 00000100:00100000:3.0:1787119523.422054:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1311 00000100:00100000:3.0:1787119523.422066:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633659520:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.424690:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2374:x1873929633659520:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2614us (5714us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119523.424707:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1311 00002000:00100000:3.0:1787119523.424722:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a63eabc700 x1873929633659520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.424732:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633659520 ext(303104->307199) 00010000:00010000:3.0:1787119523.424743:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 34 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.424780:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 34 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.424788:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabc700 00000100:00100000:0.0:1787119523.425063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.425092:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633659648 00000100:00100000:0.0:1787119523.425101:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633659648 00002000:00100000:0.0:1787119523.425152:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (294912->303103) req@ffff92a63403b800 x1873929633659648/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 8680/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.425169:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633659648 ext(294912->303103) 00010000:00010000:0.0:1787119523.425184:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 34 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.425200:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 34 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.425209:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b800 00000100:00100000:0.0:1787119523.425234:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1312 00000100:00100000:0.0:1787119523.425245:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2373:x1873929633659648:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119523.425703:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2373:x1873929633659648:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 459us (639us total) trans 4294969257 rc 0/0 00000100:00100000:0.0:1787119523.425711:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1312 00002000:00100000:0.0:1787119523.425718:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (294912->303103) req@ffff92a63403b800 x1873929633659648/t4294969257(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 8680/448 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.425726:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b800 with x1873929633659648 ext(294912->303103) 00010000:00010000:0.0:1787119523.425731:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 36 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.425745:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 36 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.425752:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b800 00000100:00100000:1.0:1787119523.426713:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653647616:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119523.426750:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.426772:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:1.0:1787119523.426816:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:33946:x1873929633659392:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7640us (7985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.426823:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5432 00000100:00100000:3.0:1787119523.434538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.434591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.434668:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633659904 00000100:00100000:0.0:1787119523.434679:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633659904 00010000:00010000:0.0:1787119523.434718:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 36 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.434770:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5484 00000100:00100000:0.0:1787119523.434779:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633659904:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.434795:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.434819:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 36 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.434844:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 36 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.434879:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e418e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716827 expref: 36 pid: 6693 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.434894:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 264) 00010000:00010000:0.0:1787119523.434900:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 264) 00010000:00010000:0.0:1787119523.434907:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 32 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.434918:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 32 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.435200:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 32 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.435218:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653647744:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.435407:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466300 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.436078:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633659776 00000100:00100000:2.0:1787119523.436087:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633659776 00000100:00100000:2.0:1787119523.436152:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5433 00000100:00100000:2.0:1787119523.436161:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+36:33957:x1873929633659776:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.436364:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.436396:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716835 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.436428:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 32 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.436437:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 264) 00010000:00010000:2.0:1787119523.436477:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 264) 00010000:00010000:2.0:1787119523.436482:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.436514:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 32 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.436539:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 32 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.436553:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653647872:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119523.436626:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.444322:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653647744:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.444353:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.444420:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2376:x1873929633659904:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9640us (9826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.444433:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5484 00000100:00100000:3.0:1787119523.444589:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653647872:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119523.444616:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.444639:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e200, rc 0) 00000100:00100000:3.0:1787119523.444667:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+36:33957:x1873929633659776:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8507us (10141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.444675:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5433 00000100:00100000:1.0:1787119523.449234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.449328:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633660032 00000100:00100000:2.0:1787119523.449339:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633660032 00002000:00100000:2.0:1787119523.449390:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (294912->331775) req@ffff92a511630000 x1873929633660032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.449402:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630000 with x1873929633660032 ext(294912->331775) 00010000:00010000:2.0:1787119523.449412:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.449496:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.449504:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511630000 00000100:00100000:2.0:1787119523.449536:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1313 00000100:00100000:2.0:1787119523.449546:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2376:x1873929633660032:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.455197:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2376:x1873929633660032:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5632us (5952us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119523.455210:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1313 00002000:00100000:2.0:1787119523.455222:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (294912->331775) req@ffff92a511630000 x1873929633660032/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.455230:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630000 with x1873929633660032 ext(294912->331775) 00010000:00010000:2.0:1787119523.455240:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.455269:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.455277:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511630000 00000100:00100000:2.0:1787119523.464521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.464613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.464699:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633660288 00000100:00100000:1.0:1787119523.464711:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633660288 00010000:00010000:1.0:1787119523.464752:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.464799:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5485 00000100:00100000:1.0:1787119523.464809:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2375:x1873929633660288:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.464827:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.464865:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.464890:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.464915:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4195 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->33849343] (req 294912->299007) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471682e expref: 33 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.464940:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 264) 00010000:00010000:1.0:1787119523.464944:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 264) 00010000:00010000:1.0:1787119523.464954:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.464964:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.465021:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.465039:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653648000:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.465137:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986000 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.466649:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633660160 00000100:00100000:0.0:1787119523.466662:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633660160 00000100:00100000:0.0:1787119523.466757:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5434 00000100:00100000:0.0:1787119523.466768:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:33946:x1873929633660160:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.466786:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.466805:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471683c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.466832:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 264) 00010000:00010000:0.0:1787119523.466837:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 264) 00010000:00010000:0.0:1787119523.466858:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471683c expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.466874:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471683c expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.466886:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38600, rc 0) 00000100:00100000:0.0:1787119523.466952:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:33946:x1873929633660160:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 186us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.466959:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5434 00000100:00100000:3.0:1787119523.468671:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511631c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653648000:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.468694:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.468738:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2375:x1873929633660288:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3931us (4126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.468747:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5485 00000100:00100000:2.0:1787119523.486223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.486833:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633660416 00000100:00100000:0.0:1787119523.486846:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633660416 00002000:00100000:0.0:1787119523.486906:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a63eabd500 x1873929633660416/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.486919:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd500 with x1873929633660416 ext(303104->307199) 00002000:00010000:0.0:1787119523.486925:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd500 00000100:00100000:0.0:1787119523.487026:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10687 00000100:00100000:0.0:1787119523.487037:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633660416:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.487267:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633660416:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 230us (1052us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.487274:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10687 00002000:00100000:0.0:1787119523.487282:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a63eabd500 x1873929633660416/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.487291:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd500 with x1873929633660416 ext(303104->307199) 00002000:00010000:0.0:1787119523.487294:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd500 00000100:00100000:3.0:1787119523.487431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.487934:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633660544 00000100:00100000:1.0:1787119523.487939:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633660544 00002000:00100000:1.0:1787119523.488029:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (294912->303103) req@ffff92a62a125c00 x1873929633660544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.488039:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125c00 with x1873929633660544 ext(294912->303103) 00002000:00010000:1.0:1787119523.488044:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a125c00 00000100:00100000:1.0:1787119523.488073:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10688 00000100:00100000:1.0:1787119523.488081:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2376:x1873929633660544:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.488391:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2376:x1873929633660544:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 299us (949us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1787119523.488403:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10688 00002000:00100000:1.0:1787119523.488410:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (294912->303103) req@ffff92a62a125c00 x1873929633660544/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/8632 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.488417:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125c00 with x1873929633660544 ext(294912->303103) 00002000:00010000:1.0:1787119523.488421:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a125c00 00000100:00100000:3.0:1787119523.492232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.492820:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633660672 00000100:00100000:0.0:1787119523.492830:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633660672 00000100:00100000:0.0:1787119523.492958:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5435 00000100:00100000:0.0:1787119523.492969:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:33946:x1873929633660672:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.493001:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.493025:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716843 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.493059:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.493069:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 264) 00010000:00010000:0.0:1787119523.493074:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 264) 00010000:00010000:0.0:1787119523.493079:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.493113:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.493149:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.493166:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653648128:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.493255:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.501035:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653648128:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119523.501084:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.501111:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38000, rc 0) 00000100:00100000:0.0:1787119523.502412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.502614:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:33946:x1873929633660672:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9644us (10387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.502625:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5435 00000100:00100000:2.0:1787119523.503124:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633660928 00000100:00100000:2.0:1787119523.503135:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633660928 00002000:00100000:2.0:1787119523.503194:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a63403bb80 x1873929633660928/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.503206:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633660928 ext(303104->307199) 00010000:00010000:2.0:1787119523.503216:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 36 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.503248:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 36 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.503257:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403bb80 00000100:00100000:2.0:1787119523.503289:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1314 00000100:00100000:2.0:1787119523.503299:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633660928:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119523.504085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.504208:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633660800 00000100:00100000:3.0:1787119523.504214:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633660800 00002000:00100000:3.0:1787119523.504244:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a511631880 x1873929633660800/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.504255:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631880 with x1873929633660800 ext(307200->311295) 00010000:00010000:3.0:1787119523.504262:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 39 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.504281:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 39 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.504291:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511631880 00000100:00100000:3.0:1787119523.504311:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1315 00000100:00100000:3.0:1787119523.504317:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2374:x1873929633660800:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.504523:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2376:x1873929633660928:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 1224us (2115us total) trans 4294969258 rc 0/0 00000100:00100000:0.0:1787119523.504532:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1314 00002000:00100000:0.0:1787119523.504538:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a63403bb80 x1873929633660928/t4294969258(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/448 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.504547:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403bb80 with x1873929633660928 ext(303104->307199) 00010000:00010000:0.0:1787119523.504553:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 39 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.504567:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 39 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.504573:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403bb80 00000100:00100000:3.0:1787119523.504762:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2374:x1873929633660800:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 442us (679us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119523.504770:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1315 00002000:00100000:3.0:1787119523.504776:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a511631880 x1873929633660800/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.504784:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631880 with x1873929633660800 ext(307200->311295) 00010000:00010000:3.0:1787119523.504789:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.504804:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.504811:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511631880 00000100:00100000:0.0:1787119523.509585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.509638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.509744:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633661056 00000100:00100000:1.0:1787119523.509754:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633661056 00000100:00100000:1.0:1787119523.509861:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5436 00000100:00100000:1.0:1787119523.509871:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633661056:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.509891:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.509913:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471684a expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.509962:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 264) 00010000:00010000:1.0:1787119523.509967:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 264) 00010000:00010000:1.0:1787119523.509981:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.510004:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.510018:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:1.0:1787119523.510091:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+39:33957:x1873929633661056:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 221us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.510102:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5436 00000100:00100000:2.0:1787119523.510272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633661184 00000100:00100000:2.0:1787119523.510278:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633661184 00010000:00010000:2.0:1787119523.510299:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 39 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.510330:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5486 00000100:00100000:2.0:1787119523.510336:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2373:x1873929633661184:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119523.510347:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119523.510374:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 39 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.510412:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 39 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.510488:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e419c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [303104->33857535] (req 303104->307199) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716835 expref: 39 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.510504:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 264) 00010000:00010000:2.0:1787119523.510509:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 264) 00010000:00010000:2.0:1787119523.510518:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.510529:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.510537:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 264) 00010000:00010000:2.0:1787119523.510540:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 264) 00010000:00010000:2.0:1787119523.510545:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.510553:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.510603:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.510618:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653648256:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119523.510700:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 33 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.510711:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653648384:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119523.510734:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.514724:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653648256:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119523.514742:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653648384:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119523.514763:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119523.514811:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2373:x1873929633661184:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4475us (5173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.514819:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5486 00000100:00100000:3.0:1787119523.516422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.516606:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633661312 00000100:00100000:1.0:1787119523.516615:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633661312 00002000:00100000:1.0:1787119523.516658:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a508da7b80 x1873929633661312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.516668:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7b80 with x1873929633661312 ext(303104->307199) 00002000:00010000:1.0:1787119523.516674:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7b80 00000100:00100000:1.0:1787119523.516711:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10689 00000100:00100000:1.0:1787119523.516721:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633661312:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.516910:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633661312:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 191us (498us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119523.516914:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10689 00002000:00100000:1.0:1787119523.516918:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a508da7b80 x1873929633661312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.516924:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7b80 with x1873929633661312 ext(303104->307199) 00002000:00010000:1.0:1787119523.516926:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da7b80 00000100:00100000:3.0:1787119523.521620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.521740:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633661440 00000100:00100000:2.0:1787119523.521752:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633661440 00000100:00100000:2.0:1787119523.521822:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5437 00000100:00100000:2.0:1787119523.521832:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:33946:x1873929633661440:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.521857:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.521880:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716851 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.521918:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.521929:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 264) 00010000:00010000:2.0:1787119523.521934:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 264) 00010000:00010000:2.0:1787119523.521939:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.521998:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.522026:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 37 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.522037:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653648512:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119523.522113:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.524486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.528353:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633661568 00000100:00100000:1.0:1787119523.528368:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633661568 00010000:00010000:1.0:1787119523.528420:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 38 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.528498:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5487 00000100:00100000:1.0:1787119523.528509:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633661568:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.528529:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.528556:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 38 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.528584:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 38 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.528615:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 264) 00010000:00010000:1.0:1787119523.528620:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 264) 00010000:00010000:1.0:1787119523.528629:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.528640:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.528680:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.528695:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653648640:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.528783:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00010000:00010000:2.0:1787119523.529533:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e41b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471684a expref: 38 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.529552:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653648512:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119523.529581:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.529593:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e200, rc 0) 00000100:00100000:2.0:1787119523.529654:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633661440:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7822us (8045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.529663:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5437 00000100:00100000:1.0:1787119523.533074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.533233:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653648640:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.533261:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.533321:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2376:x1873929633661568:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4813us (8882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.533333:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5487 00000100:00100000:3.0:1787119523.533524:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633661696 00000100:00100000:3.0:1787119523.533532:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633661696 00002000:00100000:3.0:1787119523.533580:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a511632680 x1873929633661696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.533591:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632680 with x1873929633661696 ext(307200->344063) 00002000:00010000:3.0:1787119523.533596:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511632680 00000100:00100000:3.0:1787119523.533622:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10690 00000100:00100000:3.0:1787119523.533632:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633661696:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.533972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.534011:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633661824 00000100:00100000:0.0:1787119523.534015:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633661824 00000100:00100000:0.0:1787119523.534043:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5438 00000100:00100000:0.0:1787119523.534050:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+37:33957:x1873929633661824:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.534060:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.534077:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716858 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.534105:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.534120:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 264) 00010000:00010000:0.0:1787119523.534125:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 264) 00010000:00010000:0.0:1787119523.534130:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.534166:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.534192:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 36 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.534207:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653648768:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.534259:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.536812:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653648768:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119523.536847:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.536887:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:2.0:1787119523.536949:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633661824:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2897us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.536958:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5438 00000100:00100000:3.0:1787119523.538885:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633661696:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5245us (5811us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119523.538898:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10690 00002000:00100000:3.0:1787119523.538910:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a511632680 x1873929633661696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.538921:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632680 with x1873929633661696 ext(307200->344063) 00010000:00010000:3.0:1787119523.538930:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.538959:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.538968:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511632680 00000100:00100000:0.0:1787119523.544253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.544422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.544528:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633662080 00000100:00100000:3.0:1787119523.544538:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633662080 00010000:00010000:3.0:1787119523.544580:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.544643:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5488 00000100:00100000:3.0:1787119523.544653:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633662080:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.544679:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.544702:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.544729:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.544761:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716851 expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.544780:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 264) 00010000:00010000:3.0:1787119523.544785:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 264) 00010000:00010000:3.0:1787119523.544793:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.544804:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.544841:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.544863:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653648896:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.544937:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.546531:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633661952 00000100:00100000:2.0:1787119523.546546:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633661952 00000100:00100000:2.0:1787119523.546614:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5439 00000100:00100000:2.0:1787119523.546624:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633661952:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.546643:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.546781:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471685f expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.546817:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.546828:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 264) 00010000:00010000:2.0:1787119523.546832:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 264) 00010000:00010000:2.0:1787119523.546837:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.546882:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.546907:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 37 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.546923:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653649024:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119523.547070:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.558862:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653649024:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119523.558904:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.558928:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e000, rc 0) 00000100:00100000:2.0:1787119523.559047:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633661952:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 12423us (14803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.559056:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5439 00000100:00100000:1.0:1787119523.561310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.561417:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633662208 00000100:00100000:0.0:1787119523.561426:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633662208 00002000:00100000:0.0:1787119523.561513:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a511633100 x1873929633662208/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.561525:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633100 with x1873929633662208 ext(307200->311295) 00010000:00010000:0.0:1787119523.561536:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.561567:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.561577:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633100 00000100:00100000:0.0:1787119523.561601:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1316 00000100:00100000:0.0:1787119523.561611:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633662208:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.561818:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633662208:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 207us (517us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.561825:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1316 00002000:00100000:0.0:1787119523.561832:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a511633100 x1873929633662208/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.561840:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633100 with x1873929633662208 ext(307200->311295) 00010000:00010000:0.0:1787119523.561846:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.561860:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.561867:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633100 00000100:00100000:3.0:1787119523.564048:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653648896:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.564075:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119523.564502:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633662080:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 19730us (19959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.564515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5488 00000100:00100000:1.0:1787119523.566261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.566415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.566629:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633662464 00000100:00100000:2.0:1787119523.566640:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633662464 00010000:00010000:2.0:1787119523.566685:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.566730:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5489 00000100:00100000:2.0:1787119523.566740:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2374:x1873929633662464:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119523.566756:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119523.566779:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.566811:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.566836:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716858 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.566857:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 264) 00010000:00010000:2.0:1787119523.566863:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 264) 00010000:00010000:2.0:1787119523.566872:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.566882:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.566920:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.566934:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653649152:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119523.567049:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.567794:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633662336 00000100:00100000:0.0:1787119523.567801:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633662336 00000100:00100000:0.0:1787119523.567890:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5440 00000100:00100000:0.0:1787119523.567899:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633662336:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.567915:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.567930:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716866 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.567973:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.567994:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 264) 00010000:00010000:0.0:1787119523.567998:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 264) 00010000:00010000:0.0:1787119523.568004:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.568031:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.568051:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 34 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.568062:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653649280:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.568129:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.573394:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653649152:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119523.573419:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119523.573568:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2374:x1873929633662464:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6827us (7151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.573579:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5489 00000100:00100000:2.0:1787119523.574306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.574380:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633662592 00000100:00100000:1.0:1787119523.574387:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633662592 00010000:00010000:1.0:1787119523.574422:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.574498:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5490 00000100:00100000:1.0:1787119523.574509:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633662592:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.574522:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.574547:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.574574:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.574600:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 264) 00010000:00010000:1.0:1787119523.574606:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 264) 00010000:00010000:1.0:1787119523.574616:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.574626:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.574661:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.574676:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511633b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653649408:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.574744:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00010000:00010000:0.0:1787119523.575681:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e41c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471685f expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.575701:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653649280:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.575730:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.575743:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119523.575836:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633662336:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7937us (9583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.575844:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5440 00000100:00100000:1.0:1787119523.580160:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511633b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653649408:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.580200:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119523.580299:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2376:x1873929633662592:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5790us (5994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.580310:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5490 00000100:00100000:1.0:1787119523.586840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.587093:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633662720 00000100:00100000:2.0:1787119523.587103:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633662720 00000100:00100000:2.0:1787119523.587272:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5441 00000100:00100000:2.0:1787119523.587283:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:33946:x1873929633662720:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.587301:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.587322:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471686d expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.587354:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.587365:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 264) 00010000:00010000:2.0:1787119523.587369:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 264) 00010000:00010000:2.0:1787119523.587374:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.587648:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.587675:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 37 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.587691:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653649536:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119523.587785:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.596070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.596127:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.596222:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633662976 00000100:00100000:0.0:1787119523.596232:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633662976 00000100:00100000:0.0:1787119523.596291:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5442 00000100:00100000:0.0:1787119523.596299:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633662976:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.596317:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.596334:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716874 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.596362:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 264) 00010000:00010000:0.0:1787119523.596368:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.596373:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 264) 00010000:00010000:0.0:1787119523.596388:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.596432:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.596475:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.596486:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119523.596530:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+39:33957:x1873929633662976:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 232us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.596535:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5442 00000100:00100000:1.0:1787119523.597040:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633662848 00000100:00100000:1.0:1787119523.597046:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633662848 00010000:00010000:1.0:1787119523.597069:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 39 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.597095:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5491 00000100:00100000:1.0:1787119523.597100:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2375:x1873929633662848:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.597115:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.597132:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 39 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.597152:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 39 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.597169:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 264) 00010000:00010000:1.0:1787119523.597173:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 264) 00010000:00010000:1.0:1787119523.597181:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.597189:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.597222:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.597237:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.597247:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653649792:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.597293:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00010000:00010000:3.0:1787119523.599266:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e41cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716866 expref: 39 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.599288:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653649536:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119523.599465:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.599477:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.599494:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e200, rc 0) 00000100:00100000:3.0:1787119523.600361:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633662720:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13074us (13526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.600371:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5441 00000100:00100000:3.0:1787119523.601243:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653649792:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.601268:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.601359:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633662848:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4256us (5300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.601370:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5491 00000100:00100000:1.0:1787119523.608813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.609032:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633663104 00000100:00100000:2.0:1787119523.609046:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633663104 00002000:00100000:2.0:1787119523.609100:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a511632300 x1873929633663104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.609112:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632300 with x1873929633663104 ext(307200->344063) 00010000:00010000:2.0:1787119523.609122:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.609158:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.609167:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511632300 00000100:00100000:2.0:1787119523.610503:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1317 00000100:00100000:2.0:1787119523.610520:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633663104:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.623604:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633663104:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 13077us (14790us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119523.623624:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1317 00002000:00100000:2.0:1787119523.623637:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a511632300 x1873929633663104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.623648:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632300 with x1873929633663104 ext(307200->344063) 00010000:00010000:2.0:1787119523.623658:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.623690:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 35 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.623700:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511632300 00000100:00100000:1.0:1787119523.629654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.629758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.630012:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633663232 00000100:00100000:2.0:1787119523.630023:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633663232 00000100:00100000:3.0:1787119523.630050:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633663360 00000100:00100000:3.0:1787119523.630055:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633663360 00010000:00010000:3.0:1787119523.630078:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 36 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.630080:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5443 00000100:00100000:2.0:1787119523.630088:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633663232:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.630104:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787119523.630115:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5492 00000100:00100000:3.0:1787119523.630122:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633663360:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119523.630123:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471687b expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.630135:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119523.630148:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 264) 00010000:00010000:2.0:1787119523.630155:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.630224:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 264) 00010000:00010000:2.0:1787119523.630231:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.630774:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 37 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.630800:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 37 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.631880:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.631905:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.631923:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e41d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471686d expref: 37 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.631926:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 264) 00010000:00010000:2.0:1787119523.631931:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 264) 00010000:00010000:2.0:1787119523.631938:0:12469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.631957:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.631969:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119523.631999:0:12469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 37 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.632020:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 37 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.632035:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653650048:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.632095:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633663360:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 1972us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.632104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5492 00000100:00100000:2.0:1787119523.632106:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.636103:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653650048:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119523.636140:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6f000, rc 0) 00000100:00100000:2.0:1787119523.636209:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633663232:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6119us (6563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.636218:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5443 00000100:00100000:1.0:1787119523.636514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.636736:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633663488 00000100:00100000:2.0:1787119523.636744:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633663488 00002000:00100000:2.0:1787119523.636791:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a511631c00 x1873929633663488/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.636802:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631c00 with x1873929633663488 ext(307200->311295) 00010000:00010000:2.0:1787119523.636812:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.636841:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.636849:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511631c00 00000100:00100000:2.0:1787119523.636873:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1318 00000100:00100000:2.0:1787119523.636882:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633663488:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.637120:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633663488:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 230us (597us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119523.637128:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1318 00002000:00100000:2.0:1787119523.637134:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a511631c00 x1873929633663488/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.637142:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631c00 with x1873929633663488 ext(307200->311295) 00010000:00010000:2.0:1787119523.637148:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.637161:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 38 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.637168:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511631c00 00000100:00100000:1.0:1787119523.641688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.641785:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633663616 00000100:00100000:0.0:1787119523.641794:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633663616 00000100:00100000:0.0:1787119523.641851:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5444 00000100:00100000:0.0:1787119523.641862:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633663616:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.641880:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.641899:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716882 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.641929:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 264) 00010000:00010000:0.0:1787119523.641938:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.641945:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 264) 00010000:00010000:0.0:1787119523.641961:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.642011:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.642027:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.642040:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119523.642099:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+39:33957:x1873929633663616:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 238us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.642106:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5444 00000100:00100000:3.0:1787119523.642936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.643050:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633663744 00000100:00100000:1.0:1787119523.643056:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633663744 00010000:00010000:1.0:1787119523.643082:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 39 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.643199:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5493 00000100:00100000:0.0:1787119523.643209:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2376:x1873929633663744:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.643220:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.643243:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 39 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.643268:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 39 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.643291:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716874 expref: 39 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.643309:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 264) 00010000:00010000:0.0:1787119523.643313:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 264) 00010000:00010000:0.0:1787119523.643321:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.643331:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.643360:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.643566:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 34 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.643582:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653650304:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.643660:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.646546:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653650304:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.646575:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.646638:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633663744:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3430us (3703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.646648:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5493 00000100:00100000:2.0:1787119523.649626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.649798:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633663872 00000100:00100000:3.0:1787119523.649808:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633663872 00010000:00010000:3.0:1787119523.649910:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.650009:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5494 00000100:00100000:3.0:1787119523.650020:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2373:x1873929633663872:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.650037:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.650060:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.650085:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.650110:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e41e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471687b expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.650135:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 264) 00010000:00010000:3.0:1787119523.650141:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 264) 00010000:00010000:3.0:1787119523.650151:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.650163:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.650501:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.650518:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653650432:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.650597:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.654860:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653650432:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.654893:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.654957:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2373:x1873929633663872:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4938us (5339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.654972:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5494 00000100:00100000:1.0:1787119523.661148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.661302:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633664000 00000100:00100000:0.0:1787119523.661312:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633664000 00000100:00100000:0.0:1787119523.661368:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5445 00000100:00100000:0.0:1787119523.661385:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:33946:x1873929633664000:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.661404:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.661426:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716889 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.661507:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.661517:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 264) 00010000:00010000:0.0:1787119523.661521:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 264) 00010000:00010000:0.0:1787119523.661526:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.661558:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.661591:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 37 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.661608:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653650560:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.661693:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.664823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.664987:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653650560:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.665023:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.665053:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119523.665115:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633664000:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3738us (3977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.665124:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5445 00000100:00100000:3.0:1787119523.665671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633664128 00000100:00100000:3.0:1787119523.665679:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633664128 00010000:00010000:3.0:1787119523.665714:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 38 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.665943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5495 00000100:00100000:3.0:1787119523.665955:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2373:x1873929633664128:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.665969:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.666004:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 38 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.666034:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 38 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.666068:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e41e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716882 expref: 38 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.666085:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 264) 00010000:00010000:3.0:1787119523.666089:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 264) 00010000:00010000:3.0:1787119523.666097:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.666107:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.666148:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.666163:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653650688:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.666258:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.671037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.671122:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633664256 00000100:00100000:3.0:1787119523.671134:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633664256 00000100:00100000:3.0:1787119523.671204:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5446 00000100:00100000:3.0:1787119523.671215:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633664256:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.671238:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.671260:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716890 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.671297:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.671307:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 264) 00010000:00010000:3.0:1787119523.671312:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 264) 00010000:00010000:3.0:1787119523.671317:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 39 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.671353:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.671378:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 34 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.671395:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653650816:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119523.671535:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.673598:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653650688:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.673624:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.673686:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2373:x1873929633664128:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7733us (8873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.673701:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5495 00000100:00100000:2.0:1787119523.677293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.677484:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633664384 00000100:00100000:3.0:1787119523.677494:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633664384 00002000:00100000:3.0:1787119523.677550:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a63eabce00 x1873929633664384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.677560:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabce00 with x1873929633664384 ext(307200->344063) 00010000:00010000:3.0:1787119523.677569:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.677599:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.677608:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabce00 00000100:00100000:3.0:1787119523.677641:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1319 00000100:00100000:3.0:1787119523.677652:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633664384:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.679302:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653650816:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.679344:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.679368:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:0.0:1787119523.679561:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633664256:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8346us (8533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.679574:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5446 00000100:00100000:3.0:1787119523.683311:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633664384:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5649us (6016us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119523.683326:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1319 00002000:00100000:3.0:1787119523.683339:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a63eabce00 x1873929633664384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.683350:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabce00 with x1873929633664384 ext(307200->344063) 00010000:00010000:3.0:1787119523.683361:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.683398:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.683406:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabce00 00000100:00100000:1.0:1787119523.686937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.687004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.687193:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633664512 00000100:00100000:0.0:1787119523.687203:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633664512 00000100:00100000:0.0:1787119523.687266:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5447 00000100:00100000:0.0:1787119523.687276:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633664512:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.687295:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.687316:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716897 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.687350:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 264) 00010000:00010000:0.0:1787119523.687359:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.687366:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 264) 00010000:00010000:0.0:1787119523.687371:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.687412:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.687429:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.687484:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119523.687541:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633664512:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 265us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.687549:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5447 00000100:00100000:3.0:1787119523.687756:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633664640 00000100:00100000:3.0:1787119523.687761:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633664640 00010000:00010000:3.0:1787119523.687783:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.687811:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5496 00000100:00100000:3.0:1787119523.687818:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633664640:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.687827:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.687910:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.687936:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.687957:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e41f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716889 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.688041:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 264) 00010000:00010000:3.0:1787119523.688046:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 264) 00010000:00010000:3.0:1787119523.688055:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.688069:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.688096:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.688109:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 37 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.688124:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653651072:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.689641:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.700270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.700478:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653651072:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.700505:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.700574:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633664640:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12754us (13569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.700587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5496 00000100:00100000:0.0:1787119523.700792:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633664768 00000100:00100000:0.0:1787119523.700803:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633664768 00002000:00100000:0.0:1787119523.700869:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a519d18a80 x1873929633664768/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.700881:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18a80 with x1873929633664768 ext(307200->311295) 00010000:00010000:0.0:1787119523.700890:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.700923:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.700931:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d18a80 00000100:00100000:0.0:1787119523.700963:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1320 00000100:00100000:0.0:1787119523.700974:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633664768:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.701179:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633664768:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 206us (919us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.701186:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1320 00002000:00100000:0.0:1787119523.701192:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a519d18a80 x1873929633664768/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.701200:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18a80 with x1873929633664768 ext(307200->311295) 00010000:00010000:0.0:1787119523.701205:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.701224:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.701230:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d18a80 00000100:00100000:1.0:1787119523.706212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.706275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.706358:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633664896 00000100:00100000:2.0:1787119523.706358:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633665024 00000100:00100000:3.0:1787119523.706372:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633664896 00000100:00100000:2.0:1787119523.706372:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633665024 00010000:00010000:3.0:1787119523.706426:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 39 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.706460:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5448 00000100:00100000:2.0:1787119523.706471:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+39:33957:x1873929633665024:12345-192.168.201.59@tcp:101:mmap_sanity.0 00000100:00100000:3.0:1787119523.706476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5497 00000100:00100000:3.0:1787119523.706481:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2376:x1873929633664896:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119523.706486:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.706495:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119523.706503:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471689e expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.706519:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 40 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.706533:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 264) 00010000:00010000:2.0:1787119523.706541:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.706549:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 264) 00010000:00010000:2.0:1787119523.706554:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 40 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.707143:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 40 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.707180:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e41f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716890 expref: 40 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.707195:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 264) 00010000:00010000:3.0:1787119523.707200:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 264) 00010000:00010000:3.0:1787119523.707207:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.707217:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.707254:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.707269:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 34 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.707283:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653651200:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.707370:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787119523.708281:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 34 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.708298:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 34 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.708312:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653651328:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119523.708366:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.712301:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653651328:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.712341:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.712365:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e200, rc 0) 00000100:00100000:0.0:1787119523.712456:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+39:33957:x1873929633665024:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5969us (6162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.712462:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653651200:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.712467:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5448 00010000:00010000:3.0:1787119523.712477:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.712500:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633664896:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6019us (6302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.712512:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5497 00000100:00100000:1.0:1787119523.715610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.715685:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633665152 00000100:00100000:3.0:1787119523.715696:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633665152 00010000:00010000:3.0:1787119523.715736:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.715772:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5498 00000100:00100000:3.0:1787119523.715782:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633665152:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.715801:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.715828:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.715859:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.715883:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e41fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716897 expref: 35 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.715899:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 264) 00010000:00010000:3.0:1787119523.715903:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 264) 00010000:00010000:3.0:1787119523.715912:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.715927:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.715967:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.715993:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653651456:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.716085:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5069996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.718346:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653651456:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.718372:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.718594:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633665152:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2812us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.718606:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5498 00000100:00100000:1.0:1787119523.723905:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.724063:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633665280 00000100:00100000:0.0:1787119523.724077:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633665280 00002000:00100000:0.0:1787119523.724130:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a519d18e00 x1873929633665280/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.724141:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18e00 with x1873929633665280 ext(307200->311295) 00002000:00010000:0.0:1787119523.724147:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18e00 00000100:00100000:0.0:1787119523.724193:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10691 00000100:00100000:0.0:1787119523.724205:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633665280:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.724490:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633665280:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 285us (593us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.724499:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10691 00002000:00100000:0.0:1787119523.724507:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a519d18e00 x1873929633665280/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.724517:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18e00 with x1873929633665280 ext(307200->311295) 00002000:00010000:0.0:1787119523.724520:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d18e00 00000100:00100000:1.0:1787119523.725209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.726034:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633665408 00000100:00100000:0.0:1787119523.726044:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633665408 00000100:00100000:0.0:1787119523.726100:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5449 00000100:00100000:0.0:1787119523.726109:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:33946:x1873929633665408:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.726124:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.726145:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168a5 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.726188:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.726199:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 264) 00010000:00010000:0.0:1787119523.726204:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 264) 00010000:00010000:0.0:1787119523.726209:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.726245:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.726273:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 37 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.726294:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653651584:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.726393:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.734497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.734550:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653651584:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119523.734586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119523.734587:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.734611:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:2.0:1787119523.734717:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633665664 00000100:00100000:2.0:1787119523.734725:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633665664 00000100:00100000:2.0:1787119523.734785:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5450 00000100:00100000:2.0:1787119523.734794:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633665664:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.734812:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.734829:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168ac expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.734852:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633665408:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8735us (9638us total) trans 0 rc 0/0 00010000:00010000:2.0:1787119523.734855:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 264) 00000100:00100000:0.0:1787119523.734859:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5449 00010000:00010000:2.0:1787119523.734862:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.734869:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 264) 00010000:00010000:2.0:1787119523.734874:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 39 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.734909:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.734922:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 39 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.734932:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e600, rc 0) 00000100:00100000:2.0:1787119523.734955:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+39:33957:x1873929633665664:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.734961:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5450 00000100:00100000:1.0:1787119523.734967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633665536 00000100:00100000:1.0:1787119523.734972:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633665536 00010000:00010000:1.0:1787119523.735014:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.735048:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5499 00000100:00100000:1.0:1787119523.735056:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2375:x1873929633665536:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.735065:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.735088:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.735112:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.735134:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4205 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471689e expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.735151:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 264) 00010000:00010000:1.0:1787119523.735154:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 264) 00010000:00010000:1.0:1787119523.735162:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.735170:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.735201:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.735215:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 34 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.735228:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653651840:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.735289:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.738812:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653651840:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.738850:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119523.738917:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633665536:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3859us (4429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.738929:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5499 00000100:00100000:1.0:1787119523.743580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.744038:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633665792 00000100:00100000:2.0:1787119523.744050:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633665792 00002000:00100000:2.0:1787119523.744093:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a519d19500 x1873929633665792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.744103:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19500 with x1873929633665792 ext(307200->344063) 00010000:00010000:2.0:1787119523.744124:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.744153:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.744160:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d19500 00000100:00100000:2.0:1787119523.744196:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1321 00000100:00100000:2.0:1787119523.744206:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633665792:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.749282:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633665792:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5065us (5701us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119523.749296:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1321 00002000:00100000:2.0:1787119523.749309:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a519d19500 x1873929633665792/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.749321:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19500 with x1873929633665792 ext(307200->344063) 00010000:00010000:2.0:1787119523.749331:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.749362:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.749377:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d19500 00000100:00100000:3.0:1787119523.753624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.753701:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633665920 00000100:00100000:1.0:1787119523.753712:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633665920 00000100:00100000:3.0:1787119523.753715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.753798:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633666048 00000100:00100000:0.0:1787119523.753804:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633666048 00010000:00010000:0.0:1787119523.753831:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.753877:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5500 00000100:00100000:0.0:1787119523.753887:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633666048:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.753903:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.753927:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.753954:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.754003:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e420c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168a5 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.754022:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 264) 00010000:00010000:0.0:1787119523.754026:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 264) 00010000:00010000:0.0:1787119523.754041:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.754051:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.754091:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.754105:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653651968:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.754200:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.755063:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5451 00000100:00100000:1.0:1787119523.755077:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633665920:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.755093:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.755108:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168b3 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.755132:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.755148:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 264) 00010000:00010000:1.0:1787119523.755151:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 264) 00010000:00010000:1.0:1787119523.755155:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 36 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.755247:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.755268:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 37 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.755280:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653652096:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119523.755395:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.765361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.765532:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633666176 00000100:00100000:1.0:1787119523.765534:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653652096:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119523.765540:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633666176 00010000:00010000:3.0:1787119523.765578:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.765578:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 36 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.765602:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:3.0:1787119523.765629:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5501 00000100:00100000:3.0:1787119523.765638:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633666176:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.765656:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787119523.765657:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633665920:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10585us (12043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.765678:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5451 00010000:00010000:3.0:1787119523.765679:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.765704:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.765729:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 264) 00010000:00010000:3.0:1787119523.765735:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 264) 00010000:00010000:3.0:1787119523.765744:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 35 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.765755:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 35 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.765789:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 35 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.765803:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653652224:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.765868:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00010000:00010000:0.0:1787119523.770766:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e4213 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ac expref: 38 pid: 8267 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.770789:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653651968:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.770812:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.771127:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633666048:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 17240us (17409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.771138:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5500 00000100:00100000:3.0:1787119523.771427:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653652224:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.771458:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.771482:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2375:x1873929633666176:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5844us (6134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.771489:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5501 00000100:00100000:2.0:1787119523.772432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.773772:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633666304 00000100:00100000:0.0:1787119523.773784:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633666304 00000100:00100000:1.0:1787119523.773990:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5452 00000100:00100000:1.0:1787119523.774002:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+37:33957:x1873929633666304:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.774024:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.774047:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168ba expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.774088:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 34 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.774097:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 264) 00010000:00010000:1.0:1787119523.774102:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 264) 00010000:00010000:1.0:1787119523.774108:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.774145:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 34 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.774184:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 34 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.774200:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653652352:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119523.774286:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.777936:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653652352:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119523.777996:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.778024:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:1.0:1787119523.778100:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633666304:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4100us (5671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.778110:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5452 00000100:00100000:0.0:1787119523.780934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.781279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633666432 00000100:00100000:1.0:1787119523.781291:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633666432 00010000:00010000:1.0:1787119523.781334:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.782018:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5502 00000100:00100000:1.0:1787119523.782032:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633666432:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.782051:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.782075:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.782102:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.782131:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e421a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168b3 expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.782150:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 264) 00010000:00010000:1.0:1787119523.782155:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 264) 00010000:00010000:1.0:1787119523.782163:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.782185:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.782231:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.782247:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653652480:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.782348:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.786843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.786925:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633666560 00000100:00100000:0.0:1787119523.786936:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633666560 00000100:00100000:0.0:1787119523.787036:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5453 00000100:00100000:0.0:1787119523.787046:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633666560:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.787066:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.787085:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168c1 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.787116:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.787126:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 264) 00010000:00010000:0.0:1787119523.787131:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 264) 00010000:00010000:0.0:1787119523.787136:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 36 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.787178:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.787203:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 37 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.787219:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653652608:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.787325:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.788781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.788868:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653652480:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119523.788893:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119523.788943:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2376:x1873929633666432:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6915us (8020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.788954:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5502 00000100:00100000:3.0:1787119523.789087:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633666688 00000100:00100000:3.0:1787119523.789095:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633666688 00002000:00100000:3.0:1787119523.789139:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a63eabd880 x1873929633666688/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.789150:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd880 with x1873929633666688 ext(307200->311295) 00010000:00010000:3.0:1787119523.789158:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.789195:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.789203:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabd880 00000100:00100000:3.0:1787119523.789233:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1322 00000100:00100000:3.0:1787119523.789242:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633666688:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.790418:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633666688:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1171us (1636us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119523.790428:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1322 00002000:00100000:3.0:1787119523.790437:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a63eabd880 x1873929633666688/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.790461:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd880 with x1873929633666688 ext(307200->311295) 00010000:00010000:3.0:1787119523.790470:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.790494:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.790508:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabd880 00000100:00100000:0.0:1787119523.797867:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653652608:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.797909:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.797934:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119523.798007:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633666560:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10961us (11174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.798016:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5453 00000100:00100000:3.0:1787119523.798092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.798486:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633666816 00000100:00100000:0.0:1787119523.798495:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633666816 00000100:00100000:0.0:1787119523.798577:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5454 00000100:00100000:0.0:1787119523.798588:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633666816:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.798604:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.798624:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168c8 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.798649:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 264) 00010000:00010000:0.0:1787119523.798658:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.798675:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 264) 00010000:00010000:0.0:1787119523.798680:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.798715:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.798734:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.798743:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:0.0:1787119523.798782:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+39:33957:x1873929633666816:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 195us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.798788:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5454 00000100:00100000:2.0:1787119523.806132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.806284:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633666944 00000100:00100000:3.0:1787119523.806294:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633666944 00010000:00010000:3.0:1787119523.806339:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.806960:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5503 00000100:00100000:3.0:1787119523.806991:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2375:x1873929633666944:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.807008:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.807031:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.807060:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.807086:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4221 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168ba expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.807103:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 264) 00010000:00010000:3.0:1787119523.807108:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 264) 00010000:00010000:3.0:1787119523.807116:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.807126:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.807971:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.808015:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 34 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.808033:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653652864:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119523.808271:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999300 going to sleep for 11 seconds 00010000:00010000:0.0:1787119523.811275:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119523.814117:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653652864:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119523.814146:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119523.814224:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633666944:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7252us (8115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.814235:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5503 00000100:00100000:2.0:1787119523.817925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.818026:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633667072 00000100:00100000:1.0:1787119523.818036:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633667072 00002000:00100000:1.0:1787119523.818086:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a63eabf100 x1873929633667072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.818096:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf100 with x1873929633667072 ext(307200->344063) 00010000:00010000:1.0:1787119523.818106:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.818135:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119523.818142:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabf100 00000100:00100000:1.0:1787119523.818188:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1323 00000100:00100000:1.0:1787119523.818199:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2373:x1873929633667072:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.823705:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2373:x1873929633667072:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5493us (5780us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119523.823722:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1323 00002000:00100000:1.0:1787119523.823741:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a63eabf100 x1873929633667072/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.823753:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf100 with x1873929633667072 ext(307200->344063) 00010000:00010000:1.0:1787119523.823767:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.823801:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119523.823810:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabf100 00000100:00100000:0.0:1787119523.827219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.827538:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633667200 00000100:00100000:1.0:1787119523.827548:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633667200 00000100:00100000:1.0:1787119523.827604:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5455 00000100:00100000:1.0:1787119523.827614:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633667200:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.827631:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.827648:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168cf expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.827678:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 264) 00010000:00010000:1.0:1787119523.827687:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.827700:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 264) 00010000:00010000:1.0:1787119523.827705:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 36 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.827745:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.827759:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 36 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.827772:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:1.0:1787119523.827829:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633667200:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 215us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.827835:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5455 00000100:00100000:3.0:1787119523.830496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.830693:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633667328 00000100:00100000:2.0:1787119523.830704:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633667328 00010000:00010000:2.0:1787119523.830746:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.830788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5504 00000100:00100000:2.0:1787119523.830798:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2376:x1873929633667328:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119523.830813:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119523.830834:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.830872:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.830898:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4228 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c1 expref: 36 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.830917:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 264) 00010000:00010000:2.0:1787119523.830921:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 264) 00010000:00010000:2.0:1787119523.830928:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.830938:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.830988:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.831003:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 37 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.831018:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653653120:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119523.831097:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.834129:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653653120:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.834156:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.834230:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633667328:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3431us (3742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.834242:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5504 00000100:00100000:0.0:1787119523.839923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.840278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633667456 00000100:00100000:1.0:1787119523.840288:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633667456 00010000:00010000:1.0:1787119523.840327:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 38 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.840371:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5505 00000100:00100000:1.0:1787119523.840390:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633667456:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119523.840431:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119523.840492:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 38 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.840526:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 38 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.840552:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e422f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168c8 expref: 38 pid: 12469 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.840571:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 264) 00010000:00010000:1.0:1787119523.840576:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 264) 00010000:00010000:1.0:1787119523.840585:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 34 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.840595:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 34 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.840638:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 34 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.840657:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653653248:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119523.840737:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.843750:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653653248:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.843777:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.843823:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2375:x1873929633667456:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3435us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.843834:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5505 00000100:00100000:3.0:1787119523.855623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.855737:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633667584 00000100:00100000:1.0:1787119523.855749:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633667584 00000100:00100000:1.0:1787119523.855814:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5456 00000100:00100000:1.0:1787119523.855825:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+37:33957:x1873929633667584:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.855843:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.855879:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168d6 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.855915:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 34 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.855925:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 264) 00010000:00010000:1.0:1787119523.855930:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 264) 00010000:00010000:1.0:1787119523.855935:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.855971:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 34 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.856012:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 34 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.856026:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653653376:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119523.856115:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.859083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.860243:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633667712 00000100:00100000:2.0:1787119523.860256:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633667712 00002000:00100000:2.0:1787119523.860311:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a634039c00 x1873929633667712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.860324:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039c00 with x1873929633667712 ext(307200->344063) 00010000:00010000:2.0:1787119523.860334:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.860364:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.860385:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039c00 00000100:00100000:2.0:1787119523.860421:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1324 00000100:00100000:2.0:1787119523.860432:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633667712:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.863793:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653653376:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119523.863832:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.863859:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119523.863916:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633667584:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8094us (8304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.863925:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5456 00000100:00100000:2.0:1787119523.865535:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633667712:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5098us (6454us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119523.865544:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1324 00002000:00100000:2.0:1787119523.865554:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (307200->344063) req@ffff92a634039c00 x1873929633667712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/440 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.865562:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039c00 with x1873929633667712 ext(307200->344063) 00010000:00010000:2.0:1787119523.865570:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.865597:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.865604:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039c00 00000100:00100000:3.0:1787119523.868309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.868416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.868634:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633667968 00000100:00100000:2.0:1787119523.868644:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633667968 00010000:00010000:2.0:1787119523.868683:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.868727:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5506 00000100:00100000:2.0:1787119523.868737:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2374:x1873929633667968:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119523.868752:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119523.868775:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.868801:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.868826:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e4236 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168cf expref: 35 pid: 20841 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.868854:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 264) 00010000:00010000:2.0:1787119523.868859:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 264) 00010000:00010000:2.0:1787119523.868868:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.868878:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.868914:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119523.868928:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653653504:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119523.869040:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.869971:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633667840 00000100:00100000:0.0:1787119523.870107:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633667840 00000100:00100000:1.0:1787119523.870336:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5457 00000100:00100000:1.0:1787119523.870346:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633667840:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.870362:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.870393:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168dd expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.870420:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.870430:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 264) 00010000:00010000:1.0:1787119523.870434:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 264) 00010000:00010000:1.0:1787119523.870455:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 36 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.870485:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.870507:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 37 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.870520:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653653632:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119523.870595:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.873217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.873401:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633668096 00000100:00100000:1.0:1787119523.873411:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633668096 00002000:00100000:1.0:1787119523.873499:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a508da6d80 x1873929633668096/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.873511:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6d80 with x1873929633668096 ext(307200->311295) 00010000:00010000:1.0:1787119523.873521:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.873552:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119523.873561:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6d80 00000100:00100000:1.0:1787119523.873585:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1325 00000100:00100000:1.0:1787119523.873595:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633668096:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.873785:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633668096:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 190us (575us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119523.873792:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1325 00002000:00100000:1.0:1787119523.873799:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a508da6d80 x1873929633668096/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119523.873807:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6d80 with x1873929633668096 ext(307200->311295) 00010000:00010000:1.0:1787119523.873811:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.873825:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119523.873832:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6d80 00000100:00100000:0.0:1787119523.876013:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653653504:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.876044:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.876209:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2374:x1873929633667968:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7472us (7791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.876222:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5506 00000100:00100000:3.0:1787119523.878519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.881106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.881192:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653653632:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119523.881233:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.881257:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:2.0:1787119523.881320:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633667840:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10975us (13021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.881328:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5457 00000100:00100000:0.0:1787119523.885210:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633668352 00000100:00100000:0.0:1787119523.885230:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633668352 00002000:00100000:0.0:1787119523.885292:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a508da5c00 x1873929633668352/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.885304:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5c00 with x1873929633668352 ext(307200->311295) 00010000:00010000:0.0:1787119523.885314:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.885345:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 38 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.885366:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5c00 00000100:00100000:0.0:1787119523.885391:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633668224 00000100:00100000:0.0:1787119523.885395:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633668224 00002000:00100000:0.0:1787119523.885409:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a519d18000 x1873929633668224/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.885418:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18000 with x1873929633668224 ext(311296->315391) 00010000:00010000:0.0:1787119523.885423:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.885437:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.885462:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d18000 00000100:00100000:0.0:1787119523.885490:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1326 00000100:00100000:0.0:1787119523.885499:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2375:x1873929633668352:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119523.885559:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1327 00000100:00100000:3.0:1787119523.885578:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2374:x1873929633668224:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.885783:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2374:x1873929633668224:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 214us (4685us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119523.885790:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1327 00002000:00100000:3.0:1787119523.885797:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a519d18000 x1873929633668224/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.885805:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18000 with x1873929633668224 ext(311296->315391) 00010000:00010000:3.0:1787119523.885811:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.885825:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 39 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.885832:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d18000 00000100:00100000:0.0:1787119523.886505:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633668352:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 1002us (7992us total) trans 4294969259 rc 0/0 00000100:00100000:0.0:1787119523.886513:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1326 00002000:00100000:0.0:1787119523.887333:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a508da5c00 x1873929633668352/t4294969259(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/448 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.887406:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5c00 with x1873929633668352 ext(307200->311295) 00010000:00010000:0.0:1787119523.887415:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 40 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.887467:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 40 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.887476:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5c00 00000100:00100000:1.0:1787119523.891576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.891633:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.891785:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633668608 00000100:00100000:3.0:1787119523.891796:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633668608 00010000:00010000:3.0:1787119523.891837:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 40 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.891883:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5507 00000100:00100000:3.0:1787119523.891893:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633668608:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.891908:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.891931:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 40 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.891964:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 40 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.892001:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e423d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168d6 expref: 40 pid: 6695 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.892018:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 264) 00010000:00010000:3.0:1787119523.892023:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 264) 00010000:00010000:3.0:1787119523.892039:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.892049:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.892084:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.892109:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653653760:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.892190:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.892893:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633668480 00000100:00100000:0.0:1787119523.892900:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633668480 00000100:00100000:0.0:1787119523.892941:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5458 00000100:00100000:0.0:1787119523.892950:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+40:33957:x1873929633668480:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.892964:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.892988:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168e4 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.893013:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.893021:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 264) 00010000:00010000:0.0:1787119523.893216:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 264) 00010000:00010000:0.0:1787119523.893224:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.893253:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 34 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.893276:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 34 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.893290:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653653888:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.893712:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119523.907864:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653653760:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119523.907891:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119523.907997:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2375:x1873929633668608:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 16104us (16362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.908009:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5507 00000100:00100000:1.0:1787119523.908361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.908613:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653653888:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.908640:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.908662:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119523.908701:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+40:33957:x1873929633668480:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 15752us (17146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.908709:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5458 00000100:00100000:3.0:1787119523.909003:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633668736 00000100:00100000:3.0:1787119523.909012:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633668736 00010000:00010000:3.0:1787119523.909050:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.909078:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5508 00000100:00100000:3.0:1787119523.909087:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633668736:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.909100:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.909126:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.909155:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.909180:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4244 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [307200->33861631] (req 307200->311295) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168dd expref: 35 pid: 6696 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.909194:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 264) 00010000:00010000:3.0:1787119523.909199:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 264) 00010000:00010000:3.0:1787119523.909208:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.909218:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.909252:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.909269:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653654016:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.909331:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:2.0:1787119523.913828:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653654016:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119523.913857:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119523.913921:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2376:x1873929633668736:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4832us (5558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.913932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5508 00000100:00100000:2.0:1787119523.922274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.923911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.924022:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633668864 00000100:00100000:1.0:1787119523.924044:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633668864 00000100:00100000:1.0:1787119523.924110:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5459 00000100:00100000:1.0:1787119523.924120:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:33946:x1873929633668864:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.924139:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.924159:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168eb expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.924193:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=1s v=(114 264) 00010000:00010000:1.0:1787119523.924198:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 264) 00010000:00010000:1.0:1787119523.924209:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168eb expref: 35 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.924226:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168eb expref: 35 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.924239:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431c00, rc 0) 00000100:00100000:1.0:1787119523.924302:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633668864:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 183us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119523.924309:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5459 00000100:00100000:0.0:1787119523.930926:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633668992 00000100:00100000:0.0:1787119523.930942:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633668992 00002000:00100000:0.0:1787119523.931012:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a63eabdc00 x1873929633668992/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.931415:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdc00 with x1873929633668992 ext(311296->315391) 00002000:00010000:0.0:1787119523.931424:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabdc00 00000100:00100000:0.0:1787119523.932124:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10692 00000100:00100000:0.0:1787119523.932140:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2373:x1873929633668992:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119523.933170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.933245:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633669120 00000100:00100000:2.0:1787119523.933253:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633669120 00000100:00100000:0.0:1787119523.933697:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2373:x1873929633668992:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1561us (9793us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.933707:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10692 00002000:00100000:0.0:1787119523.933714:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a63eabdc00 x1873929633668992/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.933725:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdc00 with x1873929633668992 ext(311296->315391) 00002000:00010000:0.0:1787119523.933731:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabdc00 00002000:00100000:2.0:1787119523.933929:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a519d1aa00 x1873929633669120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.933938:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1aa00 with x1873929633669120 ext(307200->311295) 00002000:00010000:2.0:1787119523.933942:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1aa00 00000100:00100000:2.0:1787119523.933971:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10693 00000100:00100000:2.0:1787119523.933993:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633669120:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119523.934128:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2376:x1873929633669120:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 149us (962us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119523.934135:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10693 00002000:00100000:2.0:1787119523.934141:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a519d1aa00 x1873929633669120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.934149:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1aa00 with x1873929633669120 ext(307200->311295) 00002000:00010000:2.0:1787119523.934152:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1aa00 00000100:00100000:2.0:1787119523.940967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119523.941200:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633669248 00000100:00100000:1.0:1787119523.941211:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633669248 00000100:00100000:1.0:1787119523.941268:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5460 00000100:00100000:1.0:1787119523.941277:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:33946:x1873929633669248:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119523.941306:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119523.941327:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168f2 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.941372:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.941383:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 264) 00010000:00010000:1.0:1787119523.941388:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 264) 00010000:00010000:1.0:1787119523.941393:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.941427:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119523.941497:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 39 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119523.941513:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653654144:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119523.942109:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986000 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.948277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.948365:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633669376 00000100:00100000:3.0:1787119523.948374:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633669376 00002000:00100000:3.0:1787119523.948435:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a519d1a300 x1873929633669376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.948484:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a300 with x1873929633669376 ext(315392->319487) 00010000:00010000:3.0:1787119523.948495:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 40 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.948525:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 40 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.948534:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1a300 00000100:00100000:0.0:1787119523.948581:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1328 00000100:00100000:0.0:1787119523.948595:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2374:x1873929633669376:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.948948:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2374:x1873929633669376:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 355us (679us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.948957:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1328 00002000:00100000:0.0:1787119523.948965:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a519d1a300 x1873929633669376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.948985:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1a300 with x1873929633669376 ext(315392->319487) 00010000:00010000:0.0:1787119523.948993:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 40 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.949013:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 40 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119523.949021:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1a300 00000100:00100000:3.0:1787119523.949066:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653654144:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119523.949099:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.949117:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430200, rc 0) 00000100:00100000:3.0:1787119523.949156:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633669248:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7880us (8200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.949164:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5460 00000100:00100000:1.0:1787119523.950706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.950803:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633669504 00000100:00100000:2.0:1787119523.950812:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633669504 00002000:00100000:2.0:1787119523.950864:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a519d1b480 x1873929633669504/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.950874:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b480 with x1873929633669504 ext(311296->315391) 00010000:00010000:2.0:1787119523.950883:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 40 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.950905:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 40 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.950913:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1b480 00000100:00100000:2.0:1787119523.950947:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1329 00000100:00100000:2.0:1787119523.950956:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2376:x1873929633669504:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119523.951512:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633669504:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 553us (810us total) trans 4294969260 rc 0/0 00000100:00100000:2.0:1787119523.951524:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1329 00002000:00100000:2.0:1787119523.951532:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a519d1b480 x1873929633669504/t4294969260(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 4584/448 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119523.951540:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b480 with x1873929633669504 ext(311296->315391) 00010000:00010000:2.0:1787119523.951546:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.951562:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119523.951641:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1b480 00000100:00100000:2.0:1787119523.959537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.959636:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633669632 00000100:00100000:3.0:1787119523.959648:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633669632 00000100:00100000:3.0:1787119523.959703:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5461 00000100:00100000:3.0:1787119523.959714:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633669632:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119523.959740:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119523.959765:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047168f9 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.959805:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 264) 00010000:00010000:3.0:1787119523.959811:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 264) 00010000:00010000:3.0:1787119523.959817:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.959831:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.959857:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84400, rc 0) 00000100:00100000:3.0:1787119523.965733:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633669632:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6005us (6190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119523.965748:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5461 00000100:00100000:2.0:1787119523.966377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.966472:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633669760 00000100:00100000:0.0:1787119523.966485:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633669760 00010000:00010000:0.0:1787119523.966541:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.966580:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5509 00000100:00100000:0.0:1787119523.966589:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2373:x1873929633669760:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119523.966614:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119523.966640:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.966667:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.966693:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e424b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [311296->33865727] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168e4 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.966712:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 264) 00010000:00010000:0.0:1787119523.966717:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 264) 00010000:00010000:0.0:1787119523.966726:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 35 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.966749:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 35 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.966767:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 264) 00010000:00010000:0.0:1787119523.966770:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 264) 00010000:00010000:0.0:1787119523.966775:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.966789:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.966829:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.966844:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653654272:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.966932:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 35 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.966944:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653654400:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.966973:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119523.973334:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653654272:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119523.973363:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653654400:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119523.973390:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119523.973473:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2373:x1873929633669760:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6883us (7096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.973484:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5509 00000100:00100000:2.0:1787119523.974052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.974242:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633669888 00000100:00100000:0.0:1787119523.974250:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633669888 00002000:00100000:0.0:1787119523.974301:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a63eabf800 x1873929633669888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.974312:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf800 with x1873929633669888 ext(311296->315391) 00002000:00010000:0.0:1787119523.974318:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabf800 00000100:00100000:0.0:1787119523.974353:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10694 00000100:00100000:0.0:1787119523.974362:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633669888:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119523.975037:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633669888:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 673us (985us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119523.975046:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10694 00002000:00100000:0.0:1787119523.975053:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a63eabf800 x1873929633669888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119523.975062:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf800 with x1873929633669888 ext(311296->315391) 00002000:00010000:0.0:1787119523.975065:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabf800 00000100:00100000:1.0:1787119523.979989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119523.981420:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633670016 00000100:00100000:0.0:1787119523.981478:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633670016 00000100:00100000:0.0:1787119523.981541:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5462 00000100:00100000:0.0:1787119523.981550:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633670016:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119523.981569:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119523.981588:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716900 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.982123:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.982137:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 264) 00010000:00010000:0.0:1787119523.982142:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 264) 00010000:00010000:0.0:1787119523.982148:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.982192:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.982220:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.982235:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653654528:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119523.982875:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:1.0:1787119523.986740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.986808:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633670144 00000100:00100000:3.0:1787119523.986817:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633670144 00002000:00100000:3.0:1787119523.986865:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a606156a00 x1873929633670144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/0 e 0 to 0 dl 1787119534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.986876:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156a00 with x1873929633670144 ext(315392->319487) 00010000:00010000:3.0:1787119523.986886:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.986917:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.986925:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606156a00 00000100:00100000:3.0:1787119523.986959:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1330 00000100:00100000:3.0:1787119523.986967:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633670144:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119523.987159:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633670144:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 191us (427us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119523.987174:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1330 00002000:00100000:3.0:1787119523.987180:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a606156a00 x1873929633670144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787119534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119523.987189:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156a00 with x1873929633670144 ext(315392->319487) 00010000:00010000:3.0:1787119523.987194:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.987208:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119523.987216:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606156a00 00000100:00100000:3.0:1787119523.990208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119523.992229:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633670272 00000100:00100000:2.0:1787119523.992254:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633670272 00000100:00100000:2.0:1787119523.992341:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5463 00000100:00100000:2.0:1787119523.992352:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633670272:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119523.992372:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119523.992392:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716907 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.992423:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 264) 00010000:00010000:2.0:1787119523.992431:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.992491:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 264) 00010000:00010000:2.0:1787119523.992497:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 43 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.992538:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.992552:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 43 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119523.992564:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e600, rc 0) 00000100:00100000:2.0:1787119523.992621:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633670272:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 271us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119523.992629:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5463 00000100:00100000:2.0:1787119523.995355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119523.995475:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633670400 00000100:00100000:3.0:1787119523.995484:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633670400 00010000:00010000:3.0:1787119523.995522:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.995567:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5510 00000100:00100000:3.0:1787119523.995577:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2376:x1873929633670400:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119523.995592:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119523.995616:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.995642:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.995669:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 264) 00010000:00010000:3.0:1787119523.995675:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 264) 00010000:00010000:3.0:1787119523.995683:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.995820:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.995874:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119523.995889:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119523.995903:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653654784:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119523.996032:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999e40 going to sleep for 11 seconds 00010000:00010000:0.0:1787119523.996528:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4260 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f9 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119523.996545:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653654528:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119523.996569:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.996580:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119523.996591:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119523.996624:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633670016:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 15074us (16654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119523.996632:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5462 00000100:00100000:1.0:1787119524.000052:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.000191:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653654784:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.000215:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.000251:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633670528 00000100:00100000:2.0:1787119524.000258:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633670528 00002000:00100000:2.0:1787119524.000304:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a606156300 x1873929633670528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787119524.000315:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633670400:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4739us (5038us total) trans 0 rc 0/0 00002000:00100000:2.0:1787119524.000315:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156300 with x1873929633670528 ext(315392->352255) 00010000:00010000:2.0:1787119524.000322:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.000324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5510 00010000:00010000:2.0:1787119524.000349:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.000357:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606156300 00000100:00100000:2.0:1787119524.000418:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1331 00000100:00100000:2.0:1787119524.000427:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633670528:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119524.001576:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787119524.001594:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653654912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787119524.001649:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119524.001693:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653654912 00000100:00100000:1.0:1787119524.001698:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653654912 00000100:00100000:1.0:1787119524.001794:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787119524.001803:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653654912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787119524.001835:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321847296 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1787119524.001877:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653654912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.001884:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:2.0:1787119524.001996:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787119524.002008:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653655040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119524.002039:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119524.002293:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653655040 00000100:00100000:3.0:1787119524.002298:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653655040 00000100:00100000:3.0:1787119524.002368:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787119524.002376:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653655040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119524.002388:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 22151168 granted 890437632 pending 47710208 free 3828350976 avail 3826253824 00000100:00100000:3.0:1787119524.002425:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653655040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.002431:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787119524.002521:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873929653655552:0@lo:400:kworker.0 00000100:00100000:3.0:1787119524.002550:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119524.002637:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969223 gen 2 00000004:00080000:3.0:1787119524.002642:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92a508fffb80, transno 4294969223 00000100:00100000:3.0:1787119524.002658:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653655040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119524.002674:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787119524.002679:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653655168:0@lo:400:kworker.0 00000100:00100000:3.0:1787119524.002708:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119524.002743:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653655424:0@lo:400:kworker.0 00000100:00100000:3.0:1787119524.002766:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119524.002783:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787119524.002789:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653655296:0@lo:400:kworker.0 00000100:00100000:3.0:1787119524.002810:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119524.002834:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653655552 00000100:00100000:3.0:1787119524.002838:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653655552 00000100:00100000:1.0:1787119524.002899:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968930 gen 2 00000004:00080000:1.0:1787119524.002904:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92a511f57800, transno 4294968930 00000100:00100000:1.0:1787119524.002917:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653654912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787119524.003366:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787119524.003370:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119524.003516:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653655424 00000100:00100000:3.0:1787119524.003520:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653655424 00000100:00080000:2.0:1787119524.003582:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119524.003767:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653655296 00000100:00100000:3.0:1787119524.003772:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653655296 00000100:00100000:3.0:1787119524.003790:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1787119524.003798:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873929653655552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119524.003853:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873929653655552:12345-0@lo:400:kworker.0 Request processed in 56us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.003860:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1787119524.003874:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1787119524.003880:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653655424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119524.003911:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653655424:12345-0@lo:400:kworker.0 Request processed in 31us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.003917:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1787119524.003929:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1787119524.003934:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653655296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119524.003963:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653655296:12345-0@lo:400:kworker.0 Request processed in 29us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.003968:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1787119524.004358:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653655168 00000100:00100000:3.0:1787119524.004362:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653655168 00000100:00100000:2.0:1787119524.012972:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873929653655552:0@lo:400:kworker.0 00000100:00100000:2.0:1787119524.017434:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653655296:0@lo:400:kworker.0 00000100:00100000:2.0:1787119524.017483:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653655424:0@lo:400:kworker.0 00000100:00100000:3.0:1787119524.019329:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1787119524.019347:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653655168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119524.019464:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653655168:12345-0@lo:400:kworker.0 Request processed in 123us (16754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.019473:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1787119524.019520:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653655168:0@lo:400:kworker.0 00000100:00100000:2.0:1787119524.021252:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633670528:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 20817us (21201us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119524.021265:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1331 00002000:00100000:2.0:1787119524.021282:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a606156300 x1873929633670528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.021294:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156300 with x1873929633670528 ext(315392->352255) 00010000:00010000:2.0:1787119524.021306:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.021339:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.021349:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606156300 00000100:00100000:1.0:1787119524.031612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.031758:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633670656 00000100:00100000:3.0:1787119524.031768:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633670656 00000100:00100000:3.0:1787119524.031848:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5464 00000100:00100000:3.0:1787119524.031859:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633670656:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.031877:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.031897:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471690e expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.031930:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 264) 00010000:00010000:3.0:1787119524.031939:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.031947:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 264) 00010000:00010000:3.0:1787119524.031952:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.032014:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.032030:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.032048:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:3.0:1787119524.032107:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633670656:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 250us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.032115:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5464 00000100:00080000:2.0:1787119524.032189:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119524.032761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.032835:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633670784 00000100:00100000:2.0:1787119524.032849:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633670784 00010000:00010000:2.0:1787119524.032874:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 38 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.032908:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5511 00000100:00100000:2.0:1787119524.032916:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633670784:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.032928:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.032951:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 38 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.032990:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 38 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.033010:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4267 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716900 expref: 38 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.033025:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 264) 00010000:00010000:2.0:1787119524.033030:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 264) 00010000:00010000:2.0:1787119524.033039:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.033049:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.033079:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.033094:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 41 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.033108:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653655808:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.033181:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.050079:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653655808:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.050108:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.050163:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633670784:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 17246us (17402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.050175:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5511 00000100:00100000:1.0:1787119524.050538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.050730:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633670912 00000100:00100000:2.0:1787119524.050737:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633670912 00010000:00010000:2.0:1787119524.050783:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 42 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.050819:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5512 00000100:00100000:2.0:1787119524.050829:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633670912:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.050848:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.050871:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 42 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.050902:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 42 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.050927:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e426e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716907 expref: 42 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.050945:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 264) 00010000:00010000:2.0:1787119524.050950:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 264) 00010000:00010000:2.0:1787119524.050959:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.050969:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.051019:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.051032:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653655936:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.051093:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066b40 going to sleep for 11 seconds 00000100:00080000:3.0:1787119524.051201:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119524.057516:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653655936:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.057544:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.057600:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2375:x1873929633670912:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6772us (7061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.057611:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5512 00000100:00100000:0.0:1787119524.061034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.061121:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633671040 00000100:00100000:3.0:1787119524.061131:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633671040 00000100:00100000:3.0:1787119524.061345:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5465 00000100:00100000:3.0:1787119524.061357:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633671040:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.061378:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.061397:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716915 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.061429:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.061471:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 264) 00010000:00010000:3.0:1787119524.061476:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 264) 00010000:00010000:3.0:1787119524.061481:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.061516:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.061542:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 36 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.061558:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653656064:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119524.061651:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.065336:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653656064:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119524.065373:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.065395:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:2.0:1787119524.065479:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633671040:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4125us (4455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.065488:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5465 00000100:00100000:3.0:1787119524.067546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.067641:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633671168 00000100:00100000:0.0:1787119524.067650:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633671168 00010000:00010000:0.0:1787119524.067694:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 37 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.067731:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5513 00000100:00100000:0.0:1787119524.067739:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633671168:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119524.067753:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119524.067774:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 37 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.067798:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 37 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.067823:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4275 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471690e expref: 37 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.067839:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 264) 00010000:00010000:0.0:1787119524.067853:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 264) 00010000:00010000:0.0:1787119524.067862:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.067872:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.067905:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.067921:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653656192:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119524.068004:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.070621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.070949:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633671296 00000100:00100000:2.0:1787119524.070959:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633671296 00000100:00100000:2.0:1787119524.071027:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5466 00000100:00100000:2.0:1787119524.071036:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633671296:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.071054:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.071072:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471691c expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.071116:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.071127:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 264) 00010000:00010000:2.0:1787119524.071132:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 264) 00010000:00010000:2.0:1787119524.071138:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.071181:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.071214:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.071228:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653656320:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119524.071360:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.074212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.074397:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633671424 00000100:00100000:2.0:1787119524.074407:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633671424 00002000:00100000:2.0:1787119524.074486:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a62041c000 x1873929633671424/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.074498:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041c000 with x1873929633671424 ext(315392->319487) 00010000:00010000:2.0:1787119524.074507:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.074537:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.074545:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041c000 00000100:00100000:2.0:1787119524.074571:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1332 00000100:00100000:2.0:1787119524.074580:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633671424:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119524.074831:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653656192:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.074856:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.079675:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633671424:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5084us (5458us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119524.079702:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1332 00002000:00100000:2.0:1787119524.079716:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a62041c000 x1873929633671424/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.079727:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041c000 with x1873929633671424 ext(315392->319487) 00010000:00010000:2.0:1787119524.079738:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.079768:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.079777:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041c000 00000100:00100000:1.0:1787119524.080087:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633671168:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12345us (12545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.080098:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5513 00000100:00100000:2.0:1787119524.090765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.091402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.091529:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633671680 00000100:00100000:1.0:1787119524.091540:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633671680 00010000:00010000:1.0:1787119524.091580:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.091630:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5514 00000100:00100000:1.0:1787119524.091639:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2374:x1873929633671680:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.091655:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.091681:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.091795:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.091826:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 264) 00010000:00010000:1.0:1787119524.091831:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 264) 00010000:00010000:1.0:1787119524.091906:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.091918:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.092487:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.092505:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653656448:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.092593:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.093024:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633671552 00000100:00100000:0.0:1787119524.093031:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633671552 00000100:00100000:0.0:1787119524.093078:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5467 00000100:00100000:0.0:1787119524.093086:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633671552:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.093300:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.093318:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716923 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.093346:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.093355:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 264) 00010000:00010000:0.0:1787119524.093359:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 264) 00010000:00010000:0.0:1787119524.093363:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 44 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.093389:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.093412:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.093431:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653656576:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.093490:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00010000:00010000:3.0:1787119524.095810:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e427c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716915 expref: 44 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.095834:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653656320:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119524.096005:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.096016:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.096026:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e200, rc 0) 00000100:00100000:3.0:1787119524.096100:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633671296:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 25064us (25487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.096110:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5466 00000100:00100000:3.0:1787119524.096715:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653656448:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.096733:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.096774:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2374:x1873929633671680:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5135us (5373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.096783:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5514 00000100:00100000:1.0:1787119524.099217:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653656576:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119524.099255:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.099278:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:1.0:1787119524.099337:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633671552:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6250us (8653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.099345:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5467 00000100:00100000:1.0:1787119524.118053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.118179:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633671808 00000100:00100000:0.0:1787119524.118190:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633671808 00002000:00100000:0.0:1787119524.118244:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a606154a80 x1873929633671808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.118257:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154a80 with x1873929633671808 ext(315392->352255) 00010000:00010000:0.0:1787119524.118266:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.118295:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.118304:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154a80 00000100:00100000:0.0:1787119524.118342:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1333 00000100:00100000:0.0:1787119524.118352:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633671808:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.133343:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633671808:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 14982us (15290us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119524.133358:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1333 00002000:00100000:0.0:1787119524.133369:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a606154a80 x1873929633671808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.133391:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154a80 with x1873929633671808 ext(315392->352255) 00010000:00010000:0.0:1787119524.133403:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.133433:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.133478:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154a80 00000100:00100000:2.0:1787119524.141945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.142002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.142124:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633672064 00000100:00100000:3.0:1787119524.142133:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633672064 00010000:00010000:3.0:1787119524.142185:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.142230:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5515 00000100:00100000:3.0:1787119524.142239:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633672064:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.142253:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.142276:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.142304:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.142332:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e4283 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471691c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.142350:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 264) 00010000:00010000:3.0:1787119524.142356:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 264) 00010000:00010000:3.0:1787119524.142364:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.142374:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.142413:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.142429:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653656704:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.142562:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.144235:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633671936 00000100:00100000:0.0:1787119524.144247:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633671936 00000100:00100000:0.0:1787119524.144302:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5468 00000100:00100000:0.0:1787119524.144311:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633671936:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.144327:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.144344:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471692a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.144372:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.144383:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 264) 00010000:00010000:0.0:1787119524.144387:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 264) 00010000:00010000:0.0:1787119524.144393:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.144424:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.144475:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 41 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.144491:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653656832:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.144565:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.148501:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653656832:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.148540:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.148562:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119524.148616:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633671936:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4305us (6680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.148626:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5468 00000100:00100000:3.0:1787119524.148714:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653656704:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.148726:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.148750:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633672064:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6511us (6747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.148759:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5515 00000100:00100000:3.0:1787119524.151659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.151759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633672192 00000100:00100000:1.0:1787119524.151768:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633672192 00010000:00010000:1.0:1787119524.151807:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.151864:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5516 00000100:00100000:1.0:1787119524.151873:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633672192:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.151889:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.151912:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.151938:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.151964:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e428a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716923 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.151998:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 264) 00010000:00010000:1.0:1787119524.152003:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 264) 00010000:00010000:1.0:1787119524.152012:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.152023:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.152059:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.152073:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653656960:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.152155:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.154509:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653656960:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119524.154534:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119524.154589:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2375:x1873929633672192:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2716us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.154599:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5516 00000100:00100000:3.0:1787119524.165338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.165485:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633672320 00000100:00100000:2.0:1787119524.165494:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633672320 00000100:00100000:2.0:1787119524.165552:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5469 00000100:00100000:2.0:1787119524.165561:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633672320:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.165579:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.165597:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716931 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.165632:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.165641:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 264) 00010000:00010000:2.0:1787119524.165646:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 264) 00010000:00010000:2.0:1787119524.165652:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.165687:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.165713:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 36 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.165727:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653657088:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119524.165809:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.171372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.171655:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633672448 00000100:00100000:0.0:1787119524.171666:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633672448 00002000:00100000:0.0:1787119524.171718:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a62041e300 x1873929633672448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.171731:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041e300 with x1873929633672448 ext(315392->352255) 00010000:00010000:0.0:1787119524.171743:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.171778:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.171785:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041e300 00000100:00100000:0.0:1787119524.171820:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1334 00000100:00100000:0.0:1787119524.171830:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633672448:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.174884:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653657088:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119524.174925:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.174948:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e000, rc 0) 00000100:00100000:2.0:1787119524.175023:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633672320:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9462us (9693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.175032:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5469 00000100:00100000:0.0:1787119524.178403:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633672448:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6563us (7030us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119524.178418:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1334 00002000:00100000:0.0:1787119524.178431:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a62041e300 x1873929633672448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.178476:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041e300 with x1873929633672448 ext(315392->352255) 00010000:00010000:0.0:1787119524.178488:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.178519:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.178528:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041e300 00000100:00100000:1.0:1787119524.181313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.181415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.181684:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633672576 00000100:00100000:3.0:1787119524.181695:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633672576 00000100:00100000:3.0:1787119524.181801:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5470 00000100:00100000:3.0:1787119524.181811:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633672576:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.181830:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787119524.181836:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633672704 00000100:00100000:2.0:1787119524.181840:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633672704 00010000:00010000:3.0:1787119524.181860:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716938 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.181863:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.181889:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5517 00010000:00010000:3.0:1787119524.181893:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 264) 00000100:00100000:2.0:1787119524.181895:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633672704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.181900:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.181906:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.181908:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 264) 00010000:00010000:3.0:1787119524.181913:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 39 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.181928:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 39 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.181950:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 39 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.182235:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.182253:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 39 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.182266:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:3.0:1787119524.182369:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633672576:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 559us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.182377:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5470 00010000:00010000:2.0:1787119524.184818:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4291 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471692a expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.184847:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 264) 00010000:00010000:2.0:1787119524.184853:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 264) 00010000:00010000:2.0:1787119524.184865:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.184876:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.184931:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.184960:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.184987:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653657344:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.185091:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.190014:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653657344:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.190037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119524.190048:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.190104:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633672704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8207us (8687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.190114:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5517 00000100:00100000:3.0:1787119524.190401:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633672832 00000100:00100000:3.0:1787119524.190410:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633672832 00002000:00100000:3.0:1787119524.190538:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a606155500 x1873929633672832/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.190546:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155500 with x1873929633672832 ext(315392->319487) 00010000:00010000:3.0:1787119524.190553:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.190635:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.190641:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606155500 00000100:00100000:3.0:1787119524.190673:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1335 00000100:00100000:3.0:1787119524.190684:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633672832:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119524.190893:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633672832:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 210us (855us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119524.190900:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1335 00002000:00100000:3.0:1787119524.190915:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a606155500 x1873929633672832/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.190924:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155500 with x1873929633672832 ext(315392->319487) 00010000:00010000:3.0:1787119524.190930:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.190943:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.190951:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606155500 00000100:00100000:1.0:1787119524.194640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.194690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.194770:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633672960 00000100:00100000:0.0:1787119524.194780:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633672960 00000100:00100000:3.0:1787119524.194946:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633673088 00000100:00100000:3.0:1787119524.194950:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633673088 00010000:00010000:3.0:1787119524.194989:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.195025:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5518 00000100:00100000:3.0:1787119524.195035:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2376:x1873929633673088:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.195051:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.195072:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.195098:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.195124:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e4298 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716931 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.195143:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 264) 00010000:00010000:3.0:1787119524.195148:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 264) 00010000:00010000:3.0:1787119524.195167:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.195178:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.195216:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.195229:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653657472:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.195309:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.195480:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5471 00000100:00100000:0.0:1787119524.195492:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633672960:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.195508:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.195522:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471693f expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.195542:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.195550:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 264) 00010000:00010000:0.0:1787119524.195553:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 264) 00010000:00010000:0.0:1787119524.195558:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 43 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.195593:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.195609:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 36 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.195620:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653657600:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.195650:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.199061:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653657472:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.199088:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.199153:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2376:x1873929633673088:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4118us (4460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.200260:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5518 00000100:00100000:0.0:1787119524.200499:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653657600:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.200528:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.200549:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119524.200735:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633672960:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5245us (6175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.203318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.203554:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633673216 00000100:00100000:1.0:1787119524.203575:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633673216 00010000:00010000:1.0:1787119524.203615:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.203656:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5519 00000100:00100000:1.0:1787119524.203666:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633673216:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.203681:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.203705:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.203732:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.203758:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e429f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716938 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.203776:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 264) 00010000:00010000:1.0:1787119524.203781:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 264) 00010000:00010000:1.0:1787119524.203788:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.203798:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.203847:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.203862:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653657728:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.203940:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.204782:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5471 00000100:00100000:1.0:1787119524.207402:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653657728:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.207431:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.207512:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2376:x1873929633673216:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3846us (4204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.207523:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5519 00000100:00100000:2.0:1787119524.210337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.210427:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633673344 00000100:00100000:0.0:1787119524.210474:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633673344 00000100:00100000:0.0:1787119524.210534:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5472 00000100:00100000:0.0:1787119524.210544:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633673344:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.210561:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.210591:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716946 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.210625:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.210636:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 264) 00010000:00010000:0.0:1787119524.210641:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 264) 00010000:00010000:0.0:1787119524.210646:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.210680:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.210706:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 41 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.210721:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653657856:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.210803:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.215022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.215168:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633673472 00000100:00100000:2.0:1787119524.215178:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633673472 00010000:00010000:2.0:1787119524.215221:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.215265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5520 00000100:00100000:2.0:1787119524.215276:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633673472:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.215290:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.215309:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.215329:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.215350:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 264) 00010000:00010000:2.0:1787119524.215354:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 264) 00010000:00010000:2.0:1787119524.215361:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.215372:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.215404:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.215418:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653657984:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.215525:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00010000:00010000:0.0:1787119524.216066:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e42a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471693f expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.216080:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653657856:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.216102:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.216110:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119524.216221:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633673344:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5678us (5894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.216227:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5472 00000100:00100000:3.0:1787119524.218787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.218865:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633673600 00000100:00100000:1.0:1787119524.218875:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633673600 00002000:00100000:1.0:1787119524.218922:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a62041ce00 x1873929633673600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.218933:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ce00 with x1873929633673600 ext(315392->352255) 00002000:00010000:1.0:1787119524.218938:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041ce00 00000100:00100000:1.0:1787119524.218983:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10695 00000100:00100000:1.0:1787119524.218994:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633673600:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.219864:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653657984:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.219892:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.219988:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2375:x1873929633673472:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4713us (4975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.219998:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5520 00000100:00100000:3.0:1787119524.221485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.221535:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633673728 00000100:00100000:2.0:1787119524.221544:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633673728 00000100:00100000:2.0:1787119524.221661:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5473 00000100:00100000:2.0:1787119524.221670:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633673728:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.221749:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.221768:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471694d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.221803:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.221818:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 264) 00010000:00010000:2.0:1787119524.221823:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 264) 00010000:00010000:2.0:1787119524.221828:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.221863:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.221889:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.221904:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653658112:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119524.222415:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.222820:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633673600:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3824us (4038us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119524.222830:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10695 00002000:00100000:1.0:1787119524.222841:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a62041ce00 x1873929633673600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.222851:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ce00 with x1873929633673600 ext(315392->352255) 00010000:00010000:1.0:1787119524.222859:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.222878:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119524.222886:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041ce00 00000100:00100000:0.0:1787119524.224487:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653658112:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.224525:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.224546:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e600, rc 0) 00000100:00100000:0.0:1787119524.224590:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633673728:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2921us (3109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.224597:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5473 00000100:00100000:3.0:1787119524.227098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.227136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.227158:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633673856 00000100:00100000:2.0:1787119524.227168:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633673856 00000100:00100000:0.0:1787119524.227223:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633673984 00000100:00100000:2.0:1787119524.227227:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5474 00000100:00100000:0.0:1787119524.227227:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633673984 00000100:00100000:2.0:1787119524.227236:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633673856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.227251:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.227252:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.227268:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716954 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.227288:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5521 00010000:00010000:2.0:1787119524.227295:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 264) 00000100:00100000:0.0:1787119524.227295:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633673984:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.227303:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.227304:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.227314:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 264) 00010000:00010000:2.0:1787119524.227319:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 39 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.227555:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 39 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.227581:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 39 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.227602:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716946 expref: 39 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.227619:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 264) 00010000:00010000:0.0:1787119524.227622:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 264) 00010000:00010000:0.0:1787119524.227630:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.227640:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.227674:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.227931:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.227947:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.227948:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653658240:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.227956:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.227965:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653658368:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119524.228048:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.228083:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.231150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.231223:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653658368:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119524.231257:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.231275:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e200, rc 0) 00000100:00100000:2.0:1787119524.231337:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633673856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4102us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.231346:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5474 00000100:00100000:0.0:1787119524.231426:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653658240:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119524.231469:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119524.231494:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633673984:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4199us (4357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.231504:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5521 00000100:00100000:3.0:1787119524.231722:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633674112 00000100:00100000:3.0:1787119524.231729:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633674112 00002000:00100000:3.0:1787119524.231769:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a606154000 x1873929633674112/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.231778:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154000 with x1873929633674112 ext(315392->319487) 00010000:00010000:3.0:1787119524.231785:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.231810:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.231817:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154000 00000100:00100000:3.0:1787119524.231833:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1336 00000100:00100000:3.0:1787119524.231849:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633674112:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119524.231997:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633674112:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 157us (857us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119524.232004:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1336 00002000:00100000:3.0:1787119524.232010:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a606154000 x1873929633674112/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.232018:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154000 with x1873929633674112 ext(315392->319487) 00010000:00010000:3.0:1787119524.232023:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.232042:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.232050:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154000 00000100:00100000:1.0:1787119524.235906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.235932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.236075:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633674240 00000100:00100000:0.0:1787119524.236085:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633674240 00000100:00100000:2.0:1787119524.236093:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633674368 00000100:00100000:2.0:1787119524.236096:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633674368 00010000:00010000:2.0:1787119524.236121:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.236140:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5475 00000100:00100000:0.0:1787119524.236149:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633674240:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.236164:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.236181:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471695b expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.236200:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5522 00000100:00100000:2.0:1787119524.236207:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2374:x1873929633674368:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119524.236210:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 264) 00010000:00010000:2.0:1787119524.236217:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119524.236218:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.236224:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 264) 00010000:00010000:0.0:1787119524.236228:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 44 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.236238:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 44 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.236261:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 44 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.239459:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471694d expref: 44 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.239486:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 264) 00010000:00010000:2.0:1787119524.239491:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 264) 00010000:00010000:2.0:1787119524.239501:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.239512:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.239566:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.239595:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 36 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.239613:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653658624:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119524.239749:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 36 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.239810:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00010000:00010000:0.0:1787119524.239839:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 43 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.239851:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119524.239885:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633674240:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3737us (3985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.239894:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5475 00000100:00100000:1.0:1787119524.242849:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.242915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633674496 00000100:00100000:3.0:1787119524.242923:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633674496 00010000:00010000:3.0:1787119524.242952:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.243002:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5523 00000100:00100000:3.0:1787119524.243011:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633674496:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.243027:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.243051:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.243071:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.243094:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 264) 00010000:00010000:3.0:1787119524.243098:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 264) 00010000:00010000:3.0:1787119524.243106:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.243117:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.243173:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.243188:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653658752:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.243275:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00010000:00010000:2.0:1787119524.244408:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716954 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.245154:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653658752:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119524.245177:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119524.245235:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633674496:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2224us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.245246:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5523 00000100:00100000:2.0:1787119524.246035:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653658624:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.246065:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.246148:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2374:x1873929633674368:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9941us (10214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.246155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5522 00000100:00100000:3.0:1787119524.256128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.256213:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633674624 00000100:00100000:0.0:1787119524.256223:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633674624 00000100:00100000:0.0:1787119524.256290:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5476 00000100:00100000:0.0:1787119524.256300:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633674624:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.256320:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.256339:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716962 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.256374:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.256384:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 264) 00010000:00010000:0.0:1787119524.256390:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 264) 00010000:00010000:0.0:1787119524.256395:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.256428:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.256489:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 41 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.256505:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653658880:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.256580:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.259324:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653658880:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.259360:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.259381:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119524.259475:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633674624:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3176us (3356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.259484:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5476 00000100:00100000:3.0:1787119524.260942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.261386:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633674752 00000100:00100000:2.0:1787119524.261395:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633674752 00002000:00100000:2.0:1787119524.261467:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a62041ca80 x1873929633674752/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.261479:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ca80 with x1873929633674752 ext(315392->319487) 00010000:00010000:2.0:1787119524.261488:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.261518:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.261527:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041ca80 00000100:00100000:2.0:1787119524.261560:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1337 00000100:00100000:2.0:1787119524.261570:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633674752:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.261752:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633674752:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 184us (816us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119524.261760:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1337 00002000:00100000:2.0:1787119524.261767:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a62041ca80 x1873929633674752/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.261776:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ca80 with x1873929633674752 ext(315392->319487) 00010000:00010000:2.0:1787119524.261781:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.261796:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.261802:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041ca80 00000100:00100000:3.0:1787119524.268383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.268429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.268557:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633674880 00000100:00100000:0.0:1787119524.268567:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633674880 00010000:00010000:0.0:1787119524.268605:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.268638:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5524 00000100:00100000:0.0:1787119524.268647:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633674880:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119524.268661:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119524.268684:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.268713:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.268737:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e42c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471695b expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.268757:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 264) 00010000:00010000:0.0:1787119524.268763:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 264) 00010000:00010000:0.0:1787119524.268771:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.268781:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.268823:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.268851:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653659008:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119524.268937:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.269075:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633675008 00000100:00100000:2.0:1787119524.269080:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633675008 00000100:00100000:2.0:1787119524.269119:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5477 00000100:00100000:2.0:1787119524.269127:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633675008:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.269140:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.269156:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716969 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.269177:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.269184:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 264) 00010000:00010000:2.0:1787119524.269188:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 264) 00010000:00010000:2.0:1787119524.269193:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.269215:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.269231:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 36 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.269241:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653659136:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119524.269269:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.282679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.282800:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653659008:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119524.282826:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119524.282902:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633674880:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 14254us (14527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.282914:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5524 00000100:00100000:3.0:1787119524.283096:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633675136 00000100:00100000:3.0:1787119524.283119:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633675136 00002000:00100000:3.0:1787119524.283172:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a606155180 x1873929633675136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.283183:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155180 with x1873929633675136 ext(315392->352255) 00010000:00010000:3.0:1787119524.283191:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.283220:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.283228:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606155180 00000100:00100000:3.0:1787119524.283257:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1338 00000100:00100000:3.0:1787119524.283265:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633675136:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.284357:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653659136:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119524.284399:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.284419:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e200, rc 0) 00000100:00100000:2.0:1787119524.284491:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633675008:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 15364us (16059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.284499:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5477 00000100:00100000:3.0:1787119524.296681:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633675136:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 13396us (13992us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119524.296697:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1338 00002000:00100000:3.0:1787119524.296712:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a606155180 x1873929633675136/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.296722:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606155180 with x1873929633675136 ext(315392->352255) 00010000:00010000:3.0:1787119524.296735:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.296767:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.296775:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606155180 00000100:00100000:3.0:1787119524.300360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.300552:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633675264 00000100:00100000:2.0:1787119524.300562:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633675264 00000100:00100000:2.0:1787119524.300622:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5478 00000100:00100000:2.0:1787119524.300632:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633675264:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.300650:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.300680:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716970 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.300714:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 264) 00010000:00010000:2.0:1787119524.300723:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.300731:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 264) 00010000:00010000:2.0:1787119524.300737:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.300784:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.300799:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.300813:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e600, rc 0) 00000100:00100000:2.0:1787119524.301032:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633675264:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 400us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.301040:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5478 00000100:00100000:1.0:1787119524.305553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.305644:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633675392 00000100:00100000:3.0:1787119524.305654:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633675392 00010000:00010000:3.0:1787119524.305704:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.305748:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5525 00000100:00100000:3.0:1787119524.305758:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2375:x1873929633675392:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.305773:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.305797:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.305822:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.305862:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e42c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716962 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.305883:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 264) 00010000:00010000:3.0:1787119524.305888:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 264) 00010000:00010000:3.0:1787119524.305896:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.305905:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.305945:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.305960:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.305985:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653659392:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.306074:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.310080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.310188:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653659392:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.310218:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.310284:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633675392:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4526us (4742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.310296:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5525 00000100:00100000:2.0:1787119524.310388:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633675520 00000100:00100000:2.0:1787119524.310396:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633675520 00002000:00100000:2.0:1787119524.310482:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a63403b480 x1873929633675520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.310493:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b480 with x1873929633675520 ext(315392->319487) 00010000:00010000:2.0:1787119524.310503:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.310532:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.310540:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b480 00000100:00100000:2.0:1787119524.310571:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1339 00000100:00100000:2.0:1787119524.310581:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633675520:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.310758:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633675520:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 178us (691us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119524.310765:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1339 00002000:00100000:2.0:1787119524.310771:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a63403b480 x1873929633675520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.310779:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b480 with x1873929633675520 ext(315392->319487) 00010000:00010000:2.0:1787119524.310785:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.310798:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.310805:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b480 00000100:00100000:0.0:1787119524.316068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.316121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.316219:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633675648 00000100:00100000:1.0:1787119524.316228:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633675648 00000100:00100000:1.0:1787119524.316291:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5479 00000100:00100000:1.0:1787119524.316301:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633675648:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119524.316320:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119524.316339:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716977 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.316372:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 264) 00010000:00010000:1.0:1787119524.316382:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.316390:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 264) 00010000:00010000:1.0:1787119524.316395:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 43 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.316476:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.316492:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 43 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.316505:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119524.316559:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633675648:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 259us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.316570:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5479 00000100:00100000:2.0:1787119524.317033:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633675776 00000100:00100000:2.0:1787119524.317040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633675776 00010000:00010000:2.0:1787119524.317066:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.317101:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5526 00000100:00100000:2.0:1787119524.317110:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633675776:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.317121:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.317143:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.317169:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.317193:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e10ac3de/0xcaba3de8463e42d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716969 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.317210:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 264) 00010000:00010000:2.0:1787119524.317215:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 264) 00010000:00010000:2.0:1787119524.317223:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.317233:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.317262:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.317276:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 36 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.317292:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653659648:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.317499:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.322126:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653659648:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119524.322250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119524.322366:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.322425:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633675776:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5315us (6369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.322465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5526 00000100:00100000:2.0:1787119524.322527:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633675904 00000100:00100000:2.0:1787119524.322534:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633675904 00010000:00010000:2.0:1787119524.322562:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.323608:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5527 00000100:00100000:1.0:1787119524.323626:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2373:x1873929633675904:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.323644:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.323669:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.323698:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.323723:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716970 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.323740:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 264) 00010000:00010000:1.0:1787119524.323745:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 264) 00010000:00010000:1.0:1787119524.323753:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.323763:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.323798:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.323811:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653659776:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.323953:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.327147:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653659776:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.327192:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.327253:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2373:x1873929633675904:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3633us (5003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.327264:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5527 00000100:00100000:3.0:1787119524.332327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.332475:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633676032 00000100:00100000:0.0:1787119524.332484:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633676032 00000100:00100000:0.0:1787119524.332529:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5480 00000100:00100000:0.0:1787119524.332537:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633676032:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.332557:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.332574:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471697e expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.332604:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.332615:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 264) 00010000:00010000:0.0:1787119524.332619:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 264) 00010000:00010000:0.0:1787119524.332624:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.332654:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.332683:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 41 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.332698:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653659904:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.332777:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.334719:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653659904:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.334753:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.334775:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:0.0:1787119524.335293:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633676032:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2296us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.335307:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5480 00000100:00100000:2.0:1787119524.337037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.337119:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633676160 00000100:00100000:3.0:1787119524.337129:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633676160 00010000:00010000:3.0:1787119524.337175:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.337214:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5528 00000100:00100000:3.0:1787119524.337223:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633676160:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.337237:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.337260:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.337285:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.337310:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e42de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716977 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.337325:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 264) 00010000:00010000:3.0:1787119524.337329:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 264) 00010000:00010000:3.0:1787119524.337337:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.337346:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.337382:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.337398:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653660032:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.337526:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.340584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.340880:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633676288 00000100:00100000:2.0:1787119524.340888:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633676288 00000100:00100000:2.0:1787119524.340959:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5481 00000100:00100000:2.0:1787119524.340978:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633676288:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.340995:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.341013:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716985 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.341048:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.341065:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 264) 00010000:00010000:2.0:1787119524.341069:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(143 264) 00010000:00010000:2.0:1787119524.341074:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.341106:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.341132:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 36 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.341147:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653660160:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119524.341231:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.343870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.343964:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633676416 00000100:00100000:0.0:1787119524.343983:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633676416 00002000:00100000:0.0:1787119524.344030:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a63eabc000 x1873929633676416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.344042:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633676416 ext(315392->352255) 00010000:00010000:0.0:1787119524.344053:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.344085:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.344099:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabc000 00000100:00100000:0.0:1787119524.344140:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1340 00000100:00100000:0.0:1787119524.344150:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2373:x1873929633676416:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119524.349130:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653660032:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.349160:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.349216:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633676160:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11993us (12186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.349223:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2373:x1873929633676416:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5074us (5364us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119524.349227:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5528 00000100:00100000:0.0:1787119524.349231:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1340 00002000:00100000:0.0:1787119524.349242:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a63eabc000 x1873929633676416/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.349252:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633676416 ext(315392->352255) 00010000:00010000:0.0:1787119524.349261:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.349290:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.349298:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabc000 00000100:00100000:0.0:1787119524.349330:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653660160:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.349360:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.349377:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6f000, rc 0) 00000100:00100000:0.0:1787119524.349401:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633676288:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8434us (8826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.349408:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5481 00000100:00100000:3.0:1787119524.352520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.352611:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633676544 00000100:00100000:2.0:1787119524.352620:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633676544 00000100:00100000:2.0:1787119524.352682:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5482 00000100:00100000:2.0:1787119524.352692:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633676544:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.352712:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.352731:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471698c expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.352765:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(143 264) 00010000:00010000:2.0:1787119524.352774:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.352782:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 264) 00010000:00010000:2.0:1787119524.352787:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.352833:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.352861:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.352874:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e600, rc 0) 00000100:00100000:2.0:1787119524.352942:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633676544:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 251us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.352948:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5482 00000100:00100000:3.0:1787119524.355359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.355512:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633676672 00000100:00100000:0.0:1787119524.355523:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633676672 00010000:00010000:0.0:1787119524.355562:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.355606:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5529 00000100:00100000:0.0:1787119524.355616:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2375:x1873929633676672:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119524.355632:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119524.355657:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.355682:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.355708:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e42e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471697e expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.355727:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 264) 00010000:00010000:0.0:1787119524.355733:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 264) 00010000:00010000:0.0:1787119524.355741:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.355751:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.355798:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.355814:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.355830:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653660416:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119524.355934:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.359283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.359372:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633676800 00000100:00100000:1.0:1787119524.359382:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633676800 00002000:00100000:1.0:1787119524.359431:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a634039180 x1873929633676800/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.359483:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633676800 ext(315392->319487) 00010000:00010000:1.0:1787119524.359493:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.359522:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119524.359532:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039180 00000100:00100000:1.0:1787119524.359557:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1341 00000100:00100000:1.0:1787119524.359568:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633676800:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119524.359777:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633676800:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 210us (502us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119524.359786:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1341 00002000:00100000:1.0:1787119524.359792:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a634039180 x1873929633676800/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.359800:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039180 with x1873929633676800 ext(315392->319487) 00010000:00010000:1.0:1787119524.359806:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.359820:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119524.359828:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039180 00000100:00100000:3.0:1787119524.360113:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653660416:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.360134:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.360182:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633676672:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4567us (4833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.360192:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5529 00000100:00100000:0.0:1787119524.364079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.364309:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633676928 00000100:00100000:2.0:1787119524.364321:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633676928 00000100:00100000:2.0:1787119524.364385:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5483 00000100:00100000:2.0:1787119524.364395:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633676928:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.364414:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.364435:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716993 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.364516:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 264) 00010000:00010000:2.0:1787119524.364525:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.364534:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(146 264) 00010000:00010000:2.0:1787119524.364539:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 43 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.364587:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.364602:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 43 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.364615:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6e000, rc 0) 00000100:00100000:2.0:1787119524.364670:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633676928:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 276us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.364676:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5483 00000100:00100000:2.0:1787119524.367336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.367486:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633677056 00000100:00100000:1.0:1787119524.367496:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633677056 00010000:00010000:1.0:1787119524.367537:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.367582:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5530 00000100:00100000:1.0:1787119524.367592:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633677056:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.367608:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.367635:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.367664:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.367692:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e42ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716985 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.367710:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 264) 00010000:00010000:1.0:1787119524.367715:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 264) 00010000:00010000:1.0:1787119524.367723:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.367732:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.367772:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.367789:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 36 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.367803:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653660672:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.367889:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986000 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.371721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.371818:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653660672:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.371857:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.371921:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633677056:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4328us (4595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.371933:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5530 00000100:00100000:1.0:1787119524.371964:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633677184 00000100:00100000:1.0:1787119524.371986:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633677184 00010000:00010000:1.0:1787119524.372017:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.372054:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5531 00000100:00100000:1.0:1787119524.372063:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633677184:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.372077:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.372102:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.372128:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.372172:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007777d38c/0xcaba3de8463e42f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471698c expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.372191:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 264) 00010000:00010000:1.0:1787119524.372195:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 264) 00010000:00010000:1.0:1787119524.372205:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.372217:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.372256:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.372272:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653660800:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.372325:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986000 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.375430:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653660800:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.375485:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.375535:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633677184:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3472us (3821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.375546:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5531 00000100:00100000:2.0:1787119524.383485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.383791:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633677312 00000100:00100000:0.0:1787119524.383803:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633677312 00000100:00100000:0.0:1787119524.383873:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5484 00000100:00100000:0.0:1787119524.383883:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633677312:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.383902:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.383920:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471699a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.383953:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.383962:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 264) 00010000:00010000:0.0:1787119524.383966:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 264) 00010000:00010000:0.0:1787119524.383984:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.384018:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.384044:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 41 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.384060:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653660928:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.384147:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.387109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.387278:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653660928:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119524.387322:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.387345:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:3.0:1787119524.387405:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633677312:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3523us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.387414:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5484 00000100:00100000:1.0:1787119524.388055:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633677440 00000100:00100000:1.0:1787119524.388065:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633677440 00010000:00010000:1.0:1787119524.388100:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 42 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.388137:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5532 00000100:00100000:1.0:1787119524.388146:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633677440:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.388171:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.388194:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 42 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.388218:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 42 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.388243:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006315af9d/0xcaba3de8463e42fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716993 expref: 42 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.388264:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 264) 00010000:00010000:1.0:1787119524.388269:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 264) 00010000:00010000:1.0:1787119524.388277:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.388288:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.388325:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.388338:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653661056:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.388407:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986000 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.394291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.394339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.394422:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633677696 00000100:00100000:3.0:1787119524.394431:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633677696 00002000:00100000:3.0:1787119524.394509:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a50512ea00 x1873929633677696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.394520:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ea00 with x1873929633677696 ext(315392->352255) 00002000:00010000:3.0:1787119524.394527:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a50512ea00 00000100:00100000:3.0:1787119524.394552:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10696 00000100:00100000:3.0:1787119524.394563:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633677696:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119524.394871:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653661056:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.394895:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.394943:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2375:x1873929633677440:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6797us (7843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.394952:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5532 00000100:00100000:2.0:1787119524.395051:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633677568 00000100:00100000:2.0:1787119524.395056:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633677568 00000100:00100000:2.0:1787119524.395095:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5485 00000100:00100000:2.0:1787119524.395103:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633677568:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.395114:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.395133:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169a1 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.395168:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.395179:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 264) 00010000:00010000:2.0:1787119524.395184:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 264) 00010000:00010000:2.0:1787119524.395190:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.395225:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.395269:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.395286:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653661184:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119524.395340:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.400558:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653661184:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119524.400600:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.400623:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a611f6f000, rc 0) 00000100:00100000:1.0:1787119524.400687:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633677568:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5583us (6404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.400696:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5485 00000100:00100000:3.0:1787119524.401404:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633677696:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6840us (7061us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119524.401415:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10696 00002000:00100000:3.0:1787119524.401427:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a50512ea00 x1873929633677696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.401473:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512ea00 with x1873929633677696 ext(315392->352255) 00010000:00010000:3.0:1787119524.401484:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.401514:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.401522:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512ea00 00000100:00100000:0.0:1787119524.404545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.404676:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633677824 00000100:00100000:2.0:1787119524.404686:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633677824 00000100:00100000:2.0:1787119524.404745:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5486 00000100:00100000:2.0:1787119524.404755:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633677824:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.404772:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.404792:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169a8 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.404826:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 264) 00010000:00010000:2.0:1787119524.404848:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.404854:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(150 264) 00010000:00010000:2.0:1787119524.404859:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.404902:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.404917:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.404931:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a642155400, rc 0) 00000100:00100000:2.0:1787119524.405003:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633677824:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 249us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.405010:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5486 00000100:00100000:2.0:1787119524.406705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.406920:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633677952 00000100:00100000:0.0:1787119524.406928:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633677952 00010000:00010000:0.0:1787119524.406960:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.407049:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5533 00000100:00100000:0.0:1787119524.407059:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2375:x1873929633677952:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119524.407074:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119524.407098:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.407130:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.407169:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4301 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471699a expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.407189:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 264) 00010000:00010000:0.0:1787119524.407194:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 264) 00010000:00010000:0.0:1787119524.407204:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.407215:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.407252:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.407269:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.407283:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a50512d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653661440:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119524.407365:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.411354:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a50512d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653661440:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.411383:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.411462:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633677952:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4402us (4762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.411474:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5533 00000100:00100000:0.0:1787119524.411739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.412180:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633678080 00000100:00100000:1.0:1787119524.412188:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633678080 00002000:00100000:1.0:1787119524.412234:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a50512c700 x1873929633678080/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.412245:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c700 with x1873929633678080 ext(315392->319487) 00010000:00010000:1.0:1787119524.412254:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.412279:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119524.412286:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c700 00000100:00100000:1.0:1787119524.412356:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1342 00000100:00100000:1.0:1787119524.412367:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633678080:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119524.412586:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633678080:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 221us (847us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119524.412593:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1342 00002000:00100000:1.0:1787119524.412600:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a50512c700 x1873929633678080/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.412608:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c700 with x1873929633678080 ext(315392->319487) 00010000:00010000:1.0:1787119524.412614:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.412628:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119524.412635:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c700 00000100:00100000:2.0:1787119524.416500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.416538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.416619:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633678208 00000100:00100000:0.0:1787119524.416630:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633678208 00000100:00100000:0.0:1787119524.416712:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5487 00000100:00100000:0.0:1787119524.416722:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633678208:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.416742:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.416762:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169af expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.416796:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 264) 00010000:00010000:0.0:1787119524.416805:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.416813:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(152 264) 00010000:00010000:0.0:1787119524.416818:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 43 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.416879:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.416895:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 43 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.416910:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119524.416961:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633678208:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 241us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.416981:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5487 00000100:00100000:3.0:1787119524.417510:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633678336 00000100:00100000:3.0:1787119524.417516:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633678336 00010000:00010000:3.0:1787119524.417542:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.417577:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5534 00000100:00100000:3.0:1787119524.417585:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2374:x1873929633678336:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.417595:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.417618:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.417644:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.417666:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea71eebe/0xcaba3de8463e4308 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a1 expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.417683:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 264) 00010000:00010000:3.0:1787119524.417688:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 264) 00010000:00010000:3.0:1787119524.417696:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.417705:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.417735:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.417749:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 36 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.417762:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653661696:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.417843:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.421193:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653661696:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.421218:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.421277:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2374:x1873929633678336:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3691us (4737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.421289:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5534 00000100:00100000:0.0:1787119524.422681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.422777:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633678464 00000100:00100000:1.0:1787119524.422786:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633678464 00010000:00010000:1.0:1787119524.422823:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.422876:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5535 00000100:00100000:1.0:1787119524.422885:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2374:x1873929633678464:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.422902:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.422928:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.422957:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.422999:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e430f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169a8 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.423024:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 264) 00010000:00010000:1.0:1787119524.423029:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 264) 00010000:00010000:1.0:1787119524.423038:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.423049:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.423088:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.423104:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653661824:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.423189:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.425376:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653661824:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.425404:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.425482:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2374:x1873929633678464:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2596us (2807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.425493:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5535 00000100:00100000:2.0:1787119524.432638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.432755:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633678592 00000100:00100000:3.0:1787119524.432767:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633678592 00000100:00100000:3.0:1787119524.432862:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5488 00000100:00100000:3.0:1787119524.432874:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633678592:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.432892:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.432912:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169b6 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.432945:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.432955:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 264) 00010000:00010000:3.0:1787119524.432959:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 264) 00010000:00010000:3.0:1787119524.432964:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.433015:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.433041:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 41 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.433056:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653661952:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119524.433150:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.435553:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653661952:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119524.435591:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.435612:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:3.0:1787119524.435691:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633678592:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2820us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.435700:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5488 00000100:00100000:0.0:1787119524.439704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.439855:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633678720 00000100:00100000:1.0:1787119524.439865:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633678720 00010000:00010000:1.0:1787119524.439904:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 42 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.440117:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5536 00000100:00100000:1.0:1787119524.440129:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633678720:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.440145:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.440201:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 42 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.440229:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 42 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.440274:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4316 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169af expref: 42 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.440295:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 264) 00010000:00010000:1.0:1787119524.440300:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 264) 00010000:00010000:1.0:1787119524.440310:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.440322:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.440364:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.440379:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653662080:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.440707:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.443525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.443610:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633678848 00000100:00100000:1.0:1787119524.443620:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633678848 00000100:00100000:1.0:1787119524.443678:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5489 00000100:00100000:1.0:1787119524.443687:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633678848:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119524.443705:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119524.443726:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169bd expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.443759:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.443770:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 264) 00010000:00010000:1.0:1787119524.443775:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 264) 00010000:00010000:1.0:1787119524.443780:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.443812:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.443870:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 36 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.443884:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653662208:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119524.443997:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.446696:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653662080:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.446724:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.446803:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2376:x1873929633678720:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6675us (7109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.446819:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5536 00000100:00100000:1.0:1787119524.451769:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653662208:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119524.451806:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.451872:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119524.451946:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633678848:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8259us (8431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.451954:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5489 00000100:00100000:2.0:1787119524.456564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.456699:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633678976 00000100:00100000:3.0:1787119524.456709:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633678976 00002000:00100000:3.0:1787119524.456757:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a508da4380 x1873929633678976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.456769:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4380 with x1873929633678976 ext(315392->352255) 00010000:00010000:3.0:1787119524.456778:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.456808:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.456817:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4380 00000100:00100000:3.0:1787119524.456897:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1343 00000100:00100000:3.0:1787119524.456906:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633678976:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.464756:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633678976:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7840us (8191us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119524.464769:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1343 00002000:00100000:0.0:1787119524.464783:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a508da4380 x1873929633678976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.464794:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4380 with x1873929633678976 ext(315392->352255) 00010000:00010000:0.0:1787119524.464806:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.464858:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.464867:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4380 00000100:00100000:2.0:1787119524.468665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.468791:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633679104 00000100:00100000:0.0:1787119524.468800:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633679104 00000100:00100000:0.0:1787119524.468865:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5490 00000100:00100000:0.0:1787119524.468874:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633679104:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.468891:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.468911:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169c4 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.468943:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 264) 00010000:00010000:0.0:1787119524.468951:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.468964:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(156 264) 00010000:00010000:0.0:1787119524.468980:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.469017:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.469031:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.469042:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119524.469095:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633679104:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 222us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.469102:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5490 00000100:00100000:1.0:1787119524.471373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.471478:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633679232 00000100:00100000:3.0:1787119524.471487:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633679232 00010000:00010000:3.0:1787119524.471521:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.471559:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5537 00000100:00100000:3.0:1787119524.471567:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2375:x1873929633679232:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.471581:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.471602:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.471626:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.471650:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e431d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169b6 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.471666:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 264) 00010000:00010000:3.0:1787119524.471671:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 264) 00010000:00010000:3.0:1787119524.471679:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.471689:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.471723:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.471743:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.471756:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653662464:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.471830:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.475695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.475788:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653662464:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.475808:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.475862:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633679232:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4295us (4498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.475871:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5537 00000100:00100000:0.0:1787119524.476344:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633679360 00000100:00100000:0.0:1787119524.476351:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633679360 00002000:00100000:0.0:1787119524.476390:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a62041d880 x1873929633679360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.476401:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d880 with x1873929633679360 ext(315392->319487) 00010000:00010000:0.0:1787119524.476410:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.476473:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.476487:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041d880 00000100:00100000:0.0:1787119524.476512:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1344 00000100:00100000:0.0:1787119524.476521:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633679360:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.476681:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633679360:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 161us (996us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119524.476686:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1344 00002000:00100000:0.0:1787119524.476690:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a62041d880 x1873929633679360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.476696:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d880 with x1873929633679360 ext(315392->319487) 00010000:00010000:0.0:1787119524.476700:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.476709:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.476714:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041d880 00000100:00100000:3.0:1787119524.479609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.479663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.479772:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633679488 00000100:00100000:2.0:1787119524.479782:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633679488 00000100:00100000:2.0:1787119524.479866:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5491 00000100:00100000:2.0:1787119524.479896:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633679488:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.479915:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.479950:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169cb expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.479995:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 264) 00010000:00010000:2.0:1787119524.480005:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.480012:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 264) 00010000:00010000:2.0:1787119524.480017:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 43 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.480057:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.480085:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 43 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.480096:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a642155400, rc 0) 00000100:00100000:2.0:1787119524.480147:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633679488:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 273us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.480580:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5491 00000100:00100000:1.0:1787119524.480828:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633679616 00000100:00100000:1.0:1787119524.480843:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633679616 00010000:00010000:1.0:1787119524.480871:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.480907:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5538 00000100:00100000:1.0:1787119524.480914:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2374:x1873929633679616:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.480924:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.480944:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.480980:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.481003:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4324 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169bd expref: 43 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.481017:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 264) 00010000:00010000:1.0:1787119524.481021:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 264) 00010000:00010000:1.0:1787119524.481029:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.481038:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.481077:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 36 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.481092:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 36 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.481114:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653662720:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.481311:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.486631:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653662720:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.486663:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.486732:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2374:x1873929633679616:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5810us (7124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.486743:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5538 00000100:00100000:3.0:1787119524.489093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.489250:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633679744 00000100:00100000:1.0:1787119524.489260:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633679744 00010000:00010000:1.0:1787119524.489304:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 37 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.489352:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5539 00000100:00100000:1.0:1787119524.489363:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633679744:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.489380:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.489405:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 37 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.489432:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 37 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.489507:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e432b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169c4 expref: 37 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.489527:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 264) 00010000:00010000:1.0:1787119524.489532:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 264) 00010000:00010000:1.0:1787119524.489541:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.489553:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.489596:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.489610:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653662848:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.489712:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.493482:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653662848:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.493512:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.493575:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2376:x1873929633679744:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4213us (4493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.493585:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5539 00000100:00100000:0.0:1787119524.502770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.505401:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633679872 00000100:00100000:3.0:1787119524.505417:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633679872 00000100:00100000:0.0:1787119524.505758:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5492 00000100:00100000:0.0:1787119524.505769:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633679872:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.505787:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.505808:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169d2 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.505945:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.505956:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 264) 00010000:00010000:0.0:1787119524.505975:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 264) 00010000:00010000:0.0:1787119524.505982:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.506019:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.506043:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 41 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.506058:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653662976:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.506418:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.507244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.509805:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633680000 00000100:00100000:0.0:1787119524.509819:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633680000 00002000:00100000:0.0:1787119524.509954:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a508da5180 x1873929633680000/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.509977:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5180 with x1873929633680000 ext(315392->319487) 00010000:00010000:0.0:1787119524.509989:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.510021:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.510029:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5180 00000100:00100000:0.0:1787119524.510082:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1345 00000100:00100000:0.0:1787119524.510091:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633680000:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.511190:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633680000:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1095us (3945us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119524.511201:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1345 00002000:00100000:0.0:1787119524.511211:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a508da5180 x1873929633680000/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.511221:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5180 with x1873929633680000 ext(315392->319487) 00010000:00010000:0.0:1787119524.511229:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.511252:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.511259:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da5180 00000100:00100000:0.0:1787119524.514607:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653662976:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.514646:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.514675:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119524.514744:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633679872:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8976us (11982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.514754:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5492 00000100:00100000:3.0:1787119524.514994:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.515116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.515666:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633680256 00000100:00100000:3.0:1787119524.515677:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633680256 00010000:00010000:3.0:1787119524.515718:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.515748:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5540 00000100:00100000:3.0:1787119524.515756:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633680256:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.515769:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.515792:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.515815:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.515851:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adbd0bc3/0xcaba3de8463e4332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169cb expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.515868:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 264) 00010000:00010000:3.0:1787119524.515873:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 264) 00010000:00010000:3.0:1787119524.515881:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.515893:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.515931:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.515944:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653663104:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.516033:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61382d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.516774:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633680128 00000100:00100000:0.0:1787119524.516781:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633680128 00000100:00100000:0.0:1787119524.516826:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5493 00000100:00100000:0.0:1787119524.516842:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633680128:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.516857:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.516873:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169d9 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.516898:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.516907:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 264) 00010000:00010000:0.0:1787119524.516912:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(161 264) 00010000:00010000:0.0:1787119524.516916:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.516943:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.516964:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 36 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.516995:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653663232:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.517054:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.521169:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653663104:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.521200:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.521264:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633680256:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5507us (6145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.521274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5540 00000100:00100000:0.0:1787119524.521878:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653663232:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.521906:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.521928:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119524.521987:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633680128:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5153us (6993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.521994:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5493 00000100:00100000:1.0:1787119524.525547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.525695:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633680384 00000100:00100000:3.0:1787119524.525706:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633680384 00002000:00100000:3.0:1787119524.525757:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a606154700 x1873929633680384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.525769:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154700 with x1873929633680384 ext(315392->352255) 00010000:00010000:3.0:1787119524.525778:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.525806:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.525814:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154700 00000100:00100000:3.0:1787119524.525854:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1346 00000100:00100000:3.0:1787119524.525865:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2373:x1873929633680384:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.530806:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2373:x1873929633680384:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4932us (5256us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119524.530823:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1346 00002000:00100000:2.0:1787119524.530844:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a606154700 x1873929633680384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.530855:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154700 with x1873929633680384 ext(315392->352255) 00010000:00010000:2.0:1787119524.530865:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.530896:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.530903:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154700 00000100:00100000:3.0:1787119524.533483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.533578:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633680512 00000100:00100000:1.0:1787119524.533587:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633680512 00000100:00100000:1.0:1787119524.533640:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5494 00000100:00100000:1.0:1787119524.533650:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633680512:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119524.533668:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119524.533687:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169e0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.533718:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(161 264) 00010000:00010000:1.0:1787119524.533726:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.533734:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 264) 00010000:00010000:1.0:1787119524.533739:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.533780:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.533794:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.533806:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119524.533855:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633680512:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 206us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.533862:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5494 00000100:00100000:0.0:1787119524.535999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.536220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633680640 00000100:00100000:1.0:1787119524.536229:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633680640 00010000:00010000:1.0:1787119524.536263:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.536301:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5541 00000100:00100000:1.0:1787119524.536311:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2373:x1873929633680640:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.536325:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.536347:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.536372:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.536403:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d2 expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.536420:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 264) 00010000:00010000:1.0:1787119524.536425:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 264) 00010000:00010000:1.0:1787119524.536433:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.536602:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.536640:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.536655:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.536669:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653663488:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.536750:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.540053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.540400:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653663488:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.540427:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.540512:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2373:x1873929633680640:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4201us (4521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.540523:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5541 00000100:00100000:1.0:1787119524.540555:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633680768 00000100:00100000:1.0:1787119524.540630:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633680768 00010000:00010000:1.0:1787119524.540663:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.541016:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5542 00000100:00100000:2.0:1787119524.541029:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2374:x1873929633680768:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.541044:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.541066:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.541090:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.541113:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169d9 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.541129:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 264) 00010000:00010000:2.0:1787119524.541134:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 264) 00010000:00010000:2.0:1787119524.541143:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 36 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.541154:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 36 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.541192:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 36 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.541208:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653663616:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.541279:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.543592:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653663616:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.543619:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.543667:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2374:x1873929633680768:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2639us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.543677:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5542 00000100:00100000:0.0:1787119524.551288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.551406:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633680896 00000100:00100000:1.0:1787119524.551416:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633680896 00000100:00100000:1.0:1787119524.551573:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5495 00000100:00100000:0.0:1787119524.551641:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633680896:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.551661:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.551680:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169e7 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.551713:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 36 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.551724:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 264) 00010000:00010000:0.0:1787119524.551728:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 264) 00010000:00010000:0.0:1787119524.551734:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.551769:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 36 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.551794:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 36 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.551815:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653663744:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.551907:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.554229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.554355:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653663744:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119524.554387:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.554409:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:2.0:1787119524.554481:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633680896:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2899us (3202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.554490:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5495 00000100:00100000:3.0:1787119524.556147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633681024 00000100:00100000:3.0:1787119524.556218:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633681024 00000100:00100000:1.0:1787119524.556480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.556553:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633681152 00000100:00100000:0.0:1787119524.556558:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633681152 00000100:00100000:0.0:1787119524.556629:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5496 00000100:00100000:0.0:1787119524.556639:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633681152:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.556656:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.556674:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169ee expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.556705:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 264) 00010000:00010000:0.0:1787119524.556714:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.556721:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 264) 00010000:00010000:0.0:1787119524.556727:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 39 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.556767:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.556784:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 39 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.556796:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119524.557262:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633681152:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 622us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.557271:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5496 00010000:00010000:2.0:1787119524.557363:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 38 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.557398:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5543 00000100:00100000:2.0:1787119524.557406:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2375:x1873929633681024:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.557417:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.557543:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 38 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.557570:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 38 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.557593:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4347 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e0 expref: 38 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.557607:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 264) 00010000:00010000:2.0:1787119524.557612:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 264) 00010000:00010000:2.0:1787119524.557620:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.557630:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.557661:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.557682:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 41 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.557695:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653664000:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.557753:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.561541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.561654:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653664000:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.561677:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.561721:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633681024:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4314us (7497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.561731:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5543 00000100:00100000:3.0:1787119524.562405:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633681280 00000100:00100000:3.0:1787119524.562415:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633681280 00002000:00100000:3.0:1787119524.562493:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a606154e00 x1873929633681280/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.562503:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154e00 with x1873929633681280 ext(315392->319487) 00010000:00010000:3.0:1787119524.562513:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.562541:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.562553:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154e00 00000100:00100000:3.0:1787119524.562584:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1347 00000100:00100000:3.0:1787119524.562594:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633681280:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119524.562776:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633681280:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 183us (1243us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119524.562784:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1347 00002000:00100000:3.0:1787119524.562790:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a606154e00 x1873929633681280/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.562798:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606154e00 with x1873929633681280 ext(315392->319487) 00010000:00010000:3.0:1787119524.562804:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.562818:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.562824:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606154e00 00000100:00100000:1.0:1787119524.566045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.566128:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633681408 00000100:00100000:0.0:1787119524.566138:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633681408 00000100:00100000:0.0:1787119524.566192:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5497 00000100:00100000:0.0:1787119524.566202:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633681408:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.566221:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.566240:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169f5 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.566273:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 264) 00010000:00010000:0.0:1787119524.566281:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.566288:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 264) 00010000:00010000:0.0:1787119524.566293:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.566333:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.566347:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.566359:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119524.566417:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633681408:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 217us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.566423:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5497 00000100:00100000:0.0:1787119524.568040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.568117:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633681536 00000100:00100000:2.0:1787119524.568125:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633681536 00010000:00010000:2.0:1787119524.568159:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.568203:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5544 00000100:00100000:2.0:1787119524.568212:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633681536:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.568226:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.568249:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.568274:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.568303:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e434e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169e7 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.568322:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 264) 00010000:00010000:2.0:1787119524.568326:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 264) 00010000:00010000:2.0:1787119524.568334:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.568344:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.568378:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.568406:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 36 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.568420:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653664256:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.568545:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.572113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.572150:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653664256:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.572190:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.572255:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633681536:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4043us (4220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.572266:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5544 00000100:00100000:0.0:1787119524.572699:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633681664 00000100:00100000:0.0:1787119524.572707:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633681664 00002000:00100000:0.0:1787119524.572747:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a508da6300 x1873929633681664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.572757:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6300 with x1873929633681664 ext(315392->352255) 00010000:00010000:0.0:1787119524.572765:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.572791:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.572798:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6300 00000100:00100000:0.0:1787119524.572839:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1348 00000100:00100000:0.0:1787119524.572849:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633681664:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.576815:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633681664:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3956us (4700us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119524.576827:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1348 00002000:00100000:0.0:1787119524.577241:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a508da6300 x1873929633681664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.577252:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6300 with x1873929633681664 ext(315392->352255) 00010000:00010000:0.0:1787119524.577263:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.577293:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.577302:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6300 00000100:00100000:2.0:1787119524.579360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.579479:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633681792 00000100:00100000:3.0:1787119524.579488:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633681792 00000100:00100000:3.0:1787119524.579544:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5498 00000100:00100000:3.0:1787119524.579552:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633681792:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.579569:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.579588:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047169fc expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.579624:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 264) 00010000:00010000:3.0:1787119524.579632:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.579640:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 264) 00010000:00010000:3.0:1787119524.579645:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 38 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.579684:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.579698:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 38 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.579710:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:3.0:1787119524.579758:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633681792:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 207us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.579765:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5498 00000100:00100000:1.0:1787119524.582268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.582340:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633681920 00000100:00100000:3.0:1787119524.582349:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633681920 00010000:00010000:3.0:1787119524.582385:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.582425:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5545 00000100:00100000:3.0:1787119524.582435:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2375:x1873929633681920:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.582484:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.582508:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.582534:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.582560:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4355 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169ee expref: 38 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.582580:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 264) 00010000:00010000:3.0:1787119524.582585:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 264) 00010000:00010000:3.0:1787119524.582594:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.582605:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.582642:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.582657:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 41 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.582671:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653664512:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.582746:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.585112:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653664512:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.585137:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.585198:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633681920:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2764us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.585207:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5545 00000100:00100000:2.0:1787119524.587320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.587491:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633682048 00000100:00100000:1.0:1787119524.587501:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633682048 00010000:00010000:1.0:1787119524.587540:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.587571:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5546 00000100:00100000:1.0:1787119524.587580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2373:x1873929633682048:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.587595:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.587617:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.587648:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.587670:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e435c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169f5 expref: 42 pid: 6696 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.587688:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 264) 00010000:00010000:1.0:1787119524.587693:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 264) 00010000:00010000:1.0:1787119524.587700:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 36 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.587709:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 36 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.587744:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 36 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.587757:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653664640:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.587841:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.590381:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653664640:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.590407:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.590491:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2373:x1873929633682048:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2911us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.590503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5546 00000100:00100000:2.0:1787119524.598820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.599063:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633682176 00000100:00100000:0.0:1787119524.599073:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633682176 00000100:00100000:0.0:1787119524.599163:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5499 00000100:00100000:0.0:1787119524.599172:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633682176:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.599191:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.599210:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a03 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.599243:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 36 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.599269:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 264) 00010000:00010000:0.0:1787119524.599274:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 264) 00010000:00010000:0.0:1787119524.599280:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.599323:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 36 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.599348:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 36 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.599361:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653664768:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.599479:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.604023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.604105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.604181:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633682432 00000100:00100000:3.0:1787119524.604190:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633682432 00000100:00100000:3.0:1787119524.604248:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5500 00000100:00100000:3.0:1787119524.604257:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633682432:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.604276:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.604296:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a0a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.604327:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 264) 00010000:00010000:3.0:1787119524.604334:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.604341:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 264) 00010000:00010000:3.0:1787119524.604346:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.604380:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.604394:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.604408:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:3.0:1787119524.604481:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633682432:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 225us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.604488:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5500 00000100:00100000:2.0:1787119524.604985:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633682304 00000100:00100000:2.0:1787119524.604991:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633682304 00010000:00010000:2.0:1787119524.605016:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 38 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.605049:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5547 00000100:00100000:2.0:1787119524.605057:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633682304:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.605067:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.605087:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 38 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.605110:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 38 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.605129:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 264) 00010000:00010000:2.0:1787119524.605133:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 264) 00010000:00010000:2.0:1787119524.605141:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.605159:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.605185:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.605199:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.605211:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653665024:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.605267:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00010000:00010000:0.0:1787119524.607095:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4363 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047169fc expref: 38 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.607120:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653664768:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.607765:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.607779:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.607805:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119524.607883:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633682176:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8712us (9073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.607893:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5499 00000100:00100000:0.0:1787119524.609186:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653665024:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119524.609208:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119524.609256:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633682304:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4199us (5242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.609265:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5547 00000100:00100000:3.0:1787119524.613242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.613375:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633682560 00000100:00100000:2.0:1787119524.613385:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633682560 00002000:00100000:2.0:1787119524.613436:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a62041f100 x1873929633682560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.613483:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f100 with x1873929633682560 ext(315392->319487) 00010000:00010000:2.0:1787119524.613494:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.613523:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.613530:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041f100 00000100:00100000:2.0:1787119524.613571:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1349 00000100:00100000:2.0:1787119524.613581:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633682560:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.613795:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633682560:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 214us (562us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119524.613802:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1349 00002000:00100000:2.0:1787119524.613809:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a62041f100 x1873929633682560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.613819:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f100 with x1873929633682560 ext(315392->319487) 00010000:00010000:2.0:1787119524.613825:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.615539:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 42 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119524.615550:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041f100 00000100:00100000:2.0:1787119524.618318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.618605:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633682688 00000100:00100000:1.0:1787119524.618616:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633682688 00000100:00100000:1.0:1787119524.618677:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5501 00000100:00100000:1.0:1787119524.618687:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633682688:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119524.618718:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119524.618738:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a11 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.618773:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 264) 00010000:00010000:1.0:1787119524.618782:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.618788:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 264) 00010000:00010000:1.0:1787119524.618793:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 43 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.618843:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.618858:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 43 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.618871:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:1.0:1787119524.618932:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633682688:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 247us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.618940:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5501 00000100:00100000:1.0:1787119524.621818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.622682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633682816 00000100:00100000:3.0:1787119524.622695:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633682816 00010000:00010000:2.0:1787119524.623037:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.623120:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5548 00000100:00100000:2.0:1787119524.623130:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2376:x1873929633682816:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.623147:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.623186:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.623214:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.623240:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e436a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a03 expref: 43 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.623268:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 264) 00010000:00010000:2.0:1787119524.623273:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 264) 00010000:00010000:2.0:1787119524.623283:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.623295:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.623337:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.623353:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 36 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.623369:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653665280:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.623500:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.628113:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653665280:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.628143:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.628257:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633682816:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5127us (6446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.628270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5548 00000100:00100000:2.0:1787119524.628330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.629469:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633682944 00000100:00100000:0.0:1787119524.629481:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633682944 00002000:00100000:0.0:1787119524.629533:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a508da4a80 x1873929633682944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.629544:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4a80 with x1873929633682944 ext(315392->352255) 00010000:00010000:0.0:1787119524.629554:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.629583:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.629591:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4a80 00000100:00100000:0.0:1787119524.629615:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1350 00000100:00100000:0.0:1787119524.629624:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633682944:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119524.636260:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633682944:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6625us (7918us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119524.636293:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1350 00002000:00100000:1.0:1787119524.636307:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a508da4a80 x1873929633682944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.636320:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4a80 with x1873929633682944 ext(315392->352255) 00010000:00010000:1.0:1787119524.636330:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.636362:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119524.636371:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da4a80 00000100:00100000:3.0:1787119524.641900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.642432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.642537:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633683200 00000100:00100000:1.0:1787119524.642548:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633683200 00010000:00010000:1.0:1787119524.642587:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.642628:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5549 00000100:00100000:1.0:1787119524.642637:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633683200:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.642652:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.642675:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.642717:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.642745:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4371 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a0a expref: 37 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.642763:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 264) 00010000:00010000:1.0:1787119524.642769:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 264) 00010000:00010000:1.0:1787119524.642777:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.642787:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.642827:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.642854:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653665408:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.642935:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.643384:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633683072 00000100:00100000:0.0:1787119524.643390:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633683072 00000100:00100000:0.0:1787119524.643432:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5502 00000100:00100000:0.0:1787119524.643478:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633683072:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.643533:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.643548:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a18 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.643571:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.643579:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 264) 00010000:00010000:0.0:1787119524.643582:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 264) 00010000:00010000:0.0:1787119524.643587:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 38 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.643610:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.643628:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 41 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.643640:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653665536:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.643680:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.648661:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653665408:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.648689:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.648753:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633683200:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6116us (6321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.648764:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5549 00000100:00100000:2.0:1787119524.648871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.648959:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633683328 00000100:00100000:1.0:1787119524.648984:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633683328 00010000:00010000:1.0:1787119524.649014:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 42 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.649054:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5550 00000100:00100000:1.0:1787119524.649064:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2374:x1873929633683328:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.649078:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.649100:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 42 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.649127:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 42 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.649166:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 264) 00010000:00010000:1.0:1787119524.649171:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 264) 00010000:00010000:1.0:1787119524.649179:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.649191:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.649226:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.649240:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653665664:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.649295:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00010000:00010000:0.0:1787119524.649600:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4378 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a11 expref: 42 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.649615:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653665536:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.649637:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.649647:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119524.649675:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633683072:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6236us (7852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.649682:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5502 00000100:00100000:1.0:1787119524.654298:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653665664:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.654324:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.654421:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2374:x1873929633683328:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5357us (5550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.654432:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5550 00000100:00100000:1.0:1787119524.659341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.659609:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633683456 00000100:00100000:3.0:1787119524.659620:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633683456 00000100:00100000:3.0:1787119524.659730:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5503 00000100:00100000:3.0:1787119524.659741:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633683456:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.659760:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.659778:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a1f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.659812:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.659821:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 264) 00010000:00010000:3.0:1787119524.659826:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 264) 00010000:00010000:3.0:1787119524.659842:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 42 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.659882:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 36 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.659908:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 36 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.659924:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653665792:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119524.660078:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.663292:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653665792:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119524.663330:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 42 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.663353:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84400, rc 0) 00000100:00100000:3.0:1787119524.663488:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633683456:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3747us (4156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.663498:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5503 00000100:00100000:1.0:1787119524.666723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.667040:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633683584 00000100:00100000:2.0:1787119524.667053:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633683584 00010000:00010000:2.0:1787119524.667101:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.667142:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5551 00000100:00100000:2.0:1787119524.667158:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633683584:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.667174:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.667199:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.667227:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.667256:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e437f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a18 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.667278:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 264) 00010000:00010000:2.0:1787119524.667283:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 264) 00010000:00010000:2.0:1787119524.667292:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.667302:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.667343:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.667357:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653665920:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.667435:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.668637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.668845:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633683712 00000100:00100000:2.0:1787119524.668854:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633683712 00000100:00100000:2.0:1787119524.668909:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5504 00000100:00100000:2.0:1787119524.668919:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633683712:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.668935:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.668954:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a26 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.669141:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.669162:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 264) 00010000:00010000:2.0:1787119524.669166:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 264) 00010000:00010000:2.0:1787119524.669171:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 38 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.669199:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.669223:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 41 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.669237:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653666048:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119524.669315:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.673724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.673752:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633683840 00000100:00100000:0.0:1787119524.673760:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633683840 00002000:00100000:0.0:1787119524.673801:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a63eb28e00 x1873929633683840/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.673813:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28e00 with x1873929633683840 ext(315392->319487) 00010000:00010000:0.0:1787119524.673822:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 42 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.673856:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 42 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.673865:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28e00 00000100:00100000:0.0:1787119524.673892:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1351 00000100:00100000:0.0:1787119524.673903:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633683840:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.674110:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633683840:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 208us (394us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119524.674117:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1351 00002000:00100000:0.0:1787119524.674122:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a63eb28e00 x1873929633683840/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.674130:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28e00 with x1873929633683840 ext(315392->319487) 00010000:00010000:0.0:1787119524.674135:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 42 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.674148:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 42 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.674166:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28e00 00000100:00100000:1.0:1787119524.675312:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653665920:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.675342:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.675403:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633683584:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8252us (8700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.675414:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5551 00000100:00100000:2.0:1787119524.678693:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653666048:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119524.678744:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.678774:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894600, rc 0) 00000100:00100000:2.0:1787119524.678849:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633683712:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9931us (10218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.678857:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5504 00000100:00100000:0.0:1787119524.679512:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.679639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.680047:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633683968 00000100:00100000:3.0:1787119524.680055:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633683968 00000100:00100000:3.0:1787119524.680113:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5505 00000100:00100000:3.0:1787119524.680123:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633683968:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.680140:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.680170:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a2d expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.680204:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 264) 00010000:00010000:3.0:1787119524.680212:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.680218:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 264) 00010000:00010000:3.0:1787119524.680224:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 43 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.680259:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.680273:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 43 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.680285:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:3.0:1787119524.680323:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633683968:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 202us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.680330:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5505 00000100:00100000:2.0:1787119524.681042:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633684096 00000100:00100000:2.0:1787119524.681049:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633684096 00010000:00010000:2.0:1787119524.681075:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 43 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.681109:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5552 00000100:00100000:2.0:1787119524.681118:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2376:x1873929633684096:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.681129:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.681314:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 43 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.681341:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 43 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.681365:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4386 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a1f expref: 43 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.681379:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 264) 00010000:00010000:2.0:1787119524.681384:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 264) 00010000:00010000:2.0:1787119524.681393:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.681403:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.681478:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.681495:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 36 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.681510:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653666304:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.681584:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.691082:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653666304:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.691109:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.691179:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633684096:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10061us (11538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.691189:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5552 00000100:00100000:1.0:1787119524.691545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.691639:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633684224 00000100:00100000:0.0:1787119524.691647:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633684224 00002000:00100000:0.0:1787119524.691689:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a511633800 x1873929633684224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.691710:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633800 with x1873929633684224 ext(315392->352255) 00010000:00010000:0.0:1787119524.691719:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.691745:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.691758:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633800 00000100:00100000:0.0:1787119524.691782:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1352 00000100:00100000:0.0:1787119524.691791:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2374:x1873929633684224:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.699555:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2374:x1873929633684224:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7639us (7885us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119524.699572:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1352 00002000:00100000:0.0:1787119524.699585:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (315392->352255) req@ffff92a511633800 x1873929633684224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.699597:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633800 with x1873929633684224 ext(315392->352255) 00010000:00010000:0.0:1787119524.699608:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.699638:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.699647:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633800 00000100:00100000:1.0:1787119524.704000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.704142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.704249:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633684480 00000100:00100000:2.0:1787119524.704261:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633684480 00010000:00010000:2.0:1787119524.704303:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.704350:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5553 00000100:00100000:2.0:1787119524.704360:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2373:x1873929633684480:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.704380:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.704404:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.704432:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.704476:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e438d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a26 expref: 37 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.704497:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 264) 00010000:00010000:2.0:1787119524.704502:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 264) 00010000:00010000:2.0:1787119524.704510:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.704520:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.704557:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.704572:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653666432:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.704655:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.708264:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653666432:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.708290:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.708353:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2373:x1873929633684480:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3993us (4210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.708365:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5553 00000100:00100000:0.0:1787119524.709776:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633684352 00000100:00100000:0.0:1787119524.709787:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633684352 00000100:00100000:0.0:1787119524.709933:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5506 00000100:00100000:0.0:1787119524.709944:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633684352:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.709973:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.709994:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a34 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.710029:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.710039:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 264) 00010000:00010000:0.0:1787119524.710043:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 264) 00010000:00010000:0.0:1787119524.710047:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.710077:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.710101:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 41 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.710114:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653666560:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.710243:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.715019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.715365:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633684608 00000100:00100000:1.0:1787119524.715376:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633684608 00010000:00010000:1.0:1787119524.715418:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.715478:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5554 00000100:00100000:1.0:1787119524.715488:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6180b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633684608:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.715505:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.715527:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.715555:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.715583:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 264) 00010000:00010000:1.0:1787119524.715588:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 264) 00010000:00010000:1.0:1787119524.715597:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.715607:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.715648:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.715664:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653666688:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.715764:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.718097:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653666688:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.718126:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.718191:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6180b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633684608:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2703us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.718203:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5554 00000100:00100000:3.0:1787119524.720338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.720479:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633684736 00000100:00100000:0.0:1787119524.720489:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633684736 00000100:00100000:0.0:1787119524.720547:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5507 00000100:00100000:0.0:1787119524.720557:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633684736:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.720575:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.720595:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a3b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.720632:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.720643:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 264) 00010000:00010000:0.0:1787119524.720648:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 264) 00010000:00010000:0.0:1787119524.720653:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.720690:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.720846:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.720863:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653666816:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.720949:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.723378:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653666816:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119524.723417:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.723478:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:3.0:1787119524.723662:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633684736:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3105us (3331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.723671:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5507 00010000:00010000:2.0:1787119524.723797:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4394 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a2d expref: 42 pid: 20843 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.723814:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653666560:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119524.723845:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.723854:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.723862:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:2.0:1787119524.723889:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633684352:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13947us (19900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.723896:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5506 00000100:00100000:3.0:1787119524.727490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.727580:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633684864 00000100:00100000:2.0:1787119524.727590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633684864 00010000:00010000:2.0:1787119524.727629:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.727672:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5555 00000100:00100000:2.0:1787119524.727682:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2373:x1873929633684864:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.727697:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119524.727733:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.727760:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.727787:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e439b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a34 expref: 37 pid: 8267 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.727810:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 264) 00010000:00010000:2.0:1787119524.727815:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 264) 00010000:00010000:2.0:1787119524.727823:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.727847:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.727887:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.727902:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653666944:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.727997:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.731356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.731477:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653666944:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.731500:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119524.731550:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2373:x1873929633684864:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3868us (4114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.731563:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5555 00000100:00100000:0.0:1787119524.732008:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633684992 00000100:00100000:0.0:1787119524.732017:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633684992 00002000:00100000:0.0:1787119524.732067:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a63eabed80 x1873929633684992/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.732077:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabed80 with x1873929633684992 ext(315392->319487) 00002000:00010000:0.0:1787119524.732082:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabed80 00000100:00100000:0.0:1787119524.732115:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10697 00000100:00100000:0.0:1787119524.732123:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633684992:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.732317:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633684992:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 194us (969us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119524.732325:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10697 00002000:00100000:0.0:1787119524.732331:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff92a63eabed80 x1873929633684992/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.732338:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabed80 with x1873929633684992 ext(315392->319487) 00002000:00010000:0.0:1787119524.732341:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabed80 00000100:00100000:1.0:1787119524.736323:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.736426:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633685120 00000100:00100000:2.0:1787119524.736436:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633685120 00002000:00100000:2.0:1787119524.736513:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (319488->323583) req@ffff92a63eabe680 x1873929633685120/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.736524:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe680 with x1873929633685120 ext(319488->323583) 00002000:00010000:2.0:1787119524.736530:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabe680 00000100:00100000:2.0:1787119524.736563:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10698 00000100:00100000:2.0:1787119524.736574:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633685120:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.736774:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2375:x1873929633685120:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 201us (461us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119524.736781:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10698 00002000:00100000:2.0:1787119524.736788:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (319488->323583) req@ffff92a63eabe680 x1873929633685120/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.736796:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe680 with x1873929633685120 ext(319488->323583) 00002000:00010000:2.0:1787119524.736799:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabe680 00000100:00100000:3.0:1787119524.739407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.740381:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633685248 00000100:00100000:2.0:1787119524.740393:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633685248 00000100:00100000:2.0:1787119524.740490:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5508 00000100:00100000:2.0:1787119524.740502:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:33946:x1873929633685248:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.740522:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.740544:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a42 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.740582:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.740591:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 264) 00010000:00010000:2.0:1787119524.740596:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 264) 00010000:00010000:2.0:1787119524.740601:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.740634:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.740660:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 41 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.740675:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653667072:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119524.740823:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.746525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.746563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.746665:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633685376 00000100:00100000:3.0:1787119524.746675:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633685376 00002000:00100000:3.0:1787119524.746734:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a63eabdf80 x1873929633685376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.746745:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdf80 with x1873929633685376 ext(323584->327679) 00010000:00010000:3.0:1787119524.746754:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 42 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.746785:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 42 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.746793:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabdf80 00000100:00100000:3.0:1787119524.746822:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633685504 00000100:00100000:3.0:1787119524.746825:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633685504 00002000:00100000:3.0:1787119524.746850:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff92a63eabf480 x1873929633685504/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 8680/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.746859:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf480 with x1873929633685504 ext(315392->323583) 00010000:00010000:3.0:1787119524.746864:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 43 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.746878:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 43 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.746885:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabf480 00000100:00100000:3.0:1787119524.746904:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1353 00000100:00100000:3.0:1787119524.746914:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633685376:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119524.747110:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633685376:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 196us (595us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119524.747119:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1353 00002000:00100000:3.0:1787119524.747125:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a63eabdf80 x1873929633685376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.747134:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdf80 with x1873929633685376 ext(323584->327679) 00010000:00010000:3.0:1787119524.747139:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 43 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.747164:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 43 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.747171:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabdf80 00000100:00100000:3.0:1787119524.747187:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1354 00000100:00100000:3.0:1787119524.747194:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633685504:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119524.747510:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2376:x1873929633685504:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 316us (946us total) trans 4294969261 rc 0/0 00000100:00100000:3.0:1787119524.747517:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1354 00002000:00100000:3.0:1787119524.747522:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff92a63eabf480 x1873929633685504/t4294969261(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 8680/448 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.747531:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabf480 with x1873929633685504 ext(315392->323583) 00010000:00010000:3.0:1787119524.747537:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 44 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.747550:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 44 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.747558:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eabf480 00000100:00100000:1.0:1787119524.751207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.751362:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633685632 00000100:00100000:3.0:1787119524.751373:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633685632 00000100:00100000:3.0:1787119524.751435:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5509 00000100:00100000:3.0:1787119524.751475:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+44:33957:x1873929633685632:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.751495:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.751517:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a49 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.751553:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 264) 00010000:00010000:3.0:1787119524.751559:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 264) 00010000:00010000:3.0:1787119524.751565:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 45 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.751579:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 45 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.751593:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:3.0:1787119524.751664:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+45:33957:x1873929633685632:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 191us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.751671:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5509 00000100:00100000:2.0:1787119524.752624:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653667072:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119524.752656:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 37 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.752673:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894600, rc 0) 00000100:00100000:2.0:1787119524.752727:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633685248:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 12228us (13329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.752735:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5508 00000100:00100000:3.0:1787119524.753892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.754759:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633685760 00000100:00100000:2.0:1787119524.754770:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633685760 00010000:00010000:2.0:1787119524.754813:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 45 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.754871:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5556 00000100:00100000:2.0:1787119524.754881:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2375:x1873929633685760:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119524.754897:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787119524.754918:0:20609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119522 -> 1787119523 00002000:00010000:2.0:1787119524.754922:0:20609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119522 -> 1787119523 00010000:00010000:2.0:1787119524.754928:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 45 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.754952:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 45 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.754996:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [315392->33869823] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a3b expref: 45 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.755015:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 264) 00010000:00010000:2.0:1787119524.755020:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 264) 00010000:00010000:2.0:1787119524.755028:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.755038:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.755051:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 264) 00010000:00010000:2.0:1787119524.755054:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 264) 00010000:00010000:2.0:1787119524.755058:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 44 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.755066:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 44 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.755105:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 44 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.755119:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653667200:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119524.756460:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119524.756483:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653667328:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119524.756527:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.762001:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653667200:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.762019:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653667328:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.762046:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.762105:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2375:x1873929633685760:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7224us (8218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.762117:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5556 00000100:00100000:1.0:1787119524.771913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.772059:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633685888 00000100:00100000:2.0:1787119524.772070:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633685888 00002000:00100000:2.0:1787119524.772121:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff92a63eabe300 x1873929633685888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.772134:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe300 with x1873929633685888 ext(315392->323583) 00002000:00010000:2.0:1787119524.772140:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabe300 00000100:00100000:2.0:1787119524.772185:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10699 00000100:00100000:2.0:1787119524.772196:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633685888:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.772418:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633685888:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 222us (514us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119524.772426:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10699 00002000:00100000:2.0:1787119524.772433:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff92a63eabe300 x1873929633685888/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/8632 e 0 to 0 dl 1787119535 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.772480:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe300 with x1873929633685888 ext(315392->323583) 00002000:00010000:2.0:1787119524.772484:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabe300 00000100:00100000:0.0:1787119524.775639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.775846:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633686016 00000100:00100000:1.0:1787119524.775857:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633686016 00002000:00100000:1.0:1787119524.775906:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a63eb2b800 x1873929633686016/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.775916:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633686016 ext(323584->327679) 00002000:00010000:1.0:1787119524.775922:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b800 00000100:00100000:1.0:1787119524.775954:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10700 00000100:00100000:1.0:1787119524.775972:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2373:x1873929633686016:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119524.776173:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2373:x1873929633686016:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 210us (542us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119524.776180:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10700 00002000:00100000:1.0:1787119524.776186:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a63eb2b800 x1873929633686016/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.776194:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2b800 with x1873929633686016 ext(323584->327679) 00002000:00010000:1.0:1787119524.776197:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eb2b800 00000100:00100000:1.0:1787119524.781522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.781757:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633686144 00000100:00100000:0.0:1787119524.781768:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633686144 00002000:00100000:0.0:1787119524.781819:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a63eabca80 x1873929633686144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.781844:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabca80 with x1873929633686144 ext(327680->331775) 00002000:00010000:0.0:1787119524.781850:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabca80 00000100:00100000:0.0:1787119524.781886:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10701 00000100:00100000:0.0:1787119524.781895:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2374:x1873929633686144:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.782480:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2374:x1873929633686144:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 547us (931us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119524.782490:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10701 00002000:00100000:0.0:1787119524.782499:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a63eabca80 x1873929633686144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.782508:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabca80 with x1873929633686144 ext(327680->331775) 00002000:00010000:0.0:1787119524.782512:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabca80 00000100:00100000:3.0:1787119524.783536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.783629:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633686272 00000100:00100000:1.0:1787119524.783640:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633686272 00000100:00100000:1.0:1787119524.783697:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5510 00000100:00100000:1.0:1787119524.783717:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:33946:x1873929633686272:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119524.783734:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119524.783756:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a50 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.783791:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 43 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.783801:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 264) 00010000:00010000:1.0:1787119524.783806:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 264) 00010000:00010000:1.0:1787119524.783811:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.783854:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 43 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.783883:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 43 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.783897:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653667456:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119524.783986:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.786797:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653667456:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119524.786845:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.786867:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430000, rc 0) 00000100:00100000:1.0:1787119524.786922:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633686272:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3207us (3392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.786930:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5510 00000100:00100000:3.0:1787119524.788552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.788797:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633686400 00000100:00100000:1.0:1787119524.788808:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633686400 00002000:00100000:1.0:1787119524.788871:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a50512c380 x1873929633686400/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 4584/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.788883:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c380 with x1873929633686400 ext(323584->327679) 00010000:00010000:1.0:1787119524.788893:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 44 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.788925:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 44 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119524.788934:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c380 00000100:00100000:1.0:1787119524.788980:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1355 00000100:00100000:1.0:1787119524.788991:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2375:x1873929633686400:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119524.789472:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633686400:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 481us (927us total) trans 4294969262 rc 0/0 00000100:00100000:1.0:1787119524.789480:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1355 00002000:00100000:1.0:1787119524.789486:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a50512c380 x1873929633686400/t4294969262(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 4584/448 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.789494:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512c380 with x1873929633686400 ext(323584->327679) 00010000:00010000:1.0:1787119524.789500:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 46 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.789516:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 46 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119524.789528:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512c380 00000100:00100000:3.0:1787119524.793645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.794487:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633686528 00000100:00100000:1.0:1787119524.794500:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633686528 00000100:00100000:1.0:1787119524.794555:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5511 00000100:00100000:1.0:1787119524.794565:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633686528:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119524.794586:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119524.794607:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a57 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.794643:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 264) 00010000:00010000:1.0:1787119524.794648:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 264) 00010000:00010000:1.0:1787119524.794654:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.794667:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.794679:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119524.794730:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+47:33957:x1873929633686528:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 167us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.794737:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5511 00000100:00100000:3.0:1787119524.795002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.795354:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633686656 00000100:00100000:1.0:1787119524.795360:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633686656 00010000:00010000:1.0:1787119524.795384:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 47 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.795425:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5557 00000100:00100000:1.0:1787119524.795433:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+47:2375:x1873929633686656:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.795462:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.795483:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 47 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.795506:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 47 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.795529:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e43b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [323584->33878015] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a49 expref: 47 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.795543:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 264) 00010000:00010000:1.0:1787119524.795547:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 264) 00010000:00010000:1.0:1787119524.795556:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.795565:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.795573:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 264) 00010000:00010000:1.0:1787119524.795576:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 264) 00010000:00010000:1.0:1787119524.795581:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 46 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.795595:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 46 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.795627:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 46 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.795642:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653667584:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.795715:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 37 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.795726:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653667712:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.795748:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.803062:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653667584:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.804070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.804361:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633686784 00000100:00100000:2.0:1787119524.804370:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633686784 00002000:00100000:2.0:1787119524.804421:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a634979880 x1873929633686784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.804433:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979880 with x1873929633686784 ext(323584->327679) 00002000:00010000:2.0:1787119524.804477:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979880 00000100:00100000:2.0:1787119524.804514:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10702 00000100:00100000:2.0:1787119524.804524:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2375:x1873929633686784:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119524.804713:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2375:x1873929633686784:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 191us (647us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119524.804721:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10702 00002000:00100000:2.0:1787119524.804727:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a634979880 x1873929633686784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119524.804736:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634979880 with x1873929633686784 ext(323584->327679) 00002000:00010000:2.0:1787119524.804741:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634979880 00000100:00100000:1.0:1787119524.805512:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653667712:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.805541:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.805590:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633686656:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10157us (10588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.805600:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5557 00000100:00100000:3.0:1787119524.810945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.811068:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633686912 00000100:00100000:0.0:1787119524.811077:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633686912 00000100:00100000:0.0:1787119524.811140:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5512 00000100:00100000:0.0:1787119524.811150:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633686912:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.811168:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.811192:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a5e expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.811231:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.811249:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 264) 00010000:00010000:0.0:1787119524.811254:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 264) 00010000:00010000:0.0:1787119524.811259:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.811297:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.811322:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 45 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.811336:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653667840:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.811423:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.814982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.815064:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633687040 00000100:00100000:3.0:1787119524.815074:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633687040 00002000:00100000:3.0:1787119524.815126:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a512846a00 x1873929633687040/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.815137:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633687040 ext(327680->331775) 00010000:00010000:3.0:1787119524.815147:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 46 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.815187:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 46 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.815202:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512846a00 00000100:00100000:3.0:1787119524.815244:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1356 00000100:00100000:3.0:1787119524.815255:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633687040:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119524.815561:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633687040:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 306us (599us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119524.815569:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1356 00002000:00100000:3.0:1787119524.815576:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a512846a00 x1873929633687040/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.815585:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633687040 ext(327680->331775) 00010000:00010000:3.0:1787119524.815591:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 46 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.815606:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 46 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.815614:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512846a00 00000100:00100000:0.0:1787119524.823630:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653667840:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.823679:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.823705:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119524.823769:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633686912:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 12618us (12833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.823779:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5512 00000100:00100000:0.0:1787119524.826706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.826804:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633687168 00000100:00100000:2.0:1787119524.826813:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633687168 00000100:00100000:2.0:1787119524.826876:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5513 00000100:00100000:2.0:1787119524.826886:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633687168:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119524.826904:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119524.826923:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a65 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.826954:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 264) 00010000:00010000:2.0:1787119524.826975:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.826983:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 264) 00010000:00010000:2.0:1787119524.826989:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 47 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.827028:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.827041:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 47 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119524.827054:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895e00, rc 0) 00000100:00100000:2.0:1787119524.827109:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+47:33957:x1873929633687168:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 225us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119524.827116:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5513 00000100:00100000:2.0:1787119524.830435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.831248:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633687296 00000100:00100000:1.0:1787119524.831260:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633687296 00010000:00010000:1.0:1787119524.831319:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 47 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.831364:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5558 00000100:00100000:1.0:1787119524.831373:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+47:2375:x1873929633687296:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.831398:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.831421:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 47 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.831486:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 47 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.831512:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a57 expref: 47 pid: 6693 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.831527:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 264) 00010000:00010000:1.0:1787119524.831532:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 264) 00010000:00010000:1.0:1787119524.831540:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.831549:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.831599:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.831614:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 38 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.831629:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653668096:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.831699:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00010000:00010000:0.0:1787119524.833590:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119524.848691:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653668096:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.848749:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.848816:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633687296:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 17442us (18391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.848828:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5558 00000100:00100000:0.0:1787119524.850851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.850981:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633687424 00000100:00100000:3.0:1787119524.850991:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633687424 00002000:00100000:3.0:1787119524.851041:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff92a63eb28000 x1873929633687424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.851051:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28000 with x1873929633687424 ext(327680->364543) 00010000:00010000:3.0:1787119524.851060:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.851093:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.851101:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28000 00000100:00100000:3.0:1787119524.851135:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1357 00000100:00100000:3.0:1787119524.851145:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633687424:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119524.872033:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633687424:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 20877us (21179us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119524.872047:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1357 00002000:00100000:3.0:1787119524.872063:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff92a63eb28000 x1873929633687424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119524.872073:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28000 with x1873929633687424 ext(327680->364543) 00010000:00010000:3.0:1787119524.872084:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.872116:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119524.872125:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28000 00000100:00100000:0.0:1787119524.891332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.891376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.891475:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633687680 00000100:00100000:3.0:1787119524.891487:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633687680 00010000:00010000:3.0:1787119524.891529:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.891579:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5559 00000100:00100000:3.0:1787119524.891588:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633687680:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.891604:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.891626:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.891652:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.891679:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a5e expref: 39 pid: 6695 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.891699:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 264) 00010000:00010000:3.0:1787119524.891704:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 264) 00010000:00010000:3.0:1787119524.891713:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 45 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.891723:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 45 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.891760:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 45 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.891775:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653668224:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.891863:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.892436:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633687552 00000100:00100000:1.0:1787119524.892467:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633687552 00000100:00100000:1.0:1787119524.892510:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5514 00000100:00100000:1.0:1787119524.892518:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633687552:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119524.892531:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119524.892546:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a6c expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.892569:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 45 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.892576:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 264) 00010000:00010000:1.0:1787119524.892580:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 264) 00010000:00010000:1.0:1787119524.892584:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.892607:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 45 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.892625:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 45 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.892636:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653668352:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119524.892679:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.898618:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653668224:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.898648:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.898709:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633687680:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7121us (7331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.898721:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5559 00000100:00100000:1.0:1787119524.899309:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653668352:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119524.899336:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.899357:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119524.899403:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633687552:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6885us (8080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.899410:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5514 00000100:00100000:0.0:1787119524.900237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.900568:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633687808 00000100:00100000:1.0:1787119524.900577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633687808 00010000:00010000:1.0:1787119524.900612:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 46 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.900653:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5560 00000100:00100000:1.0:1787119524.900663:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2374:x1873929633687808:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.900678:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.900702:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 46 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.900731:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 46 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.900752:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e43cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a65 expref: 46 pid: 12469 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.900766:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 264) 00010000:00010000:1.0:1787119524.900769:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 264) 00010000:00010000:1.0:1787119524.900775:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.900782:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.900810:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.900822:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653668480:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.901096:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.903647:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653668480:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.903675:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119524.903853:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2374:x1873929633687808:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3190us (3616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.903864:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5560 00000100:00100000:2.0:1787119524.916467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.916498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.916567:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633688064 00000100:00100000:1.0:1787119524.916577:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633688064 00002000:00100000:1.0:1787119524.916627:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff92a512845c00 x1873929633688064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.916636:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845c00 with x1873929633688064 ext(327680->364543) 00002000:00010000:1.0:1787119524.916641:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845c00 00000100:00100000:1.0:1787119524.916667:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10703 00000100:00100000:1.0:1787119524.916674:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633688064:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119524.917038:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633687936 00000100:00100000:3.0:1787119524.917043:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633687936 00000100:00100000:3.0:1787119524.917080:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5515 00000100:00100000:3.0:1787119524.917089:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+45:33957:x1873929633687936:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.917099:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.917117:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a73 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.917140:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.917148:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 264) 00010000:00010000:3.0:1787119524.917153:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 264) 00010000:00010000:3.0:1787119524.917158:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.917192:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.917223:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 40 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.917234:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653668608:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119524.917292:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787119524.923663:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653668608:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119524.923704:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.923724:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:3.0:1787119524.924477:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633687936:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7385us (8040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.924486:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5515 00000100:00100000:1.0:1787119524.924763:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633688064:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 8087us (8262us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119524.924773:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10703 00002000:00100000:1.0:1787119524.924784:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff92a512845c00 x1873929633688064/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119524.924794:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845c00 with x1873929633688064 ext(327680->364543) 00010000:00010000:1.0:1787119524.924804:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 39 pid: 20841 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.924834:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 39 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119524.924842:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845c00 00000100:00100000:2.0:1787119524.930396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.930475:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633688192 00000100:00100000:2.0:1787119524.930476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.930486:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633688192 00000100:00100000:0.0:1787119524.930546:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5516 00000100:00100000:1.0:1787119524.930551:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633688320 00000100:00100000:1.0:1787119524.930556:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633688320 00010000:00010000:1.0:1787119524.930586:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.930639:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633688192:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.930657:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.930676:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a7a expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.930708:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(191 264) 00000100:00100000:1.0:1787119524.930714:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5561 00010000:00010000:0.0:1787119524.930717:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.930722:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620780850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633688320:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119524.930731:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 264) 00010000:00010000:1.0:1787119524.930732:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119524.930737:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.930756:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.930785:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.930801:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.930808:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a6c expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.930815:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.930823:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 264) 00010000:00010000:1.0:1787119524.930826:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 264) 00010000:00010000:1.0:1787119524.930833:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.930842:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.930853:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00010000:00010000:1.0:1787119524.930863:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.930887:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 45 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.930901:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653668864:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119524.930982:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633688192:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 427us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.930989:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5516 00000100:00100000:1.0:1787119524.932730:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.938354:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653668864:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.938388:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.938481:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620780850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633688320:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7758us (8002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.938494:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5561 00000100:00100000:2.0:1787119524.940194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.940290:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633688448 00000100:00100000:0.0:1787119524.940300:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633688448 00002000:00100000:0.0:1787119524.940349:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a512845180 x1873929633688448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.940366:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845180 with x1873929633688448 ext(327680->331775) 00010000:00010000:0.0:1787119524.940376:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.940406:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.940418:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845180 00000100:00100000:0.0:1787119524.940484:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1358 00000100:00100000:0.0:1787119524.940493:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633688448:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.940715:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633688448:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 223us (531us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119524.940721:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1358 00002000:00100000:0.0:1787119524.940726:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a512845180 x1873929633688448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.940731:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845180 with x1873929633688448 ext(327680->331775) 00010000:00010000:0.0:1787119524.940735:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.940745:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.940750:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845180 00000100:00100000:2.0:1787119524.943221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.943317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.943406:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633688704 00000100:00100000:3.0:1787119524.943417:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633688704 00010000:00010000:3.0:1787119524.943500:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.943544:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5562 00000100:00100000:3.0:1787119524.943567:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2376:x1873929633688704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119524.943583:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119524.943606:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.943640:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.943666:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a73 expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.943686:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 264) 00010000:00010000:3.0:1787119524.943692:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 264) 00010000:00010000:3.0:1787119524.943701:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.943712:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.943757:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.943773:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653668992:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119524.943918:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.944165:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633688576 00000100:00100000:0.0:1787119524.944172:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633688576 00000100:00100000:0.0:1787119524.944249:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5517 00000100:00100000:0.0:1787119524.944258:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633688576:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.944272:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.944286:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a81 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.944315:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.944323:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 264) 00010000:00010000:0.0:1787119524.944326:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 264) 00010000:00010000:0.0:1787119524.944330:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 47 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.944353:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.944371:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 38 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.944382:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653669120:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119524.944413:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:2.0:1787119524.947149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.947400:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633688832 00000100:00100000:1.0:1787119524.947410:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633688832 00010000:00010000:1.0:1787119524.947474:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 39 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.947509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5563 00000100:00100000:1.0:1787119524.947518:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633688832:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.947535:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.947574:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 39 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.947600:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 39 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.947629:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 264) 00010000:00010000:1.0:1787119524.947634:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 264) 00010000:00010000:1.0:1787119524.947643:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 47 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.947654:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 47 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.947692:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 47 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.947712:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653669248:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.947785:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.948242:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653669120:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.948270:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 47 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.948281:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119524.948371:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+47:33957:x1873929633688576:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4113us (5159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.948379:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5517 00010000:00010000:3.0:1787119524.948414:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e43e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a7a expref: 39 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.948432:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653668992:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119524.948471:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119524.948494:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2376:x1873929633688704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4940us (5176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119524.948502:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5562 00000100:00100000:1.0:1787119524.955092:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653669248:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.955120:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.955232:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633688832:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7713us (8097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.955241:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5563 00000100:00100000:2.0:1787119524.958404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.958642:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633688960 00000100:00100000:1.0:1787119524.958653:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633688960 00000100:00100000:1.0:1787119524.958740:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5518 00000100:00100000:1.0:1787119524.958748:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633688960:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119524.958766:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119524.958781:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a88 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.958808:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 45 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.958815:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 264) 00010000:00010000:1.0:1787119524.958819:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 264) 00010000:00010000:1.0:1787119524.958823:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.958858:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 45 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.958895:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 45 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.958910:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653669376:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119524.959001:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.960930:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653669376:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119524.960986:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.961008:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119524.961115:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633688960:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2365us (2721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.961124:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5518 00000100:00100000:2.0:1787119524.961539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119524.962202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633689088 00000100:00100000:1.0:1787119524.962211:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633689088 00010000:00010000:1.0:1787119524.962244:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 46 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.962276:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5564 00000100:00100000:1.0:1787119524.962286:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633689088:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119524.962302:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119524.962326:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 46 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.962351:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 46 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.962372:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e43e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a81 expref: 46 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.962388:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 264) 00010000:00010000:1.0:1787119524.962392:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 264) 00010000:00010000:1.0:1787119524.962398:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.962405:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119524.962538:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119524.962679:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653669504:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119524.962799:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119524.965031:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653669504:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119524.965058:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119524.965119:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2375:x1873929633689088:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2834us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119524.965131:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5564 00000100:00100000:2.0:1787119524.968397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119524.968587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119524.968668:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633689344 00000100:00100000:3.0:1787119524.968677:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633689344 00000100:00100000:3.0:1787119524.968737:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5519 00000100:00100000:3.0:1787119524.968747:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+45:33957:x1873929633689344:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119524.968766:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119524.968786:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a8f expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.968820:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.968829:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 264) 00010000:00010000:3.0:1787119524.968834:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 264) 00010000:00010000:3.0:1787119524.968839:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 46 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.968874:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119524.968899:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 38 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119524.968913:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653669632:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119524.969136:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787119524.970766:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633689216 00000100:00100000:0.0:1787119524.970778:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633689216 00002000:00100000:0.0:1787119524.970830:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff92a5098a4700 x1873929633689216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/0 e 0 to 0 dl 1787119535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.970841:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633689216 ext(327680->364543) 00010000:00010000:0.0:1787119524.970850:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 39 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.970887:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 39 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.970896:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4700 00000100:00100000:0.0:1787119524.970931:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1359 00000100:00100000:0.0:1787119524.970941:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633689216:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119524.973699:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653669632:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119524.973738:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 46 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.973764:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:0.0:1787119524.973829:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633689344:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5083us (5242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.973839:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5519 00000100:00100000:0.0:1787119524.977696:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633689216:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6746us (9297us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119524.977711:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1359 00002000:00100000:0.0:1787119524.977723:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff92a5098a4700 x1873929633689216/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:560/0 lens 488/440 e 0 to 0 dl 1787119535 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119524.977733:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633689216 ext(327680->364543) 00010000:00010000:0.0:1787119524.977743:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 39 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.977773:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 39 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119524.977780:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a4700 00000100:00100000:1.0:1787119524.984061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.984350:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633689472 00000100:00100000:0.0:1787119524.984361:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633689472 00000100:00100000:0.0:1787119524.984424:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5520 00000100:00100000:0.0:1787119524.984434:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633689472:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119524.985646:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119524.985671:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a96 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.985704:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 264) 00010000:00010000:0.0:1787119524.985716:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.985722:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 264) 00010000:00010000:0.0:1787119524.985727:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 40 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.985777:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.985791:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 40 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.985804:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119524.985922:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633689472:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1489us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119524.985931:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5520 00000100:00100000:3.0:1787119524.986238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119524.986773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633689600 00000100:00100000:0.0:1787119524.986782:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633689600 00010000:00010000:0.0:1787119524.986811:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.986858:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5565 00000100:00100000:0.0:1787119524.986867:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633689600:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119524.986877:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119524.986899:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.986923:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.986951:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e43ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a88 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.986987:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 264) 00010000:00010000:0.0:1787119524.986992:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 264) 00010000:00010000:0.0:1787119524.987000:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.987010:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.987037:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119524.987052:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 45 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119524.987065:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653669888:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119524.994993:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.004737:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653669888:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.004767:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.004881:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633689600:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 17952us (18582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.004895:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5565 00000100:00100000:2.0:1787119525.006938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.007046:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633689728 00000100:00100000:0.0:1787119525.007056:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633689728 00002000:00100000:0.0:1787119525.007099:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a5098a5c00 x1873929633689728/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.007110:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5c00 with x1873929633689728 ext(327680->331775) 00010000:00010000:0.0:1787119525.007120:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.007220:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.007229:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5c00 00000100:00100000:0.0:1787119525.007593:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1360 00000100:00100000:0.0:1787119525.007605:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2376:x1873929633689728:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.007867:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2376:x1873929633689728:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 262us (935us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119525.007875:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1360 00002000:00100000:0.0:1787119525.007882:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a5098a5c00 x1873929633689728/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.007890:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5c00 with x1873929633689728 ext(327680->331775) 00010000:00010000:0.0:1787119525.007897:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.007912:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.007919:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5098a5c00 00000100:00100000:1.0:1787119525.011730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.011840:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633689856 00000100:00100000:0.0:1787119525.011852:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633689856 00000100:00100000:0.0:1787119525.011912:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5521 00000100:00100000:0.0:1787119525.011923:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633689856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.011943:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.011976:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716a9d expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.012012:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 264) 00010000:00010000:0.0:1787119525.012022:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.012029:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 264) 00010000:00010000:0.0:1787119525.012035:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 47 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.012074:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.012089:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 47 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.012103:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119525.012170:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+47:33957:x1873929633689856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 249us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.012178:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5521 00000100:00100000:2.0:1787119525.014896:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.015621:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633689984 00000100:00100000:1.0:1787119525.015633:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633689984 00010000:00010000:1.0:1787119525.015676:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 47 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.015728:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5566 00000100:00100000:1.0:1787119525.015738:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+47:2375:x1873929633689984:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.015753:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.015779:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 47 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.015808:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 47 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.015849:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e43f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a8f expref: 47 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.015871:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 264) 00010000:00010000:1.0:1787119525.015876:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 264) 00010000:00010000:1.0:1787119525.015886:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.015897:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.015942:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.015971:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 38 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.015994:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653670144:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.016086:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.026953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.027289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633690112 00000100:00100000:3.0:1787119525.027300:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633690112 00010000:00010000:3.0:1787119525.027341:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 39 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.027386:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5567 00000100:00100000:3.0:1787119525.027396:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633690112:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.027410:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.027471:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 39 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.027496:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 39 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.027523:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 264) 00010000:00010000:3.0:1787119525.027528:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 264) 00010000:00010000:3.0:1787119525.027536:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 46 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.027546:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 46 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.027584:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 46 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.027604:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653670272:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.027681:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.030361:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653670272:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.030387:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.030482:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633690112:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3083us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.030498:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5567 00010000:00010000:1.0:1787119525.032117:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e43fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a96 expref: 38 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.032217:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653670144:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.032238:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.032341:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633689984:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 16603us (17455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.032351:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5566 00000100:00100000:3.0:1787119525.035694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.035783:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633690240 00000100:00100000:1.0:1787119525.035793:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633690240 00000100:00100000:1.0:1787119525.035864:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5522 00000100:00100000:1.0:1787119525.035875:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633690240:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119525.035894:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119525.035913:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716aa4 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.035953:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 45 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.035974:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 264) 00010000:00010000:1.0:1787119525.035980:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 264) 00010000:00010000:1.0:1787119525.035985:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.036019:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 45 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.036042:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 45 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.036056:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653670400:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119525.036137:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.039690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.039782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633690368 00000100:00100000:2.0:1787119525.039791:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633690368 00010000:00010000:2.0:1787119525.039838:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 46 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.039883:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5568 00000100:00100000:2.0:1787119525.039892:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620780050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633690368:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.039908:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.039942:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 46 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.039977:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 46 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.040007:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 264) 00010000:00010000:2.0:1787119525.040012:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 264) 00010000:00010000:2.0:1787119525.040021:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.040030:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.040074:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.040097:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653670528:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.040187:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787119525.040498:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4404 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a9d expref: 46 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.040515:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653670400:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119525.040541:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.040552:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119525.040582:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633690240:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4710us (4897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.040590:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5522 00000100:00100000:3.0:1787119525.042649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.042742:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633690496 00000100:00100000:0.0:1787119525.042751:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633690496 00000100:00100000:0.0:1787119525.042805:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5523 00000100:00100000:0.0:1787119525.042814:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633690496:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.042840:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.042859:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716aab expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.042893:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.042901:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 264) 00010000:00010000:0.0:1787119525.042905:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 264) 00010000:00010000:0.0:1787119525.042910:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 47 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.042940:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.042979:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 38 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.042992:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653670656:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.043067:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.046932:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653670656:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.046988:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 47 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.047016:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119525.047077:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+47:33957:x1873929633690496:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4263us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.047086:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5523 00000100:00100000:0.0:1787119525.051020:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653670528:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119525.051047:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119525.051113:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620780050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633690368:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 11221us (11430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.051122:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5568 00000100:00100000:1.0:1787119525.054552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.054836:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633690624 00000100:00100000:3.0:1787119525.054847:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633690624 00002000:00100000:3.0:1787119525.054898:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff92a62041c380 x1873929633690624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.054910:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041c380 with x1873929633690624 ext(327680->364543) 00010000:00010000:3.0:1787119525.054919:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 39 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.054946:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 39 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.054953:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041c380 00000100:00100000:3.0:1787119525.055005:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1361 00000100:00100000:3.0:1787119525.055016:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633690624:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119525.060289:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633690624:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5263us (5738us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119525.060302:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1361 00002000:00100000:3.0:1787119525.060316:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff92a62041c380 x1873929633690624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.060327:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041c380 with x1873929633690624 ext(327680->364543) 00010000:00010000:3.0:1787119525.060338:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 39 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.060369:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 39 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.060378:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041c380 00000100:00100000:1.0:1787119525.063570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.063740:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633690752 00000100:00100000:0.0:1787119525.063754:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633690752 00000100:00100000:0.0:1787119525.063845:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5524 00000100:00100000:0.0:1787119525.063859:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633690752:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.063883:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.063909:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ab2 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.063946:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 264) 00010000:00010000:0.0:1787119525.063967:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.063976:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(203 264) 00010000:00010000:0.0:1787119525.063982:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 40 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.064031:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.064046:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 40 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.064061:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119525.064118:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633690752:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 263us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.064125:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5524 00000100:00100000:2.0:1787119525.066879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.066986:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633690880 00000100:00100000:3.0:1787119525.066996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633690880 00010000:00010000:3.0:1787119525.067036:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.067074:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5569 00000100:00100000:3.0:1787119525.067082:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633690880:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.067097:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.067121:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.067157:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.067184:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e440b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aa4 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.067206:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 264) 00010000:00010000:3.0:1787119525.067211:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 264) 00010000:00010000:3.0:1787119525.067219:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.067228:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.067268:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 45 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.067283:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 45 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.067299:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653670912:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.067390:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.071852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.071948:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633691008 00000100:00100000:2.0:1787119525.071969:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633691008 00002000:00100000:2.0:1787119525.072025:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a511630a80 x1873929633691008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119525.072035:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630a80 with x1873929633691008 ext(327680->331775) 00010000:00010000:2.0:1787119525.072045:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.072074:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119525.072082:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511630a80 00000100:00100000:2.0:1787119525.072122:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1362 00000100:00100000:2.0:1787119525.072134:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2376:x1873929633691008:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119525.072431:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2376:x1873929633691008:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 298us (588us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119525.072472:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1362 00002000:00100000:2.0:1787119525.072479:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a511630a80 x1873929633691008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119525.072493:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630a80 with x1873929633691008 ext(327680->331775) 00010000:00010000:2.0:1787119525.072499:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.072514:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 46 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119525.072521:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511630a80 00000100:00100000:3.0:1787119525.073143:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653670912:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119525.073165:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119525.073212:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633690880:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6130us (6343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.073221:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5569 00000100:00100000:1.0:1787119525.076352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.076540:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633691136 00000100:00100000:0.0:1787119525.076551:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633691136 00000100:00100000:0.0:1787119525.076616:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5525 00000100:00100000:0.0:1787119525.076626:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633691136:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.076644:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.076665:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ab9 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.076698:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 264) 00010000:00010000:0.0:1787119525.076707:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.076715:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 264) 00010000:00010000:0.0:1787119525.076721:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 47 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.076761:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.076774:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 47 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.076785:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119525.076856:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+47:33957:x1873929633691136:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 231us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.076863:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5525 00000100:00100000:1.0:1787119525.080217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.080368:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633691264 00000100:00100000:0.0:1787119525.080380:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633691264 00010000:00010000:0.0:1787119525.080531:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 47 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.080572:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5570 00000100:00100000:0.0:1787119525.080582:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+47:2375:x1873929633691264:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119525.080601:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119525.080626:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 47 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.080652:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 47 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.080683:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4412 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aab expref: 47 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.080702:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 264) 00010000:00010000:0.0:1787119525.080707:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 264) 00010000:00010000:0.0:1787119525.080716:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.080726:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.080765:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 38 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.080780:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 38 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.080793:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653671168:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119525.081268:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.083669:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653671168:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119525.083699:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119525.083750:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633691264:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3168us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.083761:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5570 00000100:00100000:1.0:1787119525.086408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.086919:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633691392 00000100:00100000:0.0:1787119525.086931:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633691392 00010000:00010000:0.0:1787119525.087072:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 39 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.087171:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5571 00000100:00100000:0.0:1787119525.087182:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2374:x1873929633691392:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119525.087198:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119525.087223:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 39 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.087250:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 39 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.087278:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4419 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab2 expref: 39 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.087298:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 264) 00010000:00010000:0.0:1787119525.087303:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 264) 00010000:00010000:0.0:1787119525.087311:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 45 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.087322:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 45 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.087364:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 45 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.087379:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653671296:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119525.087570:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.091631:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653671296:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119525.091662:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119525.091764:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2374:x1873929633691392:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4582us (5364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.091776:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5571 00000100:00100000:2.0:1787119525.105357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.105403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.105674:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633691648 00000100:00100000:3.0:1787119525.105684:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633691648 00002000:00100000:3.0:1787119525.105734:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a62a126300 x1873929633691648/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.105747:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126300 with x1873929633691648 ext(327680->331775) 00002000:00010000:3.0:1787119525.105753:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126300 00000100:00100000:3.0:1787119525.105802:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10704 00000100:00100000:3.0:1787119525.105812:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633691648:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119525.106089:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633691648:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 278us (684us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119525.106097:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10704 00002000:00100000:3.0:1787119525.106104:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a62a126300 x1873929633691648/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.106113:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126300 with x1873929633691648 ext(327680->331775) 00002000:00010000:3.0:1787119525.106116:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126300 00000100:00100000:1.0:1787119525.111828:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633691520 00000100:00100000:1.0:1787119525.111843:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633691520 00000100:00100000:1.0:1787119525.111927:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5526 00000100:00100000:1.0:1787119525.111937:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:33946:x1873929633691520:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119525.111969:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119525.111990:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ac0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.112028:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 45 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.112039:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 264) 00010000:00010000:1.0:1787119525.112044:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(207 264) 00010000:00010000:1.0:1787119525.112049:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.112084:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 45 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.112118:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 45 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.112134:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653671424:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119525.112241:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.115796:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653671424:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119525.115846:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.115869:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431400, rc 0) 00000100:00100000:1.0:1787119525.115938:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633691520:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4002us (10591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.115947:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5526 00000100:00100000:2.0:1787119525.119712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.119819:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633691776 00000100:00100000:0.0:1787119525.119837:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633691776 00000100:00100000:0.0:1787119525.119903:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5527 00000100:00100000:0.0:1787119525.119913:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633691776:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.119932:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.119951:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ac7 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.119999:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(207 264) 00010000:00010000:0.0:1787119525.120005:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 264) 00010000:00010000:0.0:1787119525.120011:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 47 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.120024:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 47 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.120037:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119525.120099:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+47:33957:x1873929633691776:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 187us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.120106:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5527 00000100:00100000:2.0:1787119525.126355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.127019:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633691904 00000100:00100000:3.0:1787119525.127030:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633691904 00002000:00100000:3.0:1787119525.127080:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a63dc05180 x1873929633691904/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 4584/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.127091:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05180 with x1873929633691904 ext(327680->331775) 00010000:00010000:3.0:1787119525.127101:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 47 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.127133:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 47 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.127155:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05180 00000100:00100000:3.0:1787119525.127189:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1363 00000100:00100000:3.0:1787119525.127200:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+47:2375:x1873929633691904:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119525.128760:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2375:x1873929633691904:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 1555us (2407us total) trans 4294969263 rc 0/0 00000100:00100000:3.0:1787119525.128772:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1363 00002000:00100000:3.0:1787119525.128782:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a63dc05180 x1873929633691904/t4294969263(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 4584/448 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.128792:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05180 with x1873929633691904 ext(327680->331775) 00010000:00010000:3.0:1787119525.128801:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 49 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.128841:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 49 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.128849:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05180 00000100:00100000:2.0:1787119525.133676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.133783:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633692032 00000100:00100000:3.0:1787119525.133794:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633692032 00010000:00010000:3.0:1787119525.133905:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 49 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.134009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5572 00000100:00100000:3.0:1787119525.134020:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2374:x1873929633692032:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.134036:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.134063:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 49 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.134099:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 49 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.134126:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4420 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [327680->33882111] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ab9 expref: 49 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.134275:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 264) 00010000:00010000:3.0:1787119525.134281:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 264) 00010000:00010000:3.0:1787119525.134289:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.134300:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.134310:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 264) 00010000:00010000:3.0:1787119525.134313:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 264) 00010000:00010000:3.0:1787119525.134319:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 48 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.134328:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 48 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.134364:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 48 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.134396:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653671552:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119525.135728:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.135752:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653671680:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.135835:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.139863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.142398:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633692160 00000100:00100000:1.0:1787119525.142424:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633692160 00002000:00100000:1.0:1787119525.142517:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff92a63dc04000 x1873929633692160/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.142529:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633692160 ext(331776->335871) 00002000:00010000:1.0:1787119525.142535:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04000 00000100:00100000:1.0:1787119525.142576:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10705 00000100:00100000:1.0:1787119525.142586:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2376:x1873929633692160:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119525.142778:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2376:x1873929633692160:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 192us (2924us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119525.142786:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10705 00002000:00100000:1.0:1787119525.142792:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff92a63dc04000 x1873929633692160/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.142800:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04000 with x1873929633692160 ext(331776->335871) 00002000:00010000:1.0:1787119525.142803:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc04000 00000100:00100000:1.0:1787119525.142851:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653671552:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.143031:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653671680:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.143052:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.143079:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+48:2374:x1873929633692032:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9062us (9415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.143086:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5572 00000100:00100000:3.0:1787119525.146098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.146624:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633692288 00000100:00100000:0.0:1787119525.146635:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633692288 00002000:00100000:0.0:1787119525.146692:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a63497a680 x1873929633692288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.146703:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a680 with x1873929633692288 ext(327680->331775) 00002000:00010000:0.0:1787119525.146708:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497a680 00000100:00100000:0.0:1787119525.147014:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10706 00000100:00100000:0.0:1787119525.147025:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633692288:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.147263:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633692288:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 238us (1174us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119525.147270:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10706 00002000:00100000:0.0:1787119525.147278:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a63497a680 x1873929633692288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.147285:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a680 with x1873929633692288 ext(327680->331775) 00002000:00010000:0.0:1787119525.147289:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63497a680 00000100:00100000:3.0:1787119525.152046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.154773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.154809:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633692544 00000100:00100000:3.0:1787119525.154819:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633692544 00000100:00100000:3.0:1787119525.154877:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5528 00000100:00100000:3.0:1787119525.154886:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633692544:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119525.154903:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119525.154923:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ace expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.154966:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 47 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.154976:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 264) 00010000:00010000:3.0:1787119525.154981:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 264) 00010000:00010000:3.0:1787119525.154986:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 40 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.155026:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 47 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.155052:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 47 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.155066:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653671808:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119525.155156:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.155302:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633692416 00000100:00100000:2.0:1787119525.155308:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633692416 00002000:00100000:2.0:1787119525.155340:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a63497a300 x1873929633692416/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119525.155350:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633692416 ext(335872->339967) 00010000:00010000:2.0:1787119525.155357:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 48 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.155372:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 48 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119525.155398:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63497a300 00000100:00100000:2.0:1787119525.155436:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1364 00000100:00100000:2.0:1787119525.155459:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+48:2375:x1873929633692416:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119525.155641:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+48:2375:x1873929633692416:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 184us (3605us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119525.155648:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1364 00002000:00100000:2.0:1787119525.155655:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a63497a300 x1873929633692416/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119525.155662:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63497a300 with x1873929633692416 ext(335872->339967) 00010000:00010000:2.0:1787119525.155667:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 48 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.155680:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 48 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119525.155686:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63497a300 00000100:00100000:3.0:1787119525.160889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.161113:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633692672 00000100:00100000:1.0:1787119525.161123:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633692672 00002000:00100000:1.0:1787119525.161179:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff92a508cfce00 x1873929633692672/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 4584/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.161189:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfce00 with x1873929633692672 ext(331776->335871) 00010000:00010000:1.0:1787119525.161199:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 48 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.161245:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 48 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119525.161254:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfce00 00000100:00100000:1.0:1787119525.161287:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1365 00000100:00100000:1.0:1787119525.161297:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+48:2375:x1873929633692672:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119525.161733:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633692672:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 435us (851us total) trans 4294969264 rc 0/0 00000100:00100000:1.0:1787119525.161740:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1365 00002000:00100000:1.0:1787119525.161748:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff92a508cfce00 x1873929633692672/t4294969264(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 4584/448 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.161757:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfce00 with x1873929633692672 ext(331776->335871) 00010000:00010000:1.0:1787119525.161764:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.161779:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119525.161787:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfce00 00000100:00100000:1.0:1787119525.164871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.165022:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633692800 00000100:00100000:3.0:1787119525.165032:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633692800 00000100:00100000:3.0:1787119525.165090:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5529 00000100:00100000:3.0:1787119525.165100:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633692800:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119525.165119:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119525.165139:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ad5 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.165186:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 264) 00010000:00010000:3.0:1787119525.165192:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 264) 00010000:00010000:3.0:1787119525.165198:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 51 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.165210:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 51 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.165228:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84400, rc 0) 00000100:00100000:3.0:1787119525.165286:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633692800:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 187us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.165293:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5529 00000100:00100000:2.0:1787119525.168747:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653671808:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119525.168788:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 40 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.168812:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84c00, rc 0) 00000100:00100000:2.0:1787119525.168896:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633692544:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 14009us (14131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.168905:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5528 00000100:00100000:1.0:1787119525.171074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.171350:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633692928 00000100:00100000:0.0:1787119525.171360:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633692928 00010000:00010000:0.0:1787119525.171409:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.171494:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5573 00000100:00100000:0.0:1787119525.171504:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2375:x1873929633692928:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119525.171522:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119525.171545:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.171572:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.171597:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e442e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [331776->33886207] (req 331776->335871) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac7 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.171617:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 264) 00010000:00010000:0.0:1787119525.171622:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 264) 00010000:00010000:0.0:1787119525.171631:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 39 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.171641:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 39 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.171650:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 264) 00010000:00010000:0.0:1787119525.171653:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 264) 00010000:00010000:0.0:1787119525.171657:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 50 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.171665:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 50 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.171708:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 50 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.171722:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653671936:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119525.171866:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 39 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.171878:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653672064:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119525.171903:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.179031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.179162:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633693056 00000100:00100000:3.0:1787119525.179173:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633693056 00002000:00100000:3.0:1787119525.179223:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff92a519d19c00 x1873929633693056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.179234:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19c00 with x1873929633693056 ext(331776->335871) 00002000:00010000:3.0:1787119525.179239:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19c00 00000100:00100000:3.0:1787119525.179270:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10707 00000100:00100000:3.0:1787119525.179279:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633693056:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119525.179512:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633693056:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 233us (491us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119525.179519:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10707 00002000:00100000:3.0:1787119525.179526:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff92a519d19c00 x1873929633693056/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.179533:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19c00 with x1873929633693056 ext(331776->335871) 00002000:00010000:3.0:1787119525.179536:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19c00 00000100:00100000:0.0:1787119525.181315:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653671936:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.181545:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653672064:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.181576:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.181646:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633692928:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10143us (10582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.181658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5573 00000100:00100000:1.0:1787119525.186035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.186166:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633693184 00000100:00100000:0.0:1787119525.186177:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633693184 00000100:00100000:0.0:1787119525.186241:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5530 00000100:00100000:0.0:1787119525.186251:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633693184:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.186270:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.186292:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716adc expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.186329:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 49 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.186340:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 264) 00010000:00010000:0.0:1787119525.186345:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(211 264) 00010000:00010000:0.0:1787119525.186351:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.186593:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 49 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.186622:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 49 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.186637:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653672192:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.186714:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.189425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.189667:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633693312 00000100:00100000:2.0:1787119525.189676:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633693312 00010000:00010000:2.0:1787119525.189715:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 50 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.189757:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5574 00000100:00100000:2.0:1787119525.189767:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633693312:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.189782:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.189804:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 50 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.189841:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 50 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.189869:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(211 264) 00010000:00010000:2.0:1787119525.189874:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(211 264) 00010000:00010000:2.0:1787119525.189883:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.189899:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.189938:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.189962:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653672320:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.190048:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00010000:00010000:0.0:1787119525.190932:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e443c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ad5 expref: 50 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.190951:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653672192:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.190993:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.191005:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119525.191056:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633693184:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4807us (5035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.191064:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5530 00000100:00100000:2.0:1787119525.195784:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653672320:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.195814:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.195886:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2375:x1873929633693312:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6119us (6480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.195897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5574 00000100:00100000:1.0:1787119525.206285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.206397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.206557:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633693568 00000100:00100000:3.0:1787119525.206569:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633693568 00002000:00100000:3.0:1787119525.206628:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a519d1b100 x1873929633693568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.206640:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b100 with x1873929633693568 ext(335872->372735) 00002000:00010000:3.0:1787119525.206648:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d1b100 00000100:00100000:3.0:1787119525.206686:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10708 00000100:00100000:3.0:1787119525.206696:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633693568:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.208424:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633693440 00000100:00100000:0.0:1787119525.208451:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633693440 00000100:00100000:0.0:1787119525.208510:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5531 00000100:00100000:0.0:1787119525.208520:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633693440:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.208540:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.208560:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ae3 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.208597:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.208609:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(211 264) 00010000:00010000:0.0:1787119525.208613:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(212 264) 00010000:00010000:0.0:1787119525.208620:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 50 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.208657:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.208687:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.208715:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653672448:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.208816:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.216642:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633693568:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 9933us (10231us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119525.216657:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10708 00002000:00100000:3.0:1787119525.216672:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a519d1b100 x1873929633693568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.216683:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b100 with x1873929633693568 ext(335872->372735) 00010000:00010000:3.0:1787119525.216695:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.216730:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.216739:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1b100 00000100:00100000:0.0:1787119525.220713:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653672448:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.220753:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 50 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.220777:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119525.220898:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633693440:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 12378us (14621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.220907:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5531 00000100:00100000:1.0:1787119525.222218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.222263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.222391:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633693824 00000100:00100000:3.0:1787119525.222400:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633693824 00000100:00100000:0.0:1787119525.222680:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5532 00000100:00100000:0.0:1787119525.222692:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633693824:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.222710:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.222728:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716aea expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.222758:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(212 264) 00010000:00010000:0.0:1787119525.222767:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.222775:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(213 264) 00010000:00010000:0.0:1787119525.222780:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.222814:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.222837:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.222849:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119525.222899:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633693824:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 210us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.222910:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5532 00000100:00100000:2.0:1787119525.223092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633693696 00000100:00100000:2.0:1787119525.223096:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633693696 00010000:00010000:2.0:1787119525.223116:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.223155:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5575 00000100:00100000:2.0:1787119525.223162:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620783c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633693696:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.223171:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.223192:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.223221:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.223240:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4443 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716adc expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.223254:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 264) 00010000:00010000:2.0:1787119525.223258:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 264) 00010000:00010000:2.0:1787119525.223266:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.223275:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.223298:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.223312:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 49 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.223325:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653672704:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.223371:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066480 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.226932:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653672704:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.226975:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.227039:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620783c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633693696:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3876us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.227051:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5575 00000100:00100000:3.0:1787119525.230500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.230651:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633693952 00000100:00100000:0.0:1787119525.230662:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633693952 00002000:00100000:0.0:1787119525.230712:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508cff100 x1873929633693952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.230722:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633693952 ext(335872->339967) 00010000:00010000:0.0:1787119525.230731:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 50 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.230759:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 50 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.230766:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cff100 00000100:00100000:0.0:1787119525.230801:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1366 00000100:00100000:0.0:1787119525.230809:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2374:x1873929633693952:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.231041:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2374:x1873929633693952:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 232us (549us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119525.231049:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1366 00002000:00100000:0.0:1787119525.231057:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508cff100 x1873929633693952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.231065:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cff100 with x1873929633693952 ext(335872->339967) 00010000:00010000:0.0:1787119525.231070:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 50 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.231088:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 50 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.231096:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cff100 00000100:00100000:1.0:1787119525.234823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.234928:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633694080 00000100:00100000:2.0:1787119525.234939:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633694080 00000100:00100000:2.0:1787119525.235004:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5533 00000100:00100000:2.0:1787119525.235014:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633694080:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.235035:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.235057:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716af1 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.235094:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 264) 00010000:00010000:2.0:1787119525.235103:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.235110:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(215 264) 00010000:00010000:2.0:1787119525.235114:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.235170:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.235184:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.235197:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895800, rc 0) 00000100:00100000:2.0:1787119525.235266:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633694080:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 253us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.235274:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5533 00000100:00100000:1.0:1787119525.238397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.238593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633694208 00000100:00100000:2.0:1787119525.238603:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633694208 00010000:00010000:2.0:1787119525.238641:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 51 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.238683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5576 00000100:00100000:2.0:1787119525.238692:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2375:x1873929633694208:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.238707:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.238730:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 51 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.238758:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 51 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.238783:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e444a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ae3 expref: 51 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.238800:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 264) 00010000:00010000:2.0:1787119525.238805:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 264) 00010000:00010000:2.0:1787119525.238814:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.238836:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.238881:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.238898:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 40 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.238912:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653672960:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.239012:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.243065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.243177:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653672960:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.243203:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.243262:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633694208:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4570us (4873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.243272:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5576 00000100:00100000:2.0:1787119525.243298:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633694336 00000100:00100000:2.0:1787119525.243305:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633694336 00010000:00010000:2.0:1787119525.243334:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.243370:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5577 00000100:00100000:2.0:1787119525.243379:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633694336:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.243401:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.243435:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.243500:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.243525:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4451 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aea expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.243544:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 264) 00010000:00010000:2.0:1787119525.243549:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 264) 00010000:00010000:2.0:1787119525.243558:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.243569:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.243630:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.243645:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653673088:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.243697:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.246872:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653673088:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.246898:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.246968:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633694336:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3589us (3912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.246979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5577 00000100:00100000:3.0:1787119525.255928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.256101:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633694464 00000100:00100000:0.0:1787119525.256112:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633694464 00000100:00100000:0.0:1787119525.256188:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5534 00000100:00100000:0.0:1787119525.256200:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633694464:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.256219:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.256239:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716af8 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.256272:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.256284:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 264) 00010000:00010000:0.0:1787119525.256289:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(217 264) 00010000:00010000:0.0:1787119525.256293:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.256329:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.256355:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 49 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.256371:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653673216:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.256509:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.263884:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653673216:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119525.263924:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.263948:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:1.0:1787119525.264143:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633694464:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7944us (8222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.264152:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5534 00000100:00100000:3.0:1787119525.266514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.266837:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633694592 00000100:00100000:0.0:1787119525.266852:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633694592 00002000:00100000:0.0:1787119525.266902:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508cfd880 x1873929633694592/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.266913:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd880 with x1873929633694592 ext(335872->339967) 00010000:00010000:0.0:1787119525.266922:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.266949:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.266968:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfd880 00000100:00100000:0.0:1787119525.267005:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1367 00000100:00100000:0.0:1787119525.267015:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633694592:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.267230:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633694592:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 215us (728us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119525.267241:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1367 00002000:00100000:0.0:1787119525.267251:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508cfd880 x1873929633694592/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.267272:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfd880 with x1873929633694592 ext(335872->339967) 00010000:00010000:0.0:1787119525.267280:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.267300:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.267307:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfd880 00000100:00100000:3.0:1787119525.269932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.270084:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633694720 00000100:00100000:0.0:1787119525.270094:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633694720 00000100:00100000:0.0:1787119525.270150:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5535 00000100:00100000:0.0:1787119525.270160:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633694720:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.270178:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.270198:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716aff expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.270230:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(217 264) 00010000:00010000:0.0:1787119525.270239:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.270247:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(218 264) 00010000:00010000:0.0:1787119525.270252:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.270304:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.270319:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.270332:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119525.270477:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633694720:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 318us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.270485:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5535 00000100:00100000:2.0:1787119525.278774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.278996:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633694848 00000100:00100000:1.0:1787119525.279006:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633694848 00010000:00010000:1.0:1787119525.279045:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 51 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.279096:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5578 00000100:00100000:1.0:1787119525.279107:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2375:x1873929633694848:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.279121:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.279145:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 51 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.279172:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 51 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.279199:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e4458 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af1 expref: 51 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.279215:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 264) 00010000:00010000:1.0:1787119525.279220:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 264) 00010000:00010000:1.0:1787119525.279229:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.279239:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.279289:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.279304:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.279318:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653673472:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.279401:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.282741:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653673472:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.282768:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.282833:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633694848:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3726us (4067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.282843:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5578 00000100:00100000:3.0:1787119525.289661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.289842:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633694976 00000100:00100000:0.0:1787119525.289852:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633694976 00002000:00100000:0.0:1787119525.289915:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a508cfed80 x1873929633694976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.289927:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633694976 ext(335872->372735) 00010000:00010000:0.0:1787119525.289937:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.289978:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.289987:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfed80 00000100:00100000:0.0:1787119525.290023:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1368 00000100:00100000:0.0:1787119525.290033:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633694976:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.294245:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633694976:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4203us (4584us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119525.294269:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1368 00002000:00100000:0.0:1787119525.294282:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a508cfed80 x1873929633694976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.294299:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfed80 with x1873929633694976 ext(335872->372735) 00010000:00010000:0.0:1787119525.294310:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.294340:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.294348:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfed80 00000100:00100000:3.0:1787119525.297614:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.297663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.297805:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633695232 00000100:00100000:1.0:1787119525.297816:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633695232 00010000:00010000:1.0:1787119525.297865:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.297919:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5579 00000100:00100000:1.0:1787119525.297929:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633695232:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.297944:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.297980:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.298007:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.298035:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e445f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716af8 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.298055:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 264) 00010000:00010000:1.0:1787119525.298060:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 264) 00010000:00010000:1.0:1787119525.298069:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.298080:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.298115:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.298129:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653673600:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.298215:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.299056:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633695104 00000100:00100000:0.0:1787119525.299063:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633695104 00000100:00100000:0.0:1787119525.299110:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5536 00000100:00100000:0.0:1787119525.299119:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633695104:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.299136:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.299152:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b06 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.299175:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.299184:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 264) 00010000:00010000:0.0:1787119525.299187:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 264) 00010000:00010000:0.0:1787119525.299192:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.299219:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.299241:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 49 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.299254:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653673728:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.299325:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.306206:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.306329:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653673600:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.306353:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.306412:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633695232:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8484us (8748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.306423:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5579 00000100:00100000:1.0:1787119525.306476:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633695360 00000100:00100000:1.0:1787119525.306482:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633695360 00010000:00010000:1.0:1787119525.306515:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 50 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.306563:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5580 00000100:00100000:1.0:1787119525.306573:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2373:x1873929633695360:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.306586:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.306610:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 50 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.306634:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 50 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.306659:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 264) 00010000:00010000:1.0:1787119525.306664:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 264) 00010000:00010000:1.0:1787119525.306672:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.306682:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.306717:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.306736:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653673856:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.306786:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00010000:00010000:0.0:1787119525.307743:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4466 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716aff expref: 50 pid: 6693 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.307766:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653673728:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.307787:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.307798:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119525.307857:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633695104:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8738us (10252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.307864:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5536 00000100:00100000:2.0:1787119525.310295:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653673856:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.310321:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.310373:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2373:x1873929633695360:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3801us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.310385:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5580 00000100:00100000:1.0:1787119525.319117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.319229:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633695488 00000100:00100000:0.0:1787119525.319240:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633695488 00000100:00100000:0.0:1787119525.319304:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5537 00000100:00100000:0.0:1787119525.319314:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633695488:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.319331:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.319351:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b0d expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.319390:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.319401:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 264) 00010000:00010000:0.0:1787119525.319406:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 264) 00010000:00010000:0.0:1787119525.319411:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 50 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.319482:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.319511:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 40 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.319525:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653673984:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.319611:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.322332:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653673984:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.322369:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 50 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.322394:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119525.327496:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633695488:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8167us (8373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.327510:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5537 00000100:00100000:3.0:1787119525.330589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.330714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.330970:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633695616 00000100:00100000:2.0:1787119525.330979:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633695616 00010000:00010000:2.0:1787119525.331017:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.331051:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5581 00000100:00100000:2.0:1787119525.331060:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633695616:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.331073:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.331094:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.331119:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.331144:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e446d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b06 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.331163:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 264) 00010000:00010000:2.0:1787119525.331168:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 264) 00010000:00010000:2.0:1787119525.331177:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.331188:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.331227:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.331242:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653674112:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.331333:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.331474:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633695744 00000100:00100000:0.0:1787119525.331479:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633695744 00000100:00100000:0.0:1787119525.331514:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5538 00000100:00100000:0.0:1787119525.331521:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633695744:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.331535:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.331560:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b14 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.331581:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.331589:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 264) 00010000:00010000:0.0:1787119525.331593:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(222 264) 00010000:00010000:0.0:1787119525.331597:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.331619:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.331633:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 49 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.331643:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653674240:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.331674:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.340629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.340712:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633695872 00000100:00100000:0.0:1787119525.340722:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633695872 00002000:00100000:0.0:1787119525.340771:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a519d1b800 x1873929633695872/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.340785:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b800 with x1873929633695872 ext(335872->339967) 00010000:00010000:0.0:1787119525.340794:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.340837:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.340846:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1b800 00000100:00100000:0.0:1787119525.340890:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1369 00000100:00100000:0.0:1787119525.340900:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633695872:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.341121:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633695872:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 222us (681us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119525.341128:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1369 00002000:00100000:0.0:1787119525.341135:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a519d1b800 x1873929633695872/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.341801:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1b800 with x1873929633695872 ext(335872->339967) 00010000:00010000:0.0:1787119525.341809:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.341839:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.341847:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1b800 00000100:00100000:0.0:1787119525.342743:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653674240:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.342774:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.342794:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:0.0:1787119525.342853:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633695744:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11332us (12138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.342860:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5538 00000100:00100000:3.0:1787119525.347275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.347330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.347432:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633696000 00000100:00100000:1.0:1787119525.347478:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633696000 00000100:00100000:1.0:1787119525.347532:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5539 00000100:00100000:1.0:1787119525.347542:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633696000:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119525.347562:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119525.347583:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b1b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.347616:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(222 264) 00010000:00010000:1.0:1787119525.347625:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.347632:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(223 264) 00010000:00010000:1.0:1787119525.347636:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.347678:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.347692:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.347706:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119525.347759:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633696000:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 218us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.347767:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5539 00000100:00100000:2.0:1787119525.348237:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653674112:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.348254:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.348292:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633695616:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 17232us (17723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.348301:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5581 00000100:00100000:2.0:1787119525.348318:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633696128 00000100:00100000:2.0:1787119525.348322:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633696128 00010000:00010000:2.0:1787119525.348341:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.348368:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5582 00000100:00100000:2.0:1787119525.348375:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620783450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2374:x1873929633696128:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.348385:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.348406:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.348457:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.348479:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4474 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b0d expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.348496:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 264) 00010000:00010000:2.0:1787119525.348499:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 264) 00010000:00010000:2.0:1787119525.348508:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.348516:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.348542:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.348558:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.348571:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653674496:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.348621:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e066e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.353554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.353712:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653674496:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.353736:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.353803:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620783450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2374:x1873929633696128:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5427us (6472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.353815:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5582 00000100:00100000:1.0:1787119525.354588:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633696256 00000100:00100000:1.0:1787119525.354598:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633696256 00002000:00100000:1.0:1787119525.354648:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a508ffdc00 x1873929633696256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.354659:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdc00 with x1873929633696256 ext(335872->372735) 00010000:00010000:1.0:1787119525.354668:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.354696:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119525.354704:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffdc00 00000100:00100000:1.0:1787119525.354738:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1370 00000100:00100000:1.0:1787119525.354748:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633696256:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.371606:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633696256:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 16847us (18050us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119525.371620:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1370 00002000:00100000:0.0:1787119525.371634:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a508ffdc00 x1873929633696256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.371646:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdc00 with x1873929633696256 ext(335872->372735) 00010000:00010000:0.0:1787119525.371655:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.371682:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.371687:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffdc00 00000100:00100000:1.0:1787119525.377687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.377886:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633696384 00000100:00100000:0.0:1787119525.377897:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633696384 00000100:00100000:0.0:1787119525.378027:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5540 00000100:00100000:0.0:1787119525.378039:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633696384:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.378060:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.378080:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b22 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.378112:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 264) 00010000:00010000:0.0:1787119525.378122:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.378130:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(225 264) 00010000:00010000:0.0:1787119525.378136:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.378191:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.378207:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.378220:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119525.378328:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633696384:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 290us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.378335:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5540 00000100:00100000:2.0:1787119525.384023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.386557:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633696512 00000100:00100000:1.0:1787119525.386575:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633696512 00010000:00010000:1.0:1787119525.386628:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.386684:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5583 00000100:00100000:1.0:1787119525.386695:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633696512:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.386713:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.386738:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.386762:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.386787:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e447b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b14 expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.386805:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 264) 00010000:00010000:1.0:1787119525.386809:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 264) 00010000:00010000:1.0:1787119525.386818:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.386829:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.386876:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.386892:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 49 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.386906:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653674752:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.387006:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.392835:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653674752:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.392865:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.392935:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633696512:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6240us (8919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.392947:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5583 00000100:00100000:3.0:1787119525.394656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.394751:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633696640 00000100:00100000:2.0:1787119525.394760:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633696640 00010000:00010000:2.0:1787119525.394798:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.394853:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5584 00000100:00100000:2.0:1787119525.394863:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2374:x1873929633696640:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.395169:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.395196:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.395224:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.395250:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4482 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b1b expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.395273:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 264) 00010000:00010000:2.0:1787119525.395277:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 264) 00010000:00010000:2.0:1787119525.395286:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.395296:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.395337:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.395352:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653674880:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.396168:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.403659:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653674880:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.403690:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.403756:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2374:x1873929633696640:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8894us (9107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.403766:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5584 00000100:00100000:1.0:1787119525.407113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.407222:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633696768 00000100:00100000:0.0:1787119525.407233:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633696768 00000100:00100000:0.0:1787119525.407296:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5541 00000100:00100000:0.0:1787119525.407305:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633696768:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.407326:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.407346:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b29 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.407379:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.407390:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 264) 00010000:00010000:0.0:1787119525.407394:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 264) 00010000:00010000:0.0:1787119525.407400:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 50 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.407434:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.407507:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 40 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.407521:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653675008:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.407594:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.411573:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653675008:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.411611:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 50 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.411635:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119525.411702:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633696768:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4397us (4598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.411712:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5541 00000100:00100000:3.0:1787119525.413134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.413236:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633696896 00000100:00100000:2.0:1787119525.413247:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633696896 00010000:00010000:2.0:1787119525.413286:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.413337:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5585 00000100:00100000:2.0:1787119525.413347:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633696896:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.413363:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.413387:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.413413:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.413478:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4489 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b22 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.413500:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 264) 00010000:00010000:2.0:1787119525.413506:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 264) 00010000:00010000:2.0:1787119525.413515:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.413526:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.413575:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.413592:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653675136:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.413668:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.417429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.417562:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633697024 00000100:00100000:0.0:1787119525.417572:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633697024 00000100:00100000:0.0:1787119525.417630:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5542 00000100:00100000:0.0:1787119525.417640:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633697024:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.417658:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.417680:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b30 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.417713:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.417724:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 264) 00010000:00010000:0.0:1787119525.417729:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 264) 00010000:00010000:0.0:1787119525.417735:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.417769:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.417795:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 49 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.417811:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653675264:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.417925:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.421204:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653675136:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.421234:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.421292:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633696896:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7944us (8164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.421303:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5585 00000100:00100000:3.0:1787119525.424287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.424430:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633697152 00000100:00100000:0.0:1787119525.424476:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633697152 00002000:00100000:0.0:1787119525.424530:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508ffed80 x1873929633697152/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.424575:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffed80 with x1873929633697152 ext(335872->339967) 00010000:00010000:0.0:1787119525.424585:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.424613:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.424620:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffed80 00000100:00100000:0.0:1787119525.424654:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1371 00000100:00100000:0.0:1787119525.424663:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633697152:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.424948:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633697152:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 285us (671us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119525.424966:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1371 00002000:00100000:0.0:1787119525.424973:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508ffed80 x1873929633697152/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.424981:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffed80 with x1873929633697152 ext(335872->339967) 00010000:00010000:0.0:1787119525.424987:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.425007:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.425014:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffed80 00000100:00100000:0.0:1787119525.427063:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653675264:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.427099:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.427119:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119525.427186:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633697024:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9547us (9768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.427194:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5542 00000100:00100000:1.0:1787119525.441099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.441371:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633697280 00000100:00100000:3.0:1787119525.441382:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633697280 00000100:00100000:3.0:1787119525.441490:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5543 00000100:00100000:3.0:1787119525.441501:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633697280:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119525.441520:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119525.441542:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b37 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.441577:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 264) 00010000:00010000:3.0:1787119525.441586:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.441595:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(229 264) 00010000:00010000:3.0:1787119525.441600:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.441647:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.441662:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.441675:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:3.0:1787119525.441737:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633697280:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 238us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.441744:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5543 00000100:00100000:3.0:1787119525.447814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.447992:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633697408 00000100:00100000:2.0:1787119525.448002:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633697408 00010000:00010000:2.0:1787119525.448045:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.448091:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5586 00000100:00100000:2.0:1787119525.448102:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2374:x1873929633697408:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.448116:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.448151:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.448178:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.448203:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4490 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b29 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.448225:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 264) 00010000:00010000:2.0:1787119525.448230:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 264) 00010000:00010000:2.0:1787119525.448239:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.448255:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.448295:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.448310:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.448324:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653675520:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.448406:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.452304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.452528:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633697536 00000100:00100000:3.0:1787119525.452539:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633697536 00002000:00100000:3.0:1787119525.452587:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a634039500 x1873929633697536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.452599:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039500 with x1873929633697536 ext(335872->372735) 00010000:00010000:3.0:1787119525.452609:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.452638:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.452645:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039500 00000100:00100000:3.0:1787119525.452681:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1372 00000100:00100000:3.0:1787119525.452693:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633697536:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119525.453187:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653675520:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.453210:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.455211:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2374:x1873929633697408:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7098us (7393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.455225:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5586 00000100:00100000:2.0:1787119525.473537:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633697536:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 20834us (21231us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119525.473553:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1372 00002000:00100000:2.0:1787119525.473566:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a634039500 x1873929633697536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119525.473576:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634039500 with x1873929633697536 ext(335872->372735) 00010000:00010000:2.0:1787119525.473586:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.473618:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119525.473626:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634039500 00000100:00100000:2.0:1787119525.477413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.477587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.477663:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633697792 00000100:00100000:3.0:1787119525.477675:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633697792 00010000:00010000:3.0:1787119525.477717:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.477766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5587 00000100:00100000:3.0:1787119525.477776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633697792:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.477791:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.477820:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.477847:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.477884:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4497 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b30 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.477902:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 264) 00010000:00010000:3.0:1787119525.477907:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 264) 00010000:00010000:3.0:1787119525.477915:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.477925:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.477991:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.478008:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653675648:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.478088:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.481779:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653675648:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.481819:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.482003:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2373:x1873929633697792:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4226us (4414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.482014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5587 00000100:00100000:0.0:1787119525.483608:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633697664 00000100:00100000:0.0:1787119525.483623:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633697664 00000100:00100000:2.0:1787119525.483799:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5544 00000100:00100000:2.0:1787119525.483811:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633697664:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.483842:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.483863:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b3e expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.484030:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.484040:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 264) 00010000:00010000:2.0:1787119525.484044:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 264) 00010000:00010000:2.0:1787119525.484049:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.484087:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.484112:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 49 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.484127:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653675776:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119525.485507:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.491178:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653675776:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119525.491217:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.491238:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894200, rc 0) 00000100:00100000:2.0:1787119525.491299:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633697664:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7491us (13895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.491307:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5544 00000100:00100000:0.0:1787119525.493314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.493539:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633697920 00000100:00100000:2.0:1787119525.493548:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633697920 00010000:00010000:2.0:1787119525.493585:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.493624:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5588 00000100:00100000:2.0:1787119525.493633:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2373:x1873929633697920:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.493650:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.493785:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.493811:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.493847:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e449e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b37 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.493864:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 264) 00010000:00010000:2.0:1787119525.493985:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 264) 00010000:00010000:2.0:1787119525.493996:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.494006:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.494042:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.494056:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653675904:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.494187:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.496610:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653675904:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.496639:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.496698:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2373:x1873929633697920:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3064us (3391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.496709:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5588 00000100:00100000:3.0:1787119525.503916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.504033:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633698048 00000100:00100000:0.0:1787119525.504042:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633698048 00000100:00100000:0.0:1787119525.504102:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5545 00000100:00100000:0.0:1787119525.504112:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633698048:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.504130:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.504162:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b45 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.504195:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.504206:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 264) 00010000:00010000:0.0:1787119525.504211:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 264) 00010000:00010000:0.0:1787119525.504216:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 50 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.504250:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.504277:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 40 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.504292:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653676032:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.504387:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.513791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.513844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.514024:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633698176 00000100:00100000:2.0:1787119525.514034:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633698176 00010000:00010000:2.0:1787119525.514075:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.514119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5589 00000100:00100000:2.0:1787119525.514129:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620781450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633698176:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.514152:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.514174:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.514200:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.514229:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 264) 00010000:00010000:2.0:1787119525.514234:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 264) 00010000:00010000:2.0:1787119525.514242:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 50 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.514252:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 50 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.514290:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 50 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.514311:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653676160:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.514383:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00010000:00010000:0.0:1787119525.514520:0:20843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e44a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b3e expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.514537:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653676032:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.514559:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 50 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.514569:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:0.0:1787119525.514595:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633698048:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10485us (10689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.514606:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5545 00000100:00100000:0.0:1787119525.514625:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633698304 00000100:00100000:0.0:1787119525.514627:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633698304 00000100:00100000:0.0:1787119525.514654:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5546 00000100:00100000:0.0:1787119525.514669:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633698304:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.514681:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.514693:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b4c expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.514712:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.514720:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 264) 00010000:00010000:0.0:1787119525.514723:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 264) 00010000:00010000:0.0:1787119525.514728:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 42 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.514746:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.514762:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 49 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.514773:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653676288:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119525.514798:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.519483:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653676288:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.519518:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 42 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.519541:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119525.519607:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633698304:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4944us (5760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.519616:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5546 00000100:00100000:1.0:1787119525.520475:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653676160:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.520496:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.520582:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620781450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633698176:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6454us (6801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.520593:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5589 00000100:00100000:0.0:1787119525.526535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.527842:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633698432 00000100:00100000:1.0:1787119525.527856:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633698432 00002000:00100000:1.0:1787119525.527911:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a509230700 x1873929633698432/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.527923:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230700 with x1873929633698432 ext(335872->339967) 00010000:00010000:1.0:1787119525.527932:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.527975:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119525.527988:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230700 00000100:00100000:1.0:1787119525.528022:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1373 00000100:00100000:1.0:1787119525.528032:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633698432:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119525.528243:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633698432:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 211us (1717us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119525.528250:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1373 00002000:00100000:1.0:1787119525.528257:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a509230700 x1873929633698432/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.528266:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230700 with x1873929633698432 ext(335872->339967) 00010000:00010000:1.0:1787119525.528271:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.528285:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119525.528292:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230700 00000100:00100000:0.0:1787119525.532051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.532174:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633698560 00000100:00100000:2.0:1787119525.532184:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633698560 00000100:00100000:2.0:1787119525.532246:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5547 00000100:00100000:2.0:1787119525.532255:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633698560:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.532276:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.532298:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b53 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.532333:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 264) 00010000:00010000:2.0:1787119525.532343:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.532351:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 264) 00010000:00010000:2.0:1787119525.532356:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.532547:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.532565:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.532584:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895a00, rc 0) 00000100:00100000:2.0:1787119525.532639:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633698560:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 385us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.532647:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5547 00000100:00100000:3.0:1787119525.536152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.536491:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633698688 00000100:00100000:2.0:1787119525.536502:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633698688 00010000:00010000:2.0:1787119525.536548:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.536583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5590 00000100:00100000:2.0:1787119525.536592:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2373:x1873929633698688:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.536609:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.536632:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.536670:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.536699:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e44ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b45 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.536718:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 264) 00010000:00010000:2.0:1787119525.536723:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 264) 00010000:00010000:2.0:1787119525.536733:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.536744:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.536784:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.536798:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 40 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.536936:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653676544:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.537040:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.542233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.542332:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653676544:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.542356:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.542426:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2373:x1873929633698688:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5834us (6294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.542465:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5590 00000100:00100000:3.0:1787119525.542581:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633698816 00000100:00100000:3.0:1787119525.542589:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633698816 00002000:00100000:3.0:1787119525.542636:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a509230000 x1873929633698816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.542647:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633698816 ext(335872->372735) 00010000:00010000:3.0:1787119525.542656:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.542695:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.542703:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230000 00000100:00100000:3.0:1787119525.542722:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1374 00000100:00100000:3.0:1787119525.542732:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633698816:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119525.546545:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633698816:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3802us (4308us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119525.546562:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1374 00002000:00100000:3.0:1787119525.546574:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a509230000 x1873929633698816/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.546584:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633698816 ext(335872->372735) 00010000:00010000:3.0:1787119525.546594:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.546624:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.546632:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230000 00000100:00100000:0.0:1787119525.550717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.550793:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.550921:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633698944 00000100:00100000:2.0:1787119525.550932:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633698944 00000100:00100000:2.0:1787119525.550999:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5548 00000100:00100000:2.0:1787119525.551008:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633698944:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.551025:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.551044:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b5a expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.551080:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 264) 00010000:00010000:2.0:1787119525.551088:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.551096:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(236 264) 00010000:00010000:2.0:1787119525.551101:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.551296:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.551315:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.551328:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895400, rc 0) 00000100:00100000:2.0:1787119525.551390:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633698944:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 383us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.551397:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5548 00000100:00100000:1.0:1787119525.552673:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633699072 00000100:00100000:1.0:1787119525.552687:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633699072 00010000:00010000:1.0:1787119525.552729:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.552775:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5591 00000100:00100000:1.0:1787119525.552785:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633699072:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.552799:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.552833:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.552859:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.552884:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e44b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b4c expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.552905:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 264) 00010000:00010000:1.0:1787119525.552910:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 264) 00010000:00010000:1.0:1787119525.552918:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.552928:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.553043:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.553058:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 49 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.553072:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653676800:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.553289:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.556702:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653676800:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.556731:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.556783:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633699072:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3999us (5989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.556794:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5591 00000100:00100000:3.0:1787119525.557270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.557395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633699200 00000100:00100000:0.0:1787119525.557403:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633699200 00010000:00010000:0.0:1787119525.557465:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 50 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.557505:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5592 00000100:00100000:0.0:1787119525.557516:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633699200:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119525.557532:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119525.557557:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 50 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.557584:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 50 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.557615:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e44ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b53 expref: 50 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.557632:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 264) 00010000:00010000:0.0:1787119525.557637:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 264) 00010000:00010000:0.0:1787119525.557645:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.557655:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.557703:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.557716:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653676928:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119525.557780:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.562765:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653676928:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119525.562793:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119525.562865:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2376:x1873929633699200:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5350us (5595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.562876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5592 00000100:00100000:1.0:1787119525.567546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.568104:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633699328 00000100:00100000:3.0:1787119525.568115:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633699328 00000100:00100000:2.0:1787119525.568358:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5549 00000100:00100000:2.0:1787119525.568369:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633699328:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.568388:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.568407:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b61 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.568475:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.568485:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 264) 00010000:00010000:2.0:1787119525.568490:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 264) 00010000:00010000:2.0:1787119525.568496:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 50 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.568531:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.568558:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 40 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.568573:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653677056:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119525.568669:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.572685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.572788:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653677056:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.572827:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 50 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.572851:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895c00, rc 0) 00000100:00100000:0.0:1787119525.572924:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633699328:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4556us (5387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.572933:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5549 00000100:00100000:3.0:1787119525.573881:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633699456 00000100:00100000:3.0:1787119525.573891:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633699456 00010000:00010000:3.0:1787119525.573926:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.573977:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5593 00000100:00100000:3.0:1787119525.573987:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633699456:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.574000:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.574020:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.574050:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.574075:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e44c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b5a expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.574090:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 264) 00010000:00010000:3.0:1787119525.574094:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 264) 00010000:00010000:3.0:1787119525.574102:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.574112:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.574153:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.574167:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653677184:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.574225:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.577334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.577393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.577469:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633699712 00000100:00100000:2.0:1787119525.577478:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633699712 00002000:00100000:2.0:1787119525.577520:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a509233480 x1873929633699712/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119525.577531:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233480 with x1873929633699712 ext(335872->339967) 00002000:00010000:2.0:1787119525.577536:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233480 00000100:00100000:2.0:1787119525.577566:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10709 00000100:00100000:2.0:1787119525.577575:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633699712:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119525.577751:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633699712:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 176us (357us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119525.577758:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10709 00002000:00100000:2.0:1787119525.577765:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a509233480 x1873929633699712/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119525.577774:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233480 with x1873929633699712 ext(335872->339967) 00002000:00010000:2.0:1787119525.577777:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233480 00000100:00100000:2.0:1787119525.577819:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653677184:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.577838:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.577861:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633699456:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3876us (5189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.577869:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5593 00000100:00100000:3.0:1787119525.578652:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633699584 00000100:00100000:3.0:1787119525.578668:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633699584 00000100:00100000:3.0:1787119525.578704:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5550 00000100:00100000:3.0:1787119525.578711:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633699584:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119525.578722:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119525.578739:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b68 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.578768:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.578778:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 264) 00010000:00010000:3.0:1787119525.578782:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 264) 00010000:00010000:3.0:1787119525.578787:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.578826:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.578850:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 49 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.578864:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653677312:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119525.578924:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.582826:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653677312:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119525.582863:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 41 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.582886:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:3.0:1787119525.582945:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633699584:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4234us (5618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.582970:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5550 00000100:00100000:0.0:1787119525.589080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.589278:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633699840 00000100:00100000:2.0:1787119525.589287:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633699840 00000100:00100000:2.0:1787119525.589348:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5551 00000100:00100000:2.0:1787119525.589358:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633699840:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.589378:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.589399:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b6f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.589433:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 264) 00010000:00010000:2.0:1787119525.589480:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.589493:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 264) 00010000:00010000:2.0:1787119525.589498:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.589539:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.589555:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.589569:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894e00, rc 0) 00000100:00100000:2.0:1787119525.589622:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633699840:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 266us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.589628:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5551 00000100:00100000:2.0:1787119525.599187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.599285:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633699968 00000100:00100000:1.0:1787119525.599295:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633699968 00010000:00010000:1.0:1787119525.599339:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 51 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.599383:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5594 00000100:00100000:1.0:1787119525.599393:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2376:x1873929633699968:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.599409:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.599434:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 51 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.599507:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 51 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.599538:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e44c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b61 expref: 51 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.599558:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(241 264) 00010000:00010000:1.0:1787119525.599564:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(241 264) 00010000:00010000:1.0:1787119525.599573:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.599583:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.599622:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.599637:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 40 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.599651:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653677568:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.599740:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.604251:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653677568:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.604286:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.604353:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633699968:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4960us (5176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.604366:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5594 00000100:00100000:3.0:1787119525.604937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.606095:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633700096 00000100:00100000:1.0:1787119525.606107:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633700096 00002000:00100000:1.0:1787119525.606168:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a508ffe680 x1873929633700096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.606181:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe680 with x1873929633700096 ext(335872->372735) 00010000:00010000:1.0:1787119525.606190:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.606219:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119525.606228:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffe680 00000100:00100000:1.0:1787119525.606262:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1375 00000100:00100000:1.0:1787119525.606272:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633700096:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119525.611546:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633700096:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5264us (6600us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119525.611560:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1375 00002000:00100000:1.0:1787119525.611574:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a508ffe680 x1873929633700096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.611585:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe680 with x1873929633700096 ext(335872->372735) 00010000:00010000:1.0:1787119525.611595:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.611628:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119525.611638:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffe680 00000100:00100000:3.0:1787119525.616502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.617230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.617359:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633700224 00000100:00100000:2.0:1787119525.617369:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633700224 00000100:00100000:2.0:1787119525.617429:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5552 00000100:00100000:2.0:1787119525.617463:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633700224:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.617483:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.617505:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b76 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.617540:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(241 264) 00010000:00010000:2.0:1787119525.617551:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.617558:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 264) 00010000:00010000:2.0:1787119525.617563:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.617616:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.617633:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.617648:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894a00, rc 0) 00000100:00100000:2.0:1787119525.617793:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633700224:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 355us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.617801:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5552 00000100:00100000:0.0:1787119525.617963:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633700352 00000100:00100000:0.0:1787119525.617968:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633700352 00010000:00010000:0.0:1787119525.618003:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.618035:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5595 00000100:00100000:0.0:1787119525.618044:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633700352:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119525.618053:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119525.618076:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.618101:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.618122:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e44cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b68 expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.618152:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 264) 00010000:00010000:0.0:1787119525.618156:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 264) 00010000:00010000:0.0:1787119525.618165:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.618175:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.618201:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.618217:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 49 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.618231:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653677824:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119525.618286:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.623080:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653677824:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.623106:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.623177:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633700352:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5132us (5947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.623192:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5595 00000100:00100000:1.0:1787119525.625388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.625573:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633700480 00000100:00100000:2.0:1787119525.625582:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633700480 00010000:00010000:2.0:1787119525.625622:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 50 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.625712:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5596 00000100:00100000:2.0:1787119525.625733:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620782c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2373:x1873929633700480:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.625749:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.625772:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 50 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.625800:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 50 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.625838:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b6f expref: 50 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.625859:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 264) 00010000:00010000:2.0:1787119525.625864:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 264) 00010000:00010000:2.0:1787119525.625873:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.625884:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.625930:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.625945:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653677952:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.626051:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.630084:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653677952:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119525.630112:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119525.630282:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620782c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2373:x1873929633700480:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4560us (4901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.630294:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5596 00000100:00100000:0.0:1787119525.646327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.646847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.647936:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633700608 00000100:00100000:2.0:1787119525.647958:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633700608 00000100:00100000:2.0:1787119525.648033:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5553 00000100:00100000:2.0:1787119525.648043:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633700608:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.648063:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.648087:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b7d expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.648124:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.648146:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 264) 00010000:00010000:2.0:1787119525.648151:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 264) 00010000:00010000:2.0:1787119525.648157:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.648194:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.648235:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 40 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.648251:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653678080:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119525.648344:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.650827:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633700736 00000100:00100000:1.0:1787119525.650842:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633700736 00002000:00100000:1.0:1787119525.651145:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a509232a00 x1873929633700736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.651158:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633700736 ext(335872->372735) 00010000:00010000:1.0:1787119525.651168:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.651198:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119525.651206:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509232a00 00000100:00100000:1.0:1787119525.651349:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1376 00000100:00100000:1.0:1787119525.651360:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633700736:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119525.664262:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633700736:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 12894us (17405us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119525.664275:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1376 00002000:00100000:1.0:1787119525.664287:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a509232a00 x1873929633700736/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119525.664298:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633700736 ext(335872->372735) 00010000:00010000:1.0:1787119525.664308:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.664338:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119525.664347:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509232a00 00000100:00100000:2.0:1787119525.667883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.668596:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633700864 00000100:00100000:3.0:1787119525.668607:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633700864 00000100:00100000:3.0:1787119525.668676:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5554 00000100:00100000:3.0:1787119525.668687:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633700864:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119525.668705:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119525.668726:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b84 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.668759:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 264) 00010000:00010000:3.0:1787119525.668768:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.668775:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(245 264) 00010000:00010000:3.0:1787119525.668780:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 42 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.668827:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.668841:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 42 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.668854:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:3.0:1787119525.668922:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633700864:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 237us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.668929:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5554 00000100:00100000:2.0:1787119525.670602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.670777:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633700992 00000100:00100000:1.0:1787119525.670785:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633700992 00010000:00010000:1.0:1787119525.670824:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 42 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.670969:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653678080:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119525.671005:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.671022:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894e00, rc 0) 00000100:00100000:1.0:1787119525.671122:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5597 00000100:00100000:1.0:1787119525.671141:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2374:x1873929633700992:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.671155:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.671175:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 42 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.671200:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 42 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.671239:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e44dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b76 expref: 42 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.671257:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 264) 00010000:00010000:1.0:1787119525.671262:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 264) 00010000:00010000:1.0:1787119525.671270:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.671285:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.671318:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.671334:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.671347:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653678336:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.671427:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.671847:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633700608:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 23803us (25529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.671855:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5553 00000100:00100000:0.0:1787119525.675775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.676011:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633701120 00000100:00100000:3.0:1787119525.676021:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633701120 00002000:00100000:3.0:1787119525.676074:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508da7480 x1873929633701120/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.676085:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7480 with x1873929633701120 ext(335872->339967) 00010000:00010000:3.0:1787119525.676094:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.676121:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.676134:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da7480 00000100:00100000:3.0:1787119525.676165:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1377 00000100:00100000:3.0:1787119525.676175:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633701120:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119525.676329:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653678336:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.676351:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.676498:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633700992:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5367us (5901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.676507:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5597 00000100:00100000:3.0:1787119525.678895:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633701120:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2708us (3120us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119525.678911:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1377 00002000:00100000:3.0:1787119525.678925:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508da7480 x1873929633701120/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.678936:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da7480 with x1873929633701120 ext(335872->339967) 00010000:00010000:3.0:1787119525.678958:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.678990:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.679004:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da7480 00000100:00100000:0.0:1787119525.682006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.682051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.682140:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633701248 00000100:00100000:1.0:1787119525.682152:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633701248 00010000:00010000:1.0:1787119525.682191:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.682237:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5598 00000100:00100000:1.0:1787119525.682246:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2373:x1873929633701248:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.682264:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.682285:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.682311:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.682337:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e44e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b7d expref: 50 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.682357:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 264) 00010000:00010000:1.0:1787119525.682362:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 264) 00010000:00010000:1.0:1787119525.682370:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.682392:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.682428:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.682485:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653678464:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.682557:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.682670:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633701376 00000100:00100000:3.0:1787119525.682675:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633701376 00000100:00100000:3.0:1787119525.682715:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5555 00000100:00100000:3.0:1787119525.682724:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633701376:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119525.682737:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119525.682750:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b8b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.682775:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.682782:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 264) 00010000:00010000:3.0:1787119525.682786:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 264) 00010000:00010000:3.0:1787119525.682791:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.682813:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.682827:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 40 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.682838:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653678592:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119525.682864:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.688625:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653678464:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.690267:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.690360:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2373:x1873929633701248:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8108us (8303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.690374:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5598 00000100:00100000:3.0:1787119525.692147:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653678592:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119525.692182:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.692205:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:3.0:1787119525.692266:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633701376:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9543us (10269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.692276:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5555 00000100:00100000:0.0:1787119525.698049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.698182:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633701504 00000100:00100000:3.0:1787119525.698194:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633701504 00010000:00010000:3.0:1787119525.698240:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.698280:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5599 00000100:00100000:3.0:1787119525.698290:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633701504:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.698306:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.698330:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.698355:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.698382:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e44eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b84 expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.698399:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 264) 00010000:00010000:3.0:1787119525.698405:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 264) 00010000:00010000:3.0:1787119525.698413:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.698423:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.698501:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.698518:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653678720:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.698598:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.704306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.707389:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653678720:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.707418:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.707506:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633701504:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9215us (9469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.707521:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5599 00000100:00100000:0.0:1787119525.708795:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633701632 00000100:00100000:0.0:1787119525.708806:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633701632 00000100:00100000:1.0:1787119525.709004:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5556 00000100:00100000:1.0:1787119525.709013:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633701632:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119525.709031:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119525.709049:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b92 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.709081:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.709091:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 264) 00010000:00010000:1.0:1787119525.709096:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 264) 00010000:00010000:1.0:1787119525.709101:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.709248:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.709274:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 49 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.709288:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653678848:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119525.709374:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60d986840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.721085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.721197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.721395:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633701888 00000100:00100000:0.0:1787119525.721405:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633701888 00000100:00100000:0.0:1787119525.721490:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5557 00000100:00100000:0.0:1787119525.721501:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633701888:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.721518:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.721536:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716b99 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.721568:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 264) 00010000:00010000:0.0:1787119525.721577:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.721585:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(249 264) 00010000:00010000:0.0:1787119525.721590:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.721628:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.721642:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.721672:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119525.721726:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633701888:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 227us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.721733:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5557 00000100:00100000:2.0:1787119525.722310:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633701760 00000100:00100000:2.0:1787119525.722316:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633701760 00010000:00010000:2.0:1787119525.722342:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 51 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.722378:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5600 00000100:00100000:2.0:1787119525.722396:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2376:x1873929633701760:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.722406:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.722431:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 51 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.722481:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 51 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.722504:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 264) 00010000:00010000:2.0:1787119525.722509:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 264) 00010000:00010000:2.0:1787119525.722517:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.722526:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.722553:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.722573:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.722586:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653679104:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.722652:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00010000:00010000:3.0:1787119525.723583:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e44f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b8b expref: 51 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.723603:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653678848:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119525.723641:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.723652:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.724340:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:2.0:1787119525.726426:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633701632:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 17395us (22111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.726468:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5556 00000100:00100000:2.0:1787119525.727506:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653679104:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.727537:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.727586:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633701760:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5190us (6512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.727597:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5600 00000100:00100000:1.0:1787119525.734581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.734681:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633702016 00000100:00100000:3.0:1787119525.734692:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633702016 00002000:00100000:3.0:1787119525.734744:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a634038e00 x1873929633702016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.734756:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038e00 with x1873929633702016 ext(335872->372735) 00010000:00010000:3.0:1787119525.734765:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.734795:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.734809:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634038e00 00000100:00100000:3.0:1787119525.734844:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1378 00000100:00100000:3.0:1787119525.734853:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633702016:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.740035:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633702016:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5170us (5451us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119525.740050:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1378 00002000:00100000:0.0:1787119525.740064:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a634038e00 x1873929633702016/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.740074:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634038e00 with x1873929633702016 ext(335872->372735) 00010000:00010000:0.0:1787119525.740084:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.740114:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 41 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.740123:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634038e00 00000100:00100000:3.0:1787119525.758869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.763083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.763332:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633702272 00000100:00100000:3.0:1787119525.763342:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633702272 00000100:00100000:3.0:1787119525.763414:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5558 00000100:00100000:3.0:1787119525.763424:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633702272:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119525.763472:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119525.763491:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ba0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.763523:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 264) 00010000:00010000:3.0:1787119525.763532:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.763540:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(251 264) 00010000:00010000:3.0:1787119525.763546:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.763588:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.763603:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.763617:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:3.0:1787119525.763684:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633702272:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 261us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.763690:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5558 00000100:00100000:1.0:1787119525.767993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633702144 00000100:00100000:1.0:1787119525.768008:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633702144 00010000:00010000:2.0:1787119525.768191:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 42 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.768240:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5601 00000100:00100000:2.0:1787119525.768250:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633702144:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.768267:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.768292:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 42 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.768326:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 42 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.768353:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e44f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b92 expref: 42 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.768373:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 264) 00010000:00010000:2.0:1787119525.768378:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 264) 00010000:00010000:2.0:1787119525.768403:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.768413:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.768484:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.768500:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 49 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.768513:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653679360:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.768616:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.780345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.781063:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653679360:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119525.781088:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119525.781153:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633702144:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12903us (22293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.781166:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5601 00000100:00100000:3.0:1787119525.781299:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633702400 00000100:00100000:3.0:1787119525.781305:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633702400 00002000:00100000:3.0:1787119525.781343:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a63dc05f80 x1873929633702400/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.781351:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633702400 ext(335872->339967) 00010000:00010000:3.0:1787119525.781358:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.781384:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.781392:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05f80 00000100:00100000:3.0:1787119525.781424:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1379 00000100:00100000:3.0:1787119525.781434:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633702400:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119525.781606:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633702400:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 175us (1270us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119525.781611:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1379 00002000:00100000:3.0:1787119525.781615:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a63dc05f80 x1873929633702400/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.781625:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633702400 ext(335872->339967) 00010000:00010000:3.0:1787119525.781629:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.781639:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 50 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.781644:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05f80 00000100:00100000:2.0:1787119525.787229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.787313:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633702528 00000100:00100000:3.0:1787119525.787324:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633702528 00000100:00100000:3.0:1787119525.787400:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5559 00000100:00100000:3.0:1787119525.787411:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633702528:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119525.787431:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.787890:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ba7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.787927:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 264) 00010000:00010000:0.0:1787119525.787935:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.787953:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 264) 00010000:00010000:0.0:1787119525.787959:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.788005:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.788021:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.788035:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119525.788098:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633702528:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 688us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.788106:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5559 00000100:00100000:1.0:1787119525.794167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.794266:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633702656 00000100:00100000:2.0:1787119525.794278:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633702656 00010000:00010000:2.0:1787119525.794322:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.794374:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5602 00000100:00100000:2.0:1787119525.794394:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2373:x1873929633702656:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.794409:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.794434:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.794490:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.794518:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4500 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716b99 expref: 51 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.794550:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(254 264) 00010000:00010000:2.0:1787119525.794555:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(254 264) 00010000:00010000:2.0:1787119525.794564:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.794574:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.794617:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.794634:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 40 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.794648:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653679616:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.794740:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.801187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.801275:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633702784 00000100:00100000:0.0:1787119525.801285:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633702784 00002000:00100000:0.0:1787119525.801330:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a5066dd500 x1873929633702784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.801341:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633702784 ext(335872->372735) 00010000:00010000:0.0:1787119525.801350:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.801466:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.801477:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dd500 00000100:00100000:0.0:1787119525.801512:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1380 00000100:00100000:0.0:1787119525.801522:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633702784:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119525.802044:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653679616:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.802066:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.802101:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2373:x1873929633702656:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7718us (7945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.802111:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5602 00000100:00100000:0.0:1787119525.823209:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633702784:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 21614us (21961us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119525.823224:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1380 00002000:00100000:0.0:1787119525.823239:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a5066dd500 x1873929633702784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.823251:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd500 with x1873929633702784 ext(335872->372735) 00010000:00010000:0.0:1787119525.823261:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.823293:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 41 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.823302:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dd500 00000100:00100000:3.0:1787119525.827021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.827181:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633702912 00000100:00100000:0.0:1787119525.827191:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633702912 00000100:00100000:0.0:1787119525.827253:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5560 00000100:00100000:0.0:1787119525.827263:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633702912:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119525.827284:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119525.827305:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bae expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.827340:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(254 264) 00010000:00010000:0.0:1787119525.827349:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.827357:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 264) 00010000:00010000:0.0:1787119525.827363:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 42 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.827421:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.827482:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 42 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.827497:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119525.827553:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633702912:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 291us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119525.827560:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5560 00000100:00100000:1.0:1787119525.832185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.832325:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633703040 00000100:00100000:2.0:1787119525.832334:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633703040 00010000:00010000:2.0:1787119525.832372:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.832414:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5603 00000100:00100000:2.0:1787119525.832424:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620780c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633703040:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.832475:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.832498:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.832527:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.832558:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e4507 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba0 expref: 42 pid: 20841 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.832575:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 264) 00010000:00010000:2.0:1787119525.832580:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 264) 00010000:00010000:2.0:1787119525.832588:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.832600:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.832639:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.832653:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 49 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.832742:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653679872:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.832892:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.836052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.836285:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653679872:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.836310:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.836369:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620780c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633703040:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3945us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.836380:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5603 00000100:00100000:1.0:1787119525.836436:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633703168 00000100:00100000:1.0:1787119525.836465:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633703168 00010000:00010000:1.0:1787119525.836496:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.836524:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5604 00000100:00100000:1.0:1787119525.836532:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633703168:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119525.836545:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119525.836567:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.836591:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.836617:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e450e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ba7 expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.836635:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 264) 00010000:00010000:1.0:1787119525.836640:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 264) 00010000:00010000:1.0:1787119525.836648:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.836671:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.836709:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.836724:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653680000:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.836770:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.840600:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653680000:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.840628:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.843587:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2376:x1873929633703168:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7042us (7533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.843604:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5604 00000100:00100000:2.0:1787119525.847593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.847697:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633703296 00000100:00100000:1.0:1787119525.847708:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633703296 00000100:00100000:1.0:1787119525.847768:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5561 00000100:00100000:1.0:1787119525.847777:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633703296:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119525.847795:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119525.847827:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bb5 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.847863:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.847873:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 264) 00010000:00010000:1.0:1787119525.847878:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 264) 00010000:00010000:1.0:1787119525.847883:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.847917:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.847953:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 40 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.847969:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653680128:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119525.848054:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.854482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.854568:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633703424 00000100:00100000:3.0:1787119525.854578:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633703424 00002000:00100000:3.0:1787119525.854629:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a63dc04380 x1873929633703424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.854641:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04380 with x1873929633703424 ext(335872->372735) 00010000:00010000:3.0:1787119525.854652:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.854695:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.854709:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc04380 00000100:00100000:3.0:1787119525.854742:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1381 00000100:00100000:3.0:1787119525.854752:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633703424:12345-192.168.201.59@tcp:3:kworker.0 00010000:00010000:0.0:1787119525.857765:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119525.858357:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633703424:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3599us (3918us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119525.858370:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1381 00002000:00100000:3.0:1787119525.858384:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a63dc04380 x1873929633703424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.858395:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04380 with x1873929633703424 ext(335872->372735) 00010000:00010000:3.0:1787119525.858405:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.858435:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 41 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.858476:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc04380 00000100:00100000:1.0:1787119525.864158:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653680128:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119525.864198:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.864222:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119525.864285:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633703296:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 16507us (16701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.864294:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5561 00000100:00100000:1.0:1787119525.870530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.870669:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633703552 00000100:00100000:2.0:1787119525.870679:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633703552 00000100:00100000:2.0:1787119525.870785:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5562 00000100:00100000:2.0:1787119525.870796:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633703552:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.870824:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.870845:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bbc expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.870878:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 264) 00010000:00010000:2.0:1787119525.870886:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.870893:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(258 264) 00010000:00010000:2.0:1787119525.870898:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.870951:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.870969:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.870982:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895e00, rc 0) 00000100:00100000:2.0:1787119525.871088:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633703552:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 293us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.871095:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5562 00000100:00100000:3.0:1787119525.873715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.873921:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633703680 00000100:00100000:0.0:1787119525.873931:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633703680 00010000:00010000:0.0:1787119525.873986:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.874031:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5605 00000100:00100000:0.0:1787119525.874042:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633703680:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119525.874057:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119525.874080:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.874105:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.874131:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bae expref: 42 pid: 20843 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.874266:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 264) 00010000:00010000:0.0:1787119525.874272:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 264) 00010000:00010000:0.0:1787119525.874281:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.874292:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.874331:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.874346:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 49 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119525.874360:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653680384:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119525.876773:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.881164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.881667:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633703808 00000100:00100000:3.0:1787119525.881677:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633703808 00002000:00100000:3.0:1787119525.881728:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a63dc04e00 x1873929633703808/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.881740:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04e00 with x1873929633703808 ext(335872->339967) 00010000:00010000:3.0:1787119525.881750:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.881778:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.881786:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc04e00 00000100:00100000:3.0:1787119525.881973:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1382 00000100:00100000:3.0:1787119525.881984:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633703808:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119525.882179:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633703808:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 196us (1025us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119525.882187:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1382 00002000:00100000:3.0:1787119525.882193:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a63dc04e00 x1873929633703808/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.882202:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04e00 with x1873929633703808 ext(335872->339967) 00010000:00010000:3.0:1787119525.882208:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.882224:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.882231:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc04e00 00000100:00100000:1.0:1787119525.882400:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653680384:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.882420:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.882478:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633703680:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8437us (8773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.882487:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5605 00000100:00100000:2.0:1787119525.887285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.887410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.887515:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633704064 00000100:00100000:3.0:1787119525.887525:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633704064 00010000:00010000:3.0:1787119525.887565:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.887615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5606 00000100:00100000:3.0:1787119525.887626:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2373:x1873929633704064:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.887642:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.887676:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.887704:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.887731:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e451c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bb5 expref: 50 pid: 8267 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.887747:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 264) 00010000:00010000:3.0:1787119525.887752:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 264) 00010000:00010000:3.0:1787119525.887761:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.887771:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.887821:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.887838:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653680512:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.887926:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.890707:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653680512:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119525.890733:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119525.890791:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2373:x1873929633704064:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3166us (3380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.890803:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5606 00000100:00100000:0.0:1787119525.892919:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633703936 00000100:00100000:0.0:1787119525.892936:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633703936 00000100:00100000:2.0:1787119525.893233:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5563 00000100:00100000:2.0:1787119525.893246:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633703936:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.893266:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.893287:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bc3 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.893325:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.893336:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 264) 00010000:00010000:2.0:1787119525.893340:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 264) 00010000:00010000:2.0:1787119525.893346:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.893384:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.893411:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 40 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.893426:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653680640:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119525.893550:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.898002:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653680640:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119525.898043:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.898072:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894400, rc 0) 00000100:00100000:2.0:1787119525.898136:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633703936:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4885us (10854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.898145:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5563 00000100:00100000:1.0:1787119525.899649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.899796:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633704192 00000100:00100000:2.0:1787119525.899806:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633704192 00010000:00010000:2.0:1787119525.899853:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.899894:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5607 00000100:00100000:2.0:1787119525.899903:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633704192:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.899918:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.899950:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.899985:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.900011:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4523 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bbc expref: 41 pid: 12469 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.900028:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 264) 00010000:00010000:2.0:1787119525.900033:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 264) 00010000:00010000:2.0:1787119525.900042:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.900054:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.900090:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.900103:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653680768:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.900193:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.907368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.907470:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633704320 00000100:00100000:1.0:1787119525.907482:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633704320 00000100:00100000:1.0:1787119525.907539:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5564 00000100:00100000:1.0:1787119525.907549:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633704320:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119525.907568:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119525.907590:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bca expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.907624:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.907634:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 264) 00010000:00010000:1.0:1787119525.907638:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 264) 00010000:00010000:1.0:1787119525.907644:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.907691:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.907718:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 49 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.907734:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653680896:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119525.907869:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.910018:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653680768:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.910046:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.910116:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633704192:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10211us (10471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.910137:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5607 00000100:00100000:0.0:1787119525.913418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.913642:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653680896:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119525.913692:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.913717:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:1.0:1787119525.913790:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633704320:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6242us (6433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119525.913800:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5564 00000100:00100000:2.0:1787119525.914413:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633704448 00000100:00100000:2.0:1787119525.914423:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633704448 00010000:00010000:2.0:1787119525.914479:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.914516:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5608 00000100:00100000:2.0:1787119525.914526:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633704448:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119525.914540:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119525.914563:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.914592:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.914617:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e452a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bc3 expref: 50 pid: 6695 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.914635:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 264) 00010000:00010000:2.0:1787119525.914641:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 264) 00010000:00010000:2.0:1787119525.914651:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.914673:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.914710:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.914724:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653681024:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119525.914800:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119525.921678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.921763:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633704576 00000100:00100000:1.0:1787119525.921773:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633704576 00000100:00100000:1.0:1787119525.921830:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5565 00000100:00100000:1.0:1787119525.921839:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633704576:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119525.921856:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119525.921876:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bd1 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.921908:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.921919:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 264) 00010000:00010000:1.0:1787119525.921924:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(262 264) 00010000:00010000:1.0:1787119525.921929:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.921977:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119525.922000:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 40 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119525.922015:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653681152:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119525.922092:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.940493:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653681024:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119525.940522:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119525.940573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2375:x1873929633704448:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 26048us (27166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.940583:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5608 00000100:00100000:3.0:1787119525.941217:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653681152:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119525.941250:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 50 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.941275:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:3.0:1787119525.941321:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633704576:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 19483us (19653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.941333:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5565 00000100:00100000:1.0:1787119525.942684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119525.942762:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633704704 00000100:00100000:0.0:1787119525.942771:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633704704 00002000:00100000:0.0:1787119525.942822:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a63403b100 x1873929633704704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.942835:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b100 with x1873929633704704 ext(335872->372735) 00010000:00010000:0.0:1787119525.942843:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 41 pid: 6696 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.942869:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 41 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.942877:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b100 00000100:00100000:0.0:1787119525.942904:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1383 00000100:00100000:0.0:1787119525.942912:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633704704:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.947867:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633704704:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4944us (5179us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119525.947882:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1383 00002000:00100000:0.0:1787119525.947896:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a63403b100 x1873929633704704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.947907:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63403b100 with x1873929633704704 ext(335872->372735) 00010000:00010000:0.0:1787119525.947920:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 41 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.947963:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 41 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.947972:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63403b100 00000100:00100000:0.0:1787119525.950298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.950512:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633704832 00000100:00100000:2.0:1787119525.950522:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633704832 00000100:00100000:2.0:1787119525.950580:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5566 00000100:00100000:2.0:1787119525.950591:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633704832:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.950610:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.950631:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bd8 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.950667:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(262 264) 00010000:00010000:2.0:1787119525.950677:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.950684:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 262) 00010000:00010000:2.0:1787119525.950688:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.950733:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.950751:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.950764:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894400, rc 0) 00000100:00100000:2.0:1787119525.950830:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633704832:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 241us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.950836:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5566 00000100:00100000:1.0:1787119525.953356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.953469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633704960 00000100:00100000:3.0:1787119525.953479:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633704960 00010000:00010000:3.0:1787119525.953520:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.953555:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5609 00000100:00100000:3.0:1787119525.953565:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633704960:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.953580:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.953604:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.953629:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.953657:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4531 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bca expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.953679:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 262) 00010000:00010000:3.0:1787119525.953683:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 262) 00010000:00010000:3.0:1787119525.953691:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.953702:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.953741:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.953758:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 49 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.953772:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653681408:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.953868:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.956769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.956865:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653681408:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119525.956887:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119525.956937:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633704960:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3373us (3589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.956958:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5609 00000100:00100000:0.0:1787119525.957168:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633705088 00000100:00100000:0.0:1787119525.957176:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633705088 00002000:00100000:0.0:1787119525.957219:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a511f57800 x1873929633705088/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.957230:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633705088 ext(335872->339967) 00010000:00010000:0.0:1787119525.957238:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.957264:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.957273:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57800 00000100:00100000:0.0:1787119525.957300:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1384 00000100:00100000:0.0:1787119525.957309:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633705088:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119525.957514:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633705088:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 205us (752us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119525.957521:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1384 00002000:00100000:0.0:1787119525.957528:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a511f57800 x1873929633705088/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:561/0 lens 488/4536 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119525.957537:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633705088 ext(335872->339967) 00010000:00010000:0.0:1787119525.957542:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119525.957556:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119525.957563:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57800 00000100:00100000:1.0:1787119525.962553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119525.962593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.962665:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633705344 00000100:00100000:3.0:1787119525.962674:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633705344 00010000:00010000:3.0:1787119525.962713:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.962753:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5610 00000100:00100000:3.0:1787119525.962762:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620782050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2373:x1873929633705344:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.962778:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.962800:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.962833:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.962858:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4538 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd1 expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.962877:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 262) 00010000:00010000:3.0:1787119525.962883:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 262) 00010000:00010000:3.0:1787119525.962892:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.962901:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.962936:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.962961:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653681536:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.963042:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787119525.963183:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633705216 00000100:00100000:2.0:1787119525.963187:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633705216 00000100:00100000:2.0:1787119525.963221:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5567 00000100:00100000:2.0:1787119525.963228:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633705216:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.963241:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.963253:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bdf expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.963273:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.963281:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 262) 00010000:00010000:2.0:1787119525.963284:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 262) 00010000:00010000:2.0:1787119525.963288:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.963308:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 40 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.963322:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 40 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.963333:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653681664:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119525.963356:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.967021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.967257:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653681536:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119525.967279:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119525.967337:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620782050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2373:x1873929633705344:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4574us (4742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.967349:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5610 00000100:00100000:3.0:1787119525.967406:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633705472 00000100:00100000:3.0:1787119525.967413:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633705472 00010000:00010000:3.0:1787119525.967463:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 41 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.967493:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5611 00000100:00100000:3.0:1787119525.967502:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633705472:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.967514:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.967537:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 41 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.967565:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 41 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.967593:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 262) 00010000:00010000:3.0:1787119525.967598:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 262) 00010000:00010000:3.0:1787119525.967607:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.967618:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.967653:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.967668:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508fff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653681792:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.967719:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.970324:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508fff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653681792:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119525.970348:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119525.970399:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633705472:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2898us (3387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.970410:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5611 00010000:00010000:2.0:1787119525.974743:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e453f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bd8 expref: 40 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.974779:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653681664:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119525.974820:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.974833:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895e00, rc 0) 00000100:00100000:2.0:1787119525.974916:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633705216:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11687us (12371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119525.974925:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5567 00000100:00100000:1.0:1787119525.978984:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119525.979064:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633705600 00000100:00100000:2.0:1787119525.979074:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633705600 00000100:00100000:2.0:1787119525.979138:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5568 00000100:00100000:2.0:1787119525.979149:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633705600:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119525.979169:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119525.979189:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716be6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.979224:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.979234:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 262) 00010000:00010000:2.0:1787119525.979238:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 262) 00010000:00010000:2.0:1787119525.979244:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.979295:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119525.979322:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 49 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119525.979338:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653681920:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119525.979421:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119525.984279:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653681920:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119525.984320:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.984345:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894200, rc 0) 00000100:00100000:3.0:1787119525.984414:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633705600:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5266us (5440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.984424:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5568 00000100:00100000:1.0:1787119525.988342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.988430:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633705728 00000100:00100000:3.0:1787119525.988476:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633705728 00010000:00010000:3.0:1787119525.988526:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 50 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.988561:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5612 00000100:00100000:3.0:1787119525.988572:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633705728:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119525.988590:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119525.988621:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 50 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.988652:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 50 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.988680:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4546 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bdf expref: 50 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.988698:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 262) 00010000:00010000:3.0:1787119525.988703:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 262) 00010000:00010000:3.0:1787119525.988712:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.988723:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.988767:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.988783:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508fff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653682048:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119525.988890:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.991666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.991830:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633705856 00000100:00100000:3.0:1787119525.991840:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633705856 00000100:00100000:3.0:1787119525.991898:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5569 00000100:00100000:3.0:1787119525.991908:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633705856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119525.991925:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119525.991954:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bed expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.991988:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.991998:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 262) 00010000:00010000:3.0:1787119525.992002:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 262) 00010000:00010000:3.0:1787119525.992007:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.992040:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.992063:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 40 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119525.992077:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653682176:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119525.992162:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a618558240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119525.995127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119525.995303:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633705984 00000100:00100000:3.0:1787119525.995313:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633705984 00002000:00100000:3.0:1787119525.995363:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a511f57b80 x1873929633705984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/0 e 0 to 0 dl 1787119536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119525.995381:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57b80 with x1873929633705984 ext(335872->372735) 00010000:00010000:3.0:1787119525.995391:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 41 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.995420:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 41 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119525.995428:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57b80 00000100:00100000:3.0:1787119525.995492:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1385 00000100:00100000:3.0:1787119525.995502:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633705984:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119525.998951:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653682176:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119525.998990:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119525.999010:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:3.0:1787119525.999063:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633705856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7156us (7407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119525.999071:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5569 00000100:00100000:0.0:1787119526.003461:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508fff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653682048:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.003486:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.003542:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633705728:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 14972us (15209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.003553:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5612 00000100:00100000:2.0:1787119526.005996:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633705984:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 10484us (10868us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119526.006010:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1385 00002000:00100000:2.0:1787119526.006023:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff92a511f57b80 x1873929633705984/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:561/0 lens 488/440 e 0 to 0 dl 1787119536 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.006033:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57b80 with x1873929633705984 ext(335872->372735) 00010000:00010000:2.0:1787119526.006044:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 41 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.006075:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 41 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.006084:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57b80 00000100:00100000:3.0:1787119526.008967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.009020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.009105:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633706112 00000100:00100000:0.0:1787119526.009115:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633706112 00000100:00100000:0.0:1787119526.009199:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5570 00000100:00100000:0.0:1787119526.009210:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633706112:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.009227:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.009246:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bf4 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.009280:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 262) 00010000:00010000:0.0:1787119526.009289:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.009296:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 262) 00010000:00010000:0.0:1787119526.009302:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 42 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.009345:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.009360:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 42 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.009372:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119526.009421:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633706112:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 213us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.009428:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5570 00000100:00100000:1.0:1787119526.009960:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633706240 00000100:00100000:1.0:1787119526.009967:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633706240 00010000:00010000:1.0:1787119526.009992:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.010028:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5613 00000100:00100000:1.0:1787119526.010035:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633706240:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119526.010046:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119526.010072:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.010099:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.010121:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e454d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716be6 expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.010152:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 262) 00010000:00010000:1.0:1787119526.010156:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 262) 00010000:00010000:1.0:1787119526.010164:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.010173:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.010202:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 49 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.010218:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 49 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.010231:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653682432:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.010292:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00080000:3.0:1787119526.010478:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119526.012577:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653682432:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119526.012604:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119526.012662:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633706240:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2626us (3640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.012672:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5613 00000100:00100000:3.0:1787119526.015589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.015705:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633706368 00000100:00100000:0.0:1787119526.015715:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633706368 00002000:00100000:0.0:1787119526.015784:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508fff800 x1873929633706368/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.015796:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff800 with x1873929633706368 ext(335872->339967) 00010000:00010000:0.0:1787119526.015816:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.015847:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.015856:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508fff800 00000100:00100000:0.0:1787119526.015895:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1386 00000100:00100000:0.0:1787119526.015905:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633706368:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.017984:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633706368:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2063us (2387us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.017999:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1386 00002000:00100000:0.0:1787119526.018018:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508fff800 x1873929633706368/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.018029:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff800 with x1873929633706368 ext(335872->339967) 00010000:00010000:0.0:1787119526.018040:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.018070:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 50 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.018077:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508fff800 00000100:00080000:3.0:1787119526.018456:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119526.023252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.025013:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633706496 00000100:00100000:2.0:1787119526.025026:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633706496 00000100:00100000:2.0:1787119526.025100:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5571 00000100:00100000:2.0:1787119526.025109:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633706496:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.025134:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.025154:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716bfb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.025194:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 262) 00010000:00010000:2.0:1787119526.025204:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.025211:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 262) 00010000:00010000:2.0:1787119526.025216:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.025261:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.025276:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.025288:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894400, rc 0) 00000100:00100000:2.0:1787119526.025369:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633706496:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 261us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.025376:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5571 00000100:00100000:1.0:1787119526.028473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.028558:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633706624 00000100:00100000:3.0:1787119526.028569:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633706624 00010000:00010000:3.0:1787119526.028610:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 51 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.028643:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5614 00000100:00100000:3.0:1787119526.028652:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2373:x1873929633706624:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.028666:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.028689:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 51 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.028713:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 51 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.028738:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4554 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bed expref: 51 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.028753:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 262) 00010000:00010000:3.0:1787119526.028758:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 262) 00010000:00010000:3.0:1787119526.028766:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.028776:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.028823:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 40 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.028839:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 40 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.028853:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653682688:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.028950:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.033528:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653682688:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.033557:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119526.033613:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2373:x1873929633706624:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4961us (5184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.033623:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5614 00000100:00100000:1.0:1787119526.036856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.036955:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633706752 00000100:00100000:0.0:1787119526.036965:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633706752 00010000:00010000:0.0:1787119526.037019:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 41 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.037072:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5615 00000100:00100000:0.0:1787119526.037082:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633706752:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.037096:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.037121:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 41 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.037159:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 41 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.037185:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e455b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bf4 expref: 41 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.037202:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 262) 00010000:00010000:0.0:1787119526.037208:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 262) 00010000:00010000:0.0:1787119526.037217:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.037228:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.037263:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.037277:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653682816:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.037534:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.040928:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653682816:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.040968:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.041122:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2373:x1873929633706752:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4040us (4274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.041144:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5615 00000100:00100000:2.0:1787119526.053650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.053757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.053885:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633707008 00000100:00100000:1.0:1787119526.053896:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633707008 00002000:00100000:1.0:1787119526.053962:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a6181adc00 x1873929633707008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.053973:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adc00 with x1873929633707008 ext(335872->339967) 00002000:00010000:1.0:1787119526.053979:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181adc00 00000100:00100000:1.0:1787119526.054017:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10710 00000100:00100000:1.0:1787119526.054026:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633707008:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.054232:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633707008:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 206us (473us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119526.054239:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10710 00002000:00100000:1.0:1787119526.054246:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a6181adc00 x1873929633707008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.054255:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adc00 with x1873929633707008 ext(335872->339967) 00002000:00010000:1.0:1787119526.054258:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181adc00 00000100:00100000:3.0:1787119526.055902:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633706880 00000100:00100000:3.0:1787119526.055915:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633706880 00000100:00100000:3.0:1787119526.055992:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5572 00000100:00100000:3.0:1787119526.056002:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633706880:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119526.056018:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.056038:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c02 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.056070:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.056081:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 262) 00010000:00010000:3.0:1787119526.056085:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 262) 00010000:00010000:3.0:1787119526.056091:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.056491:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 49 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.056518:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 49 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.056532:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653682944:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119526.056623:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.062567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.062608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.062693:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653682944:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119526.062729:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.062754:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:3.0:1787119526.062812:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633706880:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6811us (9169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.062821:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5572 00000100:00100000:0.0:1787119526.063055:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633707136 00000100:00100000:0.0:1787119526.063064:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633707136 00002000:00100000:0.0:1787119526.063105:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a508ffdf80 x1873929633707136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.063115:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdf80 with x1873929633707136 ext(339968->344063) 00010000:00010000:0.0:1787119526.063123:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 50 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.063149:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 50 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.063157:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffdf80 00000100:00100000:0.0:1787119526.063185:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633707264 00000100:00100000:0.0:1787119526.063189:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633707264 00002000:00100000:0.0:1787119526.063203:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508fffb80 x1873929633707264/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 4584/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.063211:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fffb80 with x1873929633707264 ext(335872->339967) 00010000:00010000:0.0:1787119526.063216:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 51 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.063234:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 51 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.063240:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508fffb80 00000100:00100000:0.0:1787119526.063262:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1387 00000100:00100000:0.0:1787119526.063271:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2374:x1873929633707136:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.063433:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2374:x1873929633707136:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 163us (875us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.063465:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1387 00002000:00100000:0.0:1787119526.063471:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a508ffdf80 x1873929633707136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.063479:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffdf80 with x1873929633707136 ext(339968->344063) 00010000:00010000:0.0:1787119526.063484:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 51 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.063498:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 51 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.063505:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffdf80 00000100:00100000:0.0:1787119526.063518:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1388 00000100:00100000:0.0:1787119526.063526:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633707264:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119526.063797:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633707264:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 270us (1186us total) trans 4294969265 rc 0/0 00000100:00100000:0.0:1787119526.063804:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1388 00002000:00100000:0.0:1787119526.063810:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a508fffb80 x1873929633707264/t4294969265(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 4584/448 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.063819:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fffb80 with x1873929633707264 ext(335872->339967) 00010000:00010000:0.0:1787119526.063824:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.063838:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.063845:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508fffb80 00000100:00100000:2.0:1787119526.069917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.069974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.070061:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633707520 00000100:00100000:3.0:1787119526.070071:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633707520 00000100:00100000:3.0:1787119526.070132:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5573 00000100:00100000:3.0:1787119526.070142:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633707520:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119526.070160:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.070178:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c09 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.070253:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 262) 00010000:00010000:3.0:1787119526.070260:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 262) 00010000:00010000:3.0:1787119526.070266:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 53 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.070280:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 53 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.070295:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:3.0:1787119526.070349:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+53:33957:x1873929633707520:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 210us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.070354:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5573 00000100:00100000:1.0:1787119526.070414:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633707392 00000100:00100000:1.0:1787119526.070417:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633707392 00010000:00010000:1.0:1787119526.070433:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 53 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.070481:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5616 00000100:00100000:1.0:1787119526.070486:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2376:x1873929633707392:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119526.070494:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787119526.070508:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119523 -> 1787119524 00002000:00010000:1.0:1787119526.070511:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119523 -> 1787119524 00010000:00010000:1.0:1787119526.070515:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 53 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.070537:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 53 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.070558:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4562 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [335872->33890303] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716bfb expref: 53 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.070574:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 262) 00010000:00010000:1.0:1787119526.070579:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 262) 00010000:00010000:1.0:1787119526.070587:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.070597:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.070608:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 262) 00010000:00010000:1.0:1787119526.070610:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 262) 00010000:00010000:1.0:1787119526.070613:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 52 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.070619:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 52 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.070645:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 52 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.070656:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653683072:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.070716:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.070723:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653683200:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.070740:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.074002:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653683072:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.074019:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653683200:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.074043:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119526.074103:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633707392:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3614us (4195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.074114:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5616 00000100:00100000:2.0:1787119526.075837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.076247:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633707648 00000100:00100000:3.0:1787119526.076258:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633707648 00002000:00100000:3.0:1787119526.076309:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a6181adf80 x1873929633707648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.076327:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adf80 with x1873929633707648 ext(335872->339967) 00002000:00010000:3.0:1787119526.076332:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181adf80 00000100:00100000:3.0:1787119526.076368:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10711 00000100:00100000:3.0:1787119526.076377:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633707648:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.076891:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633707648:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 513us (1066us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119526.076900:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10711 00002000:00100000:2.0:1787119526.076908:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a6181adf80 x1873929633707648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.076917:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181adf80 with x1873929633707648 ext(335872->339967) 00002000:00010000:2.0:1787119526.076921:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6181adf80 00000100:00100000:2.0:1787119526.081054:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.081173:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633707776 00000100:00100000:3.0:1787119526.081183:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633707776 00000100:00100000:3.0:1787119526.081433:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5574 00000100:00100000:0.0:1787119526.082234:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633707776:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.082256:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.082278:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c10 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.082317:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.082328:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 262) 00010000:00010000:0.0:1787119526.082332:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 262) 00010000:00010000:0.0:1787119526.082337:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.082501:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.082532:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 51 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.082549:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653683328:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119526.082865:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.085834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.086073:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633707904 00000100:00100000:0.0:1787119526.086083:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633707904 00002000:00100000:0.0:1787119526.086136:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a508ffd500 x1873929633707904/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.086148:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd500 with x1873929633707904 ext(339968->344063) 00010000:00010000:0.0:1787119526.086157:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.086187:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.086195:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffd500 00000100:00100000:0.0:1787119526.086278:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1389 00000100:00100000:0.0:1787119526.086289:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2373:x1873929633707904:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.086486:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653683328:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119526.086513:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 42 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.086525:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2373:x1873929633707904:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 238us (698us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.086533:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1389 00002000:00100000:0.0:1787119526.086540:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a508ffd500 x1873929633707904/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.086549:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd500 with x1873929633707904 ext(339968->344063) 00010000:00010000:0.0:1787119526.086555:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.086568:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.086575:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffd500 00010000:00010000:2.0:1787119526.086755:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:2.0:1787119526.086789:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633707776:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5178us (5745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.086797:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5574 00000100:00100000:3.0:1787119526.089683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.089745:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633708032 00000100:00100000:2.0:1787119526.089754:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633708032 00000100:00100000:2.0:1787119526.089871:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5575 00000100:00100000:2.0:1787119526.089883:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633708032:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.089901:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.089920:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c17 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.089966:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 262) 00010000:00010000:2.0:1787119526.089975:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.089981:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119526.089983:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 262) 00010000:00010000:2.0:1787119526.089987:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.090028:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.090044:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.090058:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895200, rc 0) 00000100:00100000:2.0:1787119526.090341:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+53:33957:x1873929633708032:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 460us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.090348:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5575 00000100:00100000:0.0:1787119526.090897:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633708160 00000100:00100000:0.0:1787119526.090905:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633708160 00010000:00010000:0.0:1787119526.090934:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.091120:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5617 00000100:00100000:0.0:1787119526.091129:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620781c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2373:x1873929633708160:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.091143:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.091167:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.091206:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.091281:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e4570 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c09 expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.091296:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 262) 00010000:00010000:0.0:1787119526.091301:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 262) 00010000:00010000:0.0:1787119526.091309:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.091323:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.091357:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.091371:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 41 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.091434:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653683584:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.091902:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.097360:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653683584:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.097510:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.097603:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620781c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2373:x1873929633708160:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6473us (7619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.097615:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5617 00000100:00100000:1.0:1787119526.099238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.099333:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633708288 00000100:00100000:2.0:1787119526.099340:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633708288 00002000:00100000:2.0:1787119526.099378:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a511f56680 x1873929633708288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.099436:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56680 with x1873929633708288 ext(339968->376831) 00010000:00010000:2.0:1787119526.099471:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.099498:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.099505:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f56680 00000100:00100000:2.0:1787119526.099532:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1390 00000100:00100000:2.0:1787119526.099542:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633708288:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.103519:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633708288:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3966us (4272us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119526.103534:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1390 00002000:00100000:2.0:1787119526.103548:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a511f56680 x1873929633708288/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.103560:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56680 with x1873929633708288 ext(339968->376831) 00010000:00010000:2.0:1787119526.103571:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.103602:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.103616:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f56680 00000100:00100000:2.0:1787119526.106332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.106368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.106484:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633708544 00000100:00100000:0.0:1787119526.106484:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633708416 00000100:00100000:3.0:1787119526.106494:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633708544 00000100:00100000:0.0:1787119526.106494:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633708416 00000100:00100000:3.0:1787119526.106541:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5576 00000100:00100000:3.0:1787119526.106550:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633708544:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119526.106565:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.106583:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c1e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.106600:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 43 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.106613:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 262) 00010000:00010000:3.0:1787119526.106621:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.106628:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 262) 00010000:00010000:3.0:1787119526.106633:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 44 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.106633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5618 00000100:00100000:0.0:1787119526.106640:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:2373:x1873929633708416:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.106649:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.106669:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 44 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.106682:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.106692:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 44 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.106762:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 44 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.106762:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4577 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c10 expref: 44 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.106775:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 262) 00010000:00010000:3.0:1787119526.106778:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 262) 00010000:00010000:3.0:1787119526.106786:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.106795:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.106811:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119526.106819:0:6696:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.106833:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 51 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.106847:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653683840:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.106877:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2373:x1873929633708416:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 236us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.106884:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5618 00000100:00100000:3.0:1787119526.106896:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.110635:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653683840:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.110674:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84400, rc 0) 00000100:00100000:3.0:1787119526.110734:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633708544:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4183us (4362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.110743:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5576 00000100:00100000:1.0:1787119526.111032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.111371:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633708672 00000100:00100000:3.0:1787119526.111378:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633708672 00010000:00010000:3.0:1787119526.111408:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.111494:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5619 00000100:00100000:3.0:1787119526.111502:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2375:x1873929633708672:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.111515:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.111537:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.111563:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.111587:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e457e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c17 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.111604:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 262) 00010000:00010000:3.0:1787119526.111608:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 262) 00010000:00010000:3.0:1787119526.111614:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.111620:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.111648:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.111713:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653683968:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.111847:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.124481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.124522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.124636:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633708928 00000100:00100000:0.0:1787119526.124647:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633708928 00000100:00100000:0.0:1787119526.124713:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5577 00000100:00100000:0.0:1787119526.124723:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633708928:12345-192.168.201.59@tcp:101:mmap_sanity.0 00000100:00100000:3.0:1787119526.125025:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653683968:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.125157:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.125159:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119526.125181:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c25 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.125213:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.125225:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 262) 00010000:00010000:0.0:1787119526.125230:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 262) 00010000:00010000:0.0:1787119526.125236:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 53 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.125338:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.125341:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633708800 00000100:00100000:2.0:1787119526.125345:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633708800 00010000:00010000:0.0:1787119526.125365:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787119526.125376:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a511f54000 x1873929633708800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787119526.125378:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653684096:192.168.201.59@tcp:104: 00002000:00100000:2.0:1787119526.125396:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633708800 ext(339968->376831) 00010000:00010000:2.0:1787119526.125403:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.125417:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.125436:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2375:x1873929633708672:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13933us (14404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.125467:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5619 00002000:00010000:2.0:1787119526.125540:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f54000 00000100:00100000:2.0:1787119526.125568:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1391 00000100:00100000:2.0:1787119526.125576:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633708800:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.129348:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.135478:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653684096:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119526.135516:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 52 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.135538:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:3.0:1787119526.135589:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633708928:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10867us (11065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.135598:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5577 00000100:00100000:2.0:1787119526.136901:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633708800:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 11318us (12464us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119526.136915:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1391 00002000:00100000:2.0:1787119526.136927:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a511f54000 x1873929633708800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.136949:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54000 with x1873929633708800 ext(339968->376831) 00010000:00010000:2.0:1787119526.136960:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.136987:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.137140:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f54000 00000100:00100000:3.0:1787119526.155962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.156096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.156433:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633709184 00000100:00100000:2.0:1787119526.156484:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633709184 00000100:00100000:2.0:1787119526.156537:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5578 00000100:00100000:2.0:1787119526.156548:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633709184:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.156568:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.156589:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c2c expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.156624:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 262) 00010000:00010000:2.0:1787119526.156633:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.156640:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 262) 00010000:00010000:2.0:1787119526.156644:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 43 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.156710:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.156728:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 43 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.156742:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894400, rc 0) 00000100:00100000:2.0:1787119526.156800:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633709184:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 254us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.156809:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5578 00000100:00100000:0.0:1787119526.164217:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633709056 00000100:00100000:0.0:1787119526.164233:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633709056 00010000:00010000:0.0:1787119526.164301:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 43 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.164350:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5620 00000100:00100000:0.0:1787119526.164361:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2374:x1873929633709056:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.164392:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.164416:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 43 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.164460:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 43 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.164488:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4585 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c1e expref: 43 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.164505:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 262) 00010000:00010000:0.0:1787119526.164511:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 262) 00010000:00010000:0.0:1787119526.164520:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.164773:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.164821:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.164836:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 51 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.164851:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653684352:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.164949:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.176497:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653684352:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.176523:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.176589:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2374:x1873929633709056:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12229us (20647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.176599:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5620 00000100:00100000:1.0:1787119526.182416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.182546:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633709312 00000100:00100000:2.0:1787119526.182556:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633709312 00002000:00100000:2.0:1787119526.182606:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a511f55880 x1873929633709312/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.182617:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55880 with x1873929633709312 ext(339968->344063) 00010000:00010000:2.0:1787119526.182628:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.182658:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.182667:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f55880 00000100:00100000:2.0:1787119526.182701:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1392 00000100:00100000:2.0:1787119526.182712:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2375:x1873929633709312:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.183146:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2375:x1873929633709312:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 435us (739us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119526.183154:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1392 00002000:00100000:2.0:1787119526.183162:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a511f55880 x1873929633709312/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.183178:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55880 with x1873929633709312 ext(339968->344063) 00010000:00010000:2.0:1787119526.183183:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.183198:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.183206:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f55880 00000100:00100000:3.0:1787119526.207122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.207432:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633709440 00000100:00100000:2.0:1787119526.207488:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633709440 00000100:00100000:2.0:1787119526.207555:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5579 00000100:00100000:2.0:1787119526.207565:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633709440:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.207583:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.207603:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c33 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.207637:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 262) 00010000:00010000:2.0:1787119526.207646:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.207654:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 262) 00010000:00010000:2.0:1787119526.207659:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.207702:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.207718:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.207732:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895c00, rc 0) 00000100:00100000:2.0:1787119526.208342:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+53:33957:x1873929633709440:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 774us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.208352:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5579 00000100:00100000:3.0:1787119526.208987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.210236:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633709568 00000100:00100000:0.0:1787119526.210249:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633709568 00010000:00010000:0.0:1787119526.210295:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 53 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.210341:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5621 00000100:00100000:0.0:1787119526.210351:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2374:x1873929633709568:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.210365:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.210388:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 53 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.210416:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 53 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.210475:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e458c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c25 expref: 53 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.210495:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 262) 00010000:00010000:0.0:1787119526.210501:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 262) 00010000:00010000:0.0:1787119526.210509:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.210520:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.210559:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.210575:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 41 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.210589:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653684608:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.210669:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.221136:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653684608:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.221168:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119526.223972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.224151:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633709696 00000100:00100000:0.0:1787119526.224161:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633709696 00010000:00010000:0.0:1787119526.224206:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.224256:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5622 00000100:00100000:0.0:1787119526.224266:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633709696:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.224281:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.224305:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.224337:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.224362:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c2c expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.224384:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 262) 00010000:00010000:0.0:1787119526.224389:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 262) 00010000:00010000:0.0:1787119526.224396:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.224406:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.224483:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.224500:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653684736:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.224581:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.228107:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653684736:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.228145:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.228204:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633709696:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3938us (4242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.228214:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5622 00000100:00100000:1.0:1787119526.233268:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2374:x1873929633709568:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 22905us (24401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.233282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5621 00000100:00100000:2.0:1787119526.233626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.233809:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633709824 00000100:00100000:0.0:1787119526.233818:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633709824 00000100:00100000:0.0:1787119526.233876:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5580 00000100:00100000:0.0:1787119526.233885:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633709824:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.233903:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.233924:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c3a expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.233969:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.233981:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 262) 00010000:00010000:0.0:1787119526.233986:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 262) 00010000:00010000:0.0:1787119526.233991:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.234025:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.234053:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 51 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.234068:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653684864:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119526.234154:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.241407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.241533:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633709952 00000100:00100000:3.0:1787119526.241542:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633709952 00002000:00100000:3.0:1787119526.241594:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a62a121c00 x1873929633709952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.241605:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121c00 with x1873929633709952 ext(339968->344063) 00010000:00010000:3.0:1787119526.241615:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.241644:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.241659:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a121c00 00000100:00100000:3.0:1787119526.241694:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1393 00000100:00100000:3.0:1787119526.241704:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633709952:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119526.241913:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633709952:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 210us (515us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119526.241921:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1393 00002000:00100000:3.0:1787119526.241929:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a62a121c00 x1873929633709952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.241950:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121c00 with x1873929633709952 ext(339968->344063) 00010000:00010000:3.0:1787119526.241956:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.241970:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.241988:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a121c00 00000100:00100000:0.0:1787119526.242352:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653684864:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119526.242381:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.242401:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119526.242458:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633709824:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8553us (8812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.242466:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5580 00000100:00100000:2.0:1787119526.246905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.247007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.247119:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633710208 00000100:00100000:0.0:1787119526.247137:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633710208 00010000:00010000:0.0:1787119526.247175:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.247214:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5623 00000100:00100000:0.0:1787119526.247223:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633710208:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.247240:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.247264:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.247292:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.247321:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e459a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c33 expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.247339:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 262) 00010000:00010000:0.0:1787119526.247344:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 262) 00010000:00010000:0.0:1787119526.247352:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.247365:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.247402:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.247416:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653684992:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.247579:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.247867:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633710080 00000100:00100000:3.0:1787119526.247872:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633710080 00000100:00100000:3.0:1787119526.247915:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5581 00000100:00100000:3.0:1787119526.247922:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633710080:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119526.247947:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.247960:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c41 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.247985:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.247992:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 262) 00010000:00010000:3.0:1787119526.247996:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 262) 00010000:00010000:3.0:1787119526.248000:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 53 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.248021:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.248036:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 41 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.248046:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653685120:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119526.248092:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.253588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.253754:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653684992:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.253778:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.253838:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2376:x1873929633710208:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6615us (6829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.253858:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5623 00000100:00100000:1.0:1787119526.254121:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653685120:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119526.254158:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 52 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.254181:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:1.0:1787119526.254209:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633710080:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6288us (7316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.254217:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5581 00000100:00100000:3.0:1787119526.254284:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633710336 00000100:00100000:3.0:1787119526.254292:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633710336 00002000:00100000:3.0:1787119526.254331:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a62a123100 x1873929633710336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.254341:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123100 with x1873929633710336 ext(339968->376831) 00010000:00010000:3.0:1787119526.254348:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.254380:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.254389:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a123100 00000100:00100000:3.0:1787119526.254420:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1394 00000100:00100000:3.0:1787119526.254431:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633710336:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119526.261898:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633710336:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7456us (8309us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119526.261913:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1394 00002000:00100000:3.0:1787119526.261927:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a62a123100 x1873929633710336/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.261952:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123100 with x1873929633710336 ext(339968->376831) 00010000:00010000:3.0:1787119526.261964:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.261998:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.262006:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a123100 00000100:00100000:2.0:1787119526.265049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.265240:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633710464 00000100:00100000:1.0:1787119526.265251:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633710464 00000100:00100000:1.0:1787119526.265312:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5582 00000100:00100000:1.0:1787119526.265322:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633710464:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119526.265349:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119526.265371:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c48 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.265405:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 262) 00010000:00010000:1.0:1787119526.265415:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.265423:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 262) 00010000:00010000:1.0:1787119526.265428:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 43 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.265515:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.265534:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 43 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.265547:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:1.0:1787119526.265606:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633710464:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 284us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.265614:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5582 00000100:00100000:2.0:1787119526.269219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.269352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633710592 00000100:00100000:3.0:1787119526.269363:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633710592 00010000:00010000:3.0:1787119526.269404:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 43 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.269491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5624 00000100:00100000:3.0:1787119526.269503:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2376:x1873929633710592:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.269519:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.269545:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 43 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.269571:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 43 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.269597:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c3a expref: 43 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.269617:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 262) 00010000:00010000:3.0:1787119526.269623:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 262) 00010000:00010000:3.0:1787119526.269632:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.269642:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.269685:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.269701:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 51 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.269716:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653685376:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.269812:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a618558240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.274182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.274322:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653685376:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.274344:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119526.274395:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633710592:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4895us (5186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.274406:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5624 00000100:00100000:3.0:1787119526.274498:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633710720 00000100:00100000:3.0:1787119526.274505:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633710720 00010000:00010000:3.0:1787119526.274533:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.274565:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5625 00000100:00100000:3.0:1787119526.274574:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633710720:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.274586:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.274608:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.274633:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.274659:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c41 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.274681:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 262) 00010000:00010000:3.0:1787119526.274686:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 262) 00010000:00010000:3.0:1787119526.274694:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.274704:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.274736:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.274748:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653685504:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.274808:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.278329:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653685504:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.278356:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119526.278412:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2376:x1873929633710720:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3839us (4240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.278424:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5625 00000100:00100000:2.0:1787119526.285755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.285876:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633710848 00000100:00100000:1.0:1787119526.285887:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633710848 00000100:00100000:1.0:1787119526.285962:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5583 00000100:00100000:1.0:1787119526.285973:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633710848:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119526.285992:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119526.286014:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c4f expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.286059:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.286075:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 262) 00010000:00010000:1.0:1787119526.286081:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 262) 00010000:00010000:1.0:1787119526.286086:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 52 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.286140:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.286167:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 41 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.286182:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653685632:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119526.286267:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610466180 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.289102:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653685632:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119526.289156:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 52 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.289180:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:1.0:1787119526.289246:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633710848:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3275us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.289255:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5583 00000100:00100000:3.0:1787119526.299833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.300429:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633710976 00000100:00100000:1.0:1787119526.300495:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633710976 00002000:00100000:1.0:1787119526.300549:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a508ffc700 x1873929633710976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.300561:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc700 with x1873929633710976 ext(339968->376831) 00010000:00010000:1.0:1787119526.300571:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 42 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.300602:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 42 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.300610:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffc700 00000100:00100000:1.0:1787119526.300645:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1395 00000100:00100000:1.0:1787119526.300655:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2374:x1873929633710976:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.308545:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2374:x1873929633710976:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7880us (8711us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119526.308559:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1395 00002000:00100000:1.0:1787119526.308573:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a508ffc700 x1873929633710976/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.308584:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc700 with x1873929633710976 ext(339968->376831) 00010000:00010000:1.0:1787119526.308595:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 42 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.308626:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 42 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.308635:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffc700 00000100:00100000:2.0:1787119526.311784:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.312012:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633711104 00000100:00100000:0.0:1787119526.312023:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633711104 00000100:00100000:0.0:1787119526.312079:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5584 00000100:00100000:0.0:1787119526.312089:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633711104:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.312107:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.312137:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c56 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.312173:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 262) 00010000:00010000:0.0:1787119526.312182:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.312190:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 262) 00010000:00010000:0.0:1787119526.312196:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.312235:0:6696:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.312249:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.312262:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119526.312322:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633711104:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 235us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.312331:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5584 00000100:00100000:0.0:1787119526.315207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.315342:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633711232 00000100:00100000:3.0:1787119526.315353:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633711232 00010000:00010000:3.0:1787119526.315396:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 43 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.315467:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5626 00000100:00100000:3.0:1787119526.315479:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2375:x1873929633711232:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.315493:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.315517:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 43 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.315546:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 43 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.315571:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e45af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c48 expref: 43 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.315589:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 262) 00010000:00010000:3.0:1787119526.315594:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 262) 00010000:00010000:3.0:1787119526.315604:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.315615:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.315655:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.315672:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 51 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.315687:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653685888:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.315776:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.319724:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653685888:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.319752:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.319819:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633711232:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4341us (4621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.319830:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5626 00000100:00100000:2.0:1787119526.321789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.321880:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633711360 00000100:00100000:0.0:1787119526.321890:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633711360 00002000:00100000:0.0:1787119526.321949:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a62a121f80 x1873929633711360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.321972:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121f80 with x1873929633711360 ext(339968->344063) 00010000:00010000:0.0:1787119526.321983:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.322015:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.322024:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a121f80 00000100:00100000:0.0:1787119526.322059:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1396 00000100:00100000:0.0:1787119526.322068:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633711360:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.322621:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633711360:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 552us (840us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.322627:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1396 00002000:00100000:0.0:1787119526.322633:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a62a121f80 x1873929633711360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.322639:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a121f80 with x1873929633711360 ext(339968->344063) 00010000:00010000:0.0:1787119526.322643:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.322658:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.322666:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a121f80 00000100:00100000:1.0:1787119526.324811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.325137:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633711488 00000100:00100000:3.0:1787119526.325146:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633711488 00000100:00100000:3.0:1787119526.325199:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5585 00000100:00100000:3.0:1787119526.325207:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633711488:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119526.325223:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.325245:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c5d expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.325276:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 262) 00010000:00010000:3.0:1787119526.325286:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.325293:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 262) 00010000:00010000:3.0:1787119526.325299:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 53 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.325348:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.325362:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 53 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.325380:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:3.0:1787119526.325473:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+53:33957:x1873929633711488:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 230us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.325481:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5585 00000100:00100000:2.0:1787119526.327097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.327163:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633711616 00000100:00100000:1.0:1787119526.327171:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633711616 00010000:00010000:1.0:1787119526.327201:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.327231:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5627 00000100:00100000:1.0:1787119526.327237:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2376:x1873929633711616:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119526.327250:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119526.327273:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.327298:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.327320:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e45b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c4f expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.327332:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 262) 00010000:00010000:1.0:1787119526.327336:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 262) 00010000:00010000:1.0:1787119526.327342:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.327349:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.327376:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.327390:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 41 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.327404:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653686144:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.327535:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079729c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.329531:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653686144:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.329558:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119526.329651:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633711616:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2411us (2559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.329663:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5627 00000100:00100000:2.0:1787119526.330687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.330776:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633711744 00000100:00100000:3.0:1787119526.330785:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633711744 00010000:00010000:3.0:1787119526.330919:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.331006:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5628 00000100:00100000:3.0:1787119526.331016:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2374:x1873929633711744:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.331031:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.331054:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.331082:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.331110:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e45bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c56 expref: 42 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.331142:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 262) 00010000:00010000:3.0:1787119526.331146:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 262) 00010000:00010000:3.0:1787119526.331155:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.331167:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.331205:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.331220:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653686272:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.331301:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.335272:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653686272:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.335302:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119526.335362:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633711744:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4347us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.335374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5628 00000100:00100000:2.0:1787119526.342637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.342740:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633711872 00000100:00100000:3.0:1787119526.342751:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633711872 00000100:00100000:3.0:1787119526.342921:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5586 00000100:00100000:3.0:1787119526.342943:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633711872:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119526.342968:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.342989:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c64 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.343022:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.343034:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 262) 00010000:00010000:3.0:1787119526.343037:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 262) 00010000:00010000:3.0:1787119526.343041:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 42 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.343069:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.343090:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 51 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.343101:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653686400:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119526.343224:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.346005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.346951:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653686400:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119526.346985:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 42 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.347004:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:0.0:1787119526.347062:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633711872:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4130us (4432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.347071:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5586 00000100:00100000:0.0:1787119526.347112:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633712000 00000100:00100000:0.0:1787119526.347397:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633712000 00010000:00010000:0.0:1787119526.347427:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.347517:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5629 00000100:00100000:0.0:1787119526.347529:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633712000:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.347544:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.347569:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.347594:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.347618:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e45c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c5d expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.347631:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 262) 00010000:00010000:0.0:1787119526.347636:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 262) 00010000:00010000:0.0:1787119526.347642:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.347651:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.347686:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.347700:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653686528:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.347772:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.353167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.353270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.353366:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633712256 00000100:00100000:2.0:1787119526.353377:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633712256 00002000:00100000:2.0:1787119526.353429:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a511f54380 x1873929633712256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.353467:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54380 with x1873929633712256 ext(339968->376831) 00002000:00010000:2.0:1787119526.353474:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f54380 00000100:00100000:2.0:1787119526.353516:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10712 00000100:00100000:2.0:1787119526.353526:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633712256:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.353888:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653686528:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.353910:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.353960:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2376:x1873929633712000:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6433us (7963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.353970:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5629 00000100:00100000:3.0:1787119526.354399:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633712128 00000100:00100000:3.0:1787119526.354404:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633712128 00000100:00100000:3.0:1787119526.354434:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5587 00000100:00100000:3.0:1787119526.354453:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633712128:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119526.354464:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.354478:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c6b expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.354501:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.354512:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 262) 00010000:00010000:3.0:1787119526.354515:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 262) 00010000:00010000:3.0:1787119526.354519:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 52 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.354548:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.354573:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 43 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.354588:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653686656:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119526.354632:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.359373:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653686656:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119526.359417:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 52 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.359462:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:3.0:1787119526.359538:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633712128:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5089us (6375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.359548:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5587 00000100:00100000:2.0:1787119526.360898:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633712256:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7367us (7621us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119526.360910:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10712 00002000:00100000:2.0:1787119526.360920:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a511f54380 x1873929633712256/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.360930:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f54380 with x1873929633712256 ext(339968->376831) 00010000:00010000:2.0:1787119526.360951:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 42 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.360979:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 42 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.360987:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f54380 00000100:00100000:1.0:1787119526.364928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.365123:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633712512 00000100:00100000:2.0:1787119526.365144:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633712512 00000100:00100000:2.0:1787119526.365213:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5588 00000100:00100000:2.0:1787119526.365225:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633712512:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.365245:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.365267:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c72 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.365307:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 262) 00010000:00010000:2.0:1787119526.365317:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.365325:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 262) 00010000:00010000:2.0:1787119526.365330:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 43 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.365374:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.365388:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 43 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.365400:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894800, rc 0) 00000100:00100000:2.0:1787119526.365737:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633712512:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 513us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.365745:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5588 00000100:00100000:1.0:1787119526.366139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.367643:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633712384 00000100:00100000:3.0:1787119526.367669:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633712384 00010000:00010000:2.0:1787119526.368094:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 43 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.368249:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5630 00000100:00100000:2.0:1787119526.368259:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2376:x1873929633712384:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119526.368275:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119526.368297:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 43 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.368339:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 43 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.368368:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e45cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c64 expref: 43 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.368386:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 262) 00010000:00010000:2.0:1787119526.368390:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 262) 00010000:00010000:2.0:1787119526.368400:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.368409:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.368487:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.368503:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 51 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.368516:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653686912:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119526.368604:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6139c4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.372181:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653686912:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119526.372209:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119526.372270:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633712384:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4012us (6131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.372282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5630 00000100:00100000:1.0:1787119526.375696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.375809:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633712640 00000100:00100000:0.0:1787119526.375821:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633712640 00002000:00100000:0.0:1787119526.375882:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a511f55180 x1873929633712640/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.375894:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55180 with x1873929633712640 ext(339968->344063) 00010000:00010000:0.0:1787119526.375904:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.375949:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.375958:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f55180 00000100:00100000:0.0:1787119526.375991:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1397 00000100:00100000:0.0:1787119526.376002:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633712640:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.376221:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633712640:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 221us (536us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.376229:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1397 00002000:00100000:0.0:1787119526.376236:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a511f55180 x1873929633712640/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.376245:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f55180 with x1873929633712640 ext(339968->344063) 00010000:00010000:0.0:1787119526.376250:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.376263:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 52 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.376270:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f55180 00000100:00100000:1.0:1787119526.379636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.379795:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633712768 00000100:00100000:2.0:1787119526.379811:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633712768 00000100:00100000:2.0:1787119526.379878:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5589 00000100:00100000:2.0:1787119526.379888:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633712768:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.379907:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.379929:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c79 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.379973:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 262) 00010000:00010000:2.0:1787119526.379983:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.379990:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 262) 00010000:00010000:2.0:1787119526.379996:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 53 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.380037:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.380050:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 53 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.380063:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895600, rc 0) 00000100:00100000:2.0:1787119526.380123:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+53:33957:x1873929633712768:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 236us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.380137:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5589 00000100:00100000:1.0:1787119526.382597:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.382676:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633712896 00000100:00100000:3.0:1787119526.382685:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633712896 00010000:00010000:3.0:1787119526.382720:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.382760:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5631 00000100:00100000:3.0:1787119526.382768:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2375:x1873929633712896:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.382782:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.382812:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.382839:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.382870:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e45d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c6b expref: 53 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.382887:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 262) 00010000:00010000:3.0:1787119526.382892:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 262) 00010000:00010000:3.0:1787119526.382901:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.382911:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.382958:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.382979:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 41 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.382994:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653687168:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.383071:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.386322:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653687168:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119526.386352:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119526.386412:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2375:x1873929633712896:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3642us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.386423:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5631 00000100:00100000:1.0:1787119526.391104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.391201:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633713024 00000100:00100000:0.0:1787119526.391211:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633713024 00010000:00010000:0.0:1787119526.391251:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.391297:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5632 00000100:00100000:0.0:1787119526.391307:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633713024:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.391324:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.391346:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.391371:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.391396:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e45d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c72 expref: 42 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.391418:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 262) 00010000:00010000:0.0:1787119526.391423:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 262) 00010000:00010000:0.0:1787119526.391431:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 51 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.391498:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 51 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.391537:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 51 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.391553:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653687296:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.391627:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.396405:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653687296:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.396490:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.396560:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633713024:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5252us (5465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.396571:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5632 00000100:00100000:1.0:1787119526.402083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.402268:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633713152 00000100:00100000:0.0:1787119526.402279:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633713152 00000100:00100000:0.0:1787119526.402398:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5590 00000100:00100000:0.0:1787119526.402409:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633713152:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.402428:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.402490:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c80 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.402530:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 51 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.402542:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 262) 00010000:00010000:0.0:1787119526.402546:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 262) 00010000:00010000:0.0:1787119526.402552:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 42 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.402586:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 51 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.402613:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 51 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.402629:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653687424:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119526.402727:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.406228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.406344:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653687424:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119526.406383:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 42 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.406409:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:0.0:1787119526.406491:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633713152:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4083us (4418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.406500:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5590 00000100:00100000:2.0:1787119526.406587:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633713280 00000100:00100000:2.0:1787119526.406594:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633713280 00010000:00010000:2.0:1787119526.406628:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 52 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.406673:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5633 00000100:00100000:2.0:1787119526.406684:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2375:x1873929633713280:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119526.406698:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119526.406724:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 52 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.406750:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 52 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.406778:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e45e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c79 expref: 52 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.406795:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 262) 00010000:00010000:2.0:1787119526.406812:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 262) 00010000:00010000:2.0:1787119526.406822:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.406832:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.406882:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.406900:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653687552:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119526.406966:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.410827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.411239:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653687552:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119526.411270:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119526.411334:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2375:x1873929633713280:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4652us (5116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.411346:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5633 00000100:00100000:3.0:1787119526.416068:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633713408 00000100:00100000:3.0:1787119526.416089:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633713408 00000100:00100000:1.0:1787119526.416470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.416553:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633713536 00000100:00100000:3.0:1787119526.416557:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633713536 00002000:00100000:3.0:1787119526.416612:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a6068be680 x1873929633713536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.416624:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be680 with x1873929633713536 ext(339968->376831) 00002000:00010000:3.0:1787119526.416630:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068be680 00000100:00100000:3.0:1787119526.416672:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10713 00000100:00100000:3.0:1787119526.416683:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633713536:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.421673:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633713536:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4980us (5195us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119526.421688:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10713 00002000:00100000:0.0:1787119526.421700:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (339968->376831) req@ffff92a6068be680 x1873929633713536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.421712:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be680 with x1873929633713536 ext(339968->376831) 00002000:00010000:0.0:1787119526.421720:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068be680 00000100:00100000:2.0:1787119526.422225:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5591 00000100:00100000:2.0:1787119526.422238:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633713408:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.422255:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.422276:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c87 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.422311:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.422326:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 262) 00010000:00010000:2.0:1787119526.422331:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 262) 00010000:00010000:2.0:1787119526.422335:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 52 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.422368:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.422393:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 41 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.422409:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653687680:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.422501:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.428550:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653687680:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119526.428592:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 52 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.428616:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895a00, rc 0) 00000100:00100000:2.0:1787119526.428692:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633713408:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6455us (17873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.428701:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5591 00000100:00100000:1.0:1787119526.433203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.433364:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633713664 00000100:00100000:2.0:1787119526.433377:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633713664 00002000:00100000:2.0:1787119526.433479:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (249856->360447) req@ffff92a6068be300 x1873929633713664/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.433491:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be300 with x1873929633713664 ext(249856->360447) 00010000:00010000:2.0:1787119526.433515:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 42 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.433544:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 42 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.433552:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6068be300 00000100:00100000:2.0:1787119526.433583:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1398 00000100:00100000:2.0:1787119526.433594:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633713664:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119526.439606:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:2376:x1873929633713664:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 6002us (6403us total) trans 4294969266 rc 0/0 00000100:00100000:2.0:1787119526.439620:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1398 00002000:00100000:2.0:1787119526.439632:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (249856->360447) req@ffff92a6068be300 x1873929633713664/t4294969266(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/448 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.439643:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068be300 with x1873929633713664 ext(249856->360447) 00010000:00010000:2.0:1787119526.439676:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 44 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.439706:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 44 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.439715:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6068be300 00000100:00100000:2.0:1787119526.445117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.445183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.445239:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633713792 00000100:00100000:3.0:1787119526.445249:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633713792 00002000:00100000:3.0:1787119526.445298:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (360448->364543) req@ffff92a62a123480 x1873929633713792/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 4584/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.445310:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123480 with x1873929633713792 ext(360448->364543) 00010000:00010000:3.0:1787119526.445319:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 44 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.445355:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 44 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.445362:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a123480 00000100:00100000:3.0:1787119526.445388:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1399 00000100:00100000:3.0:1787119526.445398:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:2373:x1873929633713792:12345-192.168.201.59@tcp:4:kworker.0 00000100:00100000:0.0:1787119526.445904:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633713920 00000100:00100000:0.0:1787119526.445909:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633713920 00000100:00100000:0.0:1787119526.445959:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5592 00000100:00100000:0.0:1787119526.445967:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633713920:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.445978:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.445994:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c8e expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.446019:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 262) 00010000:00010000:0.0:1787119526.446026:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 262) 00010000:00010000:0.0:1787119526.446031:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 48 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.446044:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 48 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.446056:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:3.0:1787119526.446414:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:2373:x1873929633713792:12345-192.168.201.59@tcp:4:kworker.0 Request processed in 1015us (1228us total) trans 4294969267 rc 0/0 00000100:00100000:3.0:1787119526.446422:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1399 00002000:00100000:3.0:1787119526.446432:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (360448->364543) req@ffff92a62a123480 x1873929633713792/t4294969267(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 4584/448 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 0/0 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.446459:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123480 with x1873929633713792 ext(360448->364543) 00010000:00010000:3.0:1787119526.446466:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 48 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.446484:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 48 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.446491:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a123480 00000100:00100000:0.0:1787119526.446560:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633713920:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 593us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.446567:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5592 00000100:00100000:1.0:1787119526.449722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.449830:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633714048 00000100:00100000:3.0:1787119526.449850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633714048 00010000:00010000:3.0:1787119526.449902:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 47 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.449963:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5634 00000100:00100000:3.0:1787119526.449975:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:2375:x1873929633714048:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.449992:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787119526.450015:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119524 -> 1787119525 00002000:00010000:3.0:1787119526.450018:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119524 -> 1787119525 00010000:00010000:3.0:1787119526.450025:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 47 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.450056:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 47 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.450088:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e45e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [339968->33894399] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c80 expref: 47 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.450108:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 262) 00010000:00010000:3.0:1787119526.450113:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 262) 00010000:00010000:3.0:1787119526.450133:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.450145:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.450154:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 262) 00010000:00010000:3.0:1787119526.450157:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 262) 00010000:00010000:3.0:1787119526.450163:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 46 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.450172:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 46 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.450211:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 46 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.450227:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653687808:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.450337:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 51 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.450347:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653687936:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.450371:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.454954:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653687808:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.454974:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653687936:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.455003:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119526.455071:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:2375:x1873929633714048:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5097us (5357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.455083:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5634 00000100:00100000:1.0:1787119526.455552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.455624:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633714176 00000100:00100000:3.0:1787119526.455632:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633714176 00002000:00100000:3.0:1787119526.455679:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a6068bf100 x1873929633714176/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.455698:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf100 with x1873929633714176 ext(339968->344063) 00002000:00010000:3.0:1787119526.455703:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf100 00000100:00100000:3.0:1787119526.455772:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10714 00000100:00100000:3.0:1787119526.455781:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2374:x1873929633714176:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119526.456006:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2374:x1873929633714176:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 225us (455us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119526.456013:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10714 00002000:00100000:3.0:1787119526.456019:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff92a6068bf100 x1873929633714176/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.456027:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf100 with x1873929633714176 ext(339968->344063) 00002000:00010000:3.0:1787119526.456030:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bf100 00000100:00100000:1.0:1787119526.461262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.461351:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633714304 00000100:00100000:2.0:1787119526.461363:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633714304 00002000:00100000:2.0:1787119526.461436:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff92a6068bdf80 x1873929633714304/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.461485:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bdf80 with x1873929633714304 ext(344064->348159) 00002000:00010000:2.0:1787119526.461492:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bdf80 00000100:00100000:2.0:1787119526.461598:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10715 00000100:00100000:2.0:1787119526.461959:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633714304:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.462395:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633714304:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 443us (1563us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119526.462406:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10715 00002000:00100000:2.0:1787119526.462415:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff92a6068bdf80 x1873929633714304/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.462425:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bdf80 with x1873929633714304 ext(344064->348159) 00002000:00010000:2.0:1787119526.462430:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6068bdf80 00000100:00100000:0.0:1787119526.468990:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.469033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.469115:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633714432 00000100:00100000:1.0:1787119526.469190:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633714432 00002000:00100000:1.0:1787119526.469254:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (360448->364543) req@ffff92a508da4000 x1873929633714432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.469265:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633714432 ext(360448->364543) 00002000:00010000:1.0:1787119526.469272:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4000 00000100:00100000:1.0:1787119526.469302:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633714560 00000100:00100000:1.0:1787119526.469306:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633714560 00002000:00100000:1.0:1787119526.469322:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff92a508da5880 x1873929633714560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.469329:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633714560 ext(348160->352255) 00002000:00010000:1.0:1787119526.469333:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5880 00000100:00100000:1.0:1787119526.469356:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10716 00000100:00100000:1.0:1787119526.469365:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:2373:x1873929633714432:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.469631:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10717 00000100:00100000:0.0:1787119526.469642:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2375:x1873929633714560:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.469851:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2375:x1873929633714560:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 211us (816us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.469859:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10717 00002000:00100000:0.0:1787119526.469866:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff92a508da5880 x1873929633714560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.469874:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5880 with x1873929633714560 ext(348160->352255) 00002000:00010000:0.0:1787119526.469878:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5880 00000100:00100000:1.0:1787119526.470318:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:2373:x1873929633714432:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 953us (1338us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119526.470326:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10716 00002000:00100000:1.0:1787119526.470332:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (360448->364543) req@ffff92a508da4000 x1873929633714432/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.470341:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4000 with x1873929633714432 ext(360448->364543) 00002000:00010000:1.0:1787119526.470344:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da4000 00000100:00100000:1.0:1787119526.477634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.477871:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633714688 00000100:00100000:3.0:1787119526.477988:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633714688 00002000:00100000:3.0:1787119526.478038:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (352256->356351) req@ffff92a51282fb80 x1873929633714688/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.478051:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282fb80 with x1873929633714688 ext(352256->356351) 00002000:00010000:3.0:1787119526.478057:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282fb80 00000100:00100000:3.0:1787119526.478094:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10718 00000100:00100000:3.0:1787119526.478104:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2374:x1873929633714688:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119526.478603:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2374:x1873929633714688:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 499us (976us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119526.478611:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10718 00002000:00100000:3.0:1787119526.478618:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (352256->356351) req@ffff92a51282fb80 x1873929633714688/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.478627:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282fb80 with x1873929633714688 ext(352256->356351) 00002000:00010000:3.0:1787119526.478631:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282fb80 00000100:00100000:0.0:1787119526.482162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.482409:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633714816 00000100:00100000:3.0:1787119526.482419:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633714816 00002000:00100000:3.0:1787119526.482510:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff92a508da5500 x1873929633714816/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.482521:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5500 with x1873929633714816 ext(356352->360447) 00002000:00010000:3.0:1787119526.482595:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5500 00000100:00100000:3.0:1787119526.482621:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10719 00000100:00100000:3.0:1787119526.482631:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633714816:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119526.483095:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633714816:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 463us (943us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119526.483103:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10719 00002000:00100000:3.0:1787119526.483111:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff92a508da5500 x1873929633714816/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.483125:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5500 with x1873929633714816 ext(356352->360447) 00002000:00010000:3.0:1787119526.483129:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5500 00000100:00100000:0.0:1787119526.486162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.486259:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633714944 00000100:00100000:2.0:1787119526.486270:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633714944 00002000:00100000:2.0:1787119526.486318:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (364544->368639) req@ffff92a508da5f80 x1873929633714944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.486329:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5f80 with x1873929633714944 ext(364544->368639) 00002000:00010000:2.0:1787119526.486335:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5f80 00000100:00100000:2.0:1787119526.486370:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10720 00000100:00100000:2.0:1787119526.486383:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:2374:x1873929633714944:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.486629:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:2374:x1873929633714944:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 248us (480us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119526.486636:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10720 00002000:00100000:2.0:1787119526.486642:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (364544->368639) req@ffff92a508da5f80 x1873929633714944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.486650:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da5f80 with x1873929633714944 ext(364544->368639) 00002000:00010000:2.0:1787119526.486654:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508da5f80 00000100:00100000:1.0:1787119526.489521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.489767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.489816:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633715072 00000100:00100000:1.0:1787119526.489825:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633715072 00000100:00100000:0.0:1787119526.490104:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633715200 00000100:00100000:0.0:1787119526.490110:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633715200 00002000:00100000:0.0:1787119526.490158:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (368640->372735) req@ffff92a51282e680 x1873929633715200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787119526.490166:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5593 00002000:00100000:0.0:1787119526.490170:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e680 with x1873929633715200 ext(368640->372735) 00000100:00100000:1.0:1787119526.490176:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633715072:12345-192.168.201.59@tcp:101:mmap_sanity.0 00002000:00010000:0.0:1787119526.490177:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282e680 00010000:00010000:1.0:1787119526.490191:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787119526.490205:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10721 00000100:00100000:0.0:1787119526.490212:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:2373:x1873929633715200:12345-192.168.201.59@tcp:3:kworker.0 00010000:00010000:1.0:1787119526.490214:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c95 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.490321:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 46 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.490331:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 262) 00010000:00010000:1.0:1787119526.490335:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 262) 00010000:00010000:1.0:1787119526.490340:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 53 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.490373:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 46 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.490416:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:2373:x1873929633715200:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 204us (905us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.490424:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10721 00002000:00100000:0.0:1787119526.490430:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (368640->372735) req@ffff92a51282e680 x1873929633715200/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787119526.490540:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 46 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.490557:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653688064:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119526.490643:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079723c0 going to sleep for 11 seconds 00002000:00100000:0.0:1787119526.490676:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e680 with x1873929633715200 ext(368640->372735) 00010000:00010000:0.0:1787119526.490684:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 46 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.490698:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 46 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.490704:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282e680 00000100:00100000:1.0:1787119526.493794:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653688064:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119526.493844:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 53 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.493866:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1a00, rc 0) 00000100:00100000:1.0:1787119526.493921:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+53:33957:x1873929633715072:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3746us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.494048:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5593 00000100:00100000:0.0:1787119526.497246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.497338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.497487:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633715456 00000100:00100000:1.0:1787119526.497498:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633715456 00000100:00100000:1.0:1787119526.497559:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5594 00000100:00100000:1.0:1787119526.497569:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:33946:x1873929633715456:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119526.497588:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119526.497608:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716c9c expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.497642:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 262) 00010000:00010000:1.0:1787119526.497647:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 262) 00010000:00010000:1.0:1787119526.497654:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.497667:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.497680:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:1.0:1787119526.497741:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633715456:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 173us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.497752:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5594 00000100:00100000:2.0:1787119526.498895:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633715328 00000100:00100000:2.0:1787119526.498907:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633715328 00002000:00100000:2.0:1787119526.499057:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (360448->368639) req@ffff92a508da6680 x1873929633715328/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 8680/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.499069:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6680 with x1873929633715328 ext(360448->368639) 00010000:00010000:2.0:1787119526.499079:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 47 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.499110:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 47 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.499188:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6680 00000100:00100000:2.0:1787119526.499280:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1400 00000100:00100000:2.0:1787119526.499291:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:2376:x1873929633715328:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119526.499728:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:2376:x1873929633715328:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 437us (2492us total) trans 4294969268 rc 0/0 00000100:00100000:2.0:1787119526.499739:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1400 00002000:00100000:2.0:1787119526.499746:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (360448->368639) req@ffff92a508da6680 x1873929633715328/t4294969268(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 8680/448 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.499755:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da6680 with x1873929633715328 ext(360448->368639) 00010000:00010000:2.0:1787119526.499761:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 49 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.499779:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 49 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.499787:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508da6680 00000100:00100000:3.0:1787119526.502425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.502546:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633715584 00000100:00100000:0.0:1787119526.502554:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633715584 00010000:00010000:0.0:1787119526.502589:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 49 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.502631:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5635 00000100:00100000:0.0:1787119526.502640:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:2373:x1873929633715584:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.502654:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.502674:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 49 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.502699:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 49 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.502724:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e45f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [360448->33914879] (req 360448->364543) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c8e expref: 49 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.502742:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 262) 00010000:00010000:0.0:1787119526.502747:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 262) 00010000:00010000:0.0:1787119526.502755:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 52 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.502764:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 52 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.502773:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 262) 00010000:00010000:0.0:1787119526.502775:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 262) 00010000:00010000:0.0:1787119526.502780:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 48 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.502795:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 48 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.502839:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 48 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.502853:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653688192:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.503609:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 52 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.503624:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653688320:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.503664:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.507188:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653688320:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.509805:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653688192:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.509836:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.509902:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:2373:x1873929633715584:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7261us (7484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.509913:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5635 00000100:00100000:1.0:1787119526.518766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.518828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.518987:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633715712 00000100:00100000:0.0:1787119526.518998:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633715712 00002000:00100000:0.0:1787119526.519051:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (360448->364543) req@ffff92a51282c380 x1873929633715712/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.519064:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c380 with x1873929633715712 ext(360448->364543) 00002000:00010000:0.0:1787119526.519071:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c380 00000100:00100000:0.0:1787119526.519105:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633715840 00000100:00100000:0.0:1787119526.519108:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633715840 00002000:00100000:0.0:1787119526.519136:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (368640->372735) req@ffff92a51282ca80 x1873929633715840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.519146:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ca80 with x1873929633715840 ext(368640->372735) 00002000:00010000:0.0:1787119526.519149:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ca80 00000100:00100000:0.0:1787119526.519177:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10722 00000100:00100000:0.0:1787119526.519188:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2375:x1873929633715712:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.519391:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2375:x1873929633715712:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 204us (635us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.519399:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10722 00002000:00100000:0.0:1787119526.519405:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (360448->364543) req@ffff92a51282c380 x1873929633715712/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.519414:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c380 with x1873929633715712 ext(360448->364543) 00002000:00010000:0.0:1787119526.519417:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282c380 00000100:00100000:0.0:1787119526.519435:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10723 00000100:00100000:0.0:1787119526.519481:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:2376:x1873929633715840:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.519552:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:2376:x1873929633715840:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 73us (723us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.519557:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10723 00002000:00100000:0.0:1787119526.519563:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (368640->372735) req@ffff92a51282ca80 x1873929633715840/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.519576:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ca80 with x1873929633715840 ext(368640->372735) 00002000:00010000:0.0:1787119526.519580:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282ca80 00000100:00100000:2.0:1787119526.528341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.528384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.528476:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633716096 00000100:00100000:1.0:1787119526.528488:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633716096 00002000:00100000:1.0:1787119526.528541:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (372736->376831) req@ffff92a62a122300 x1873929633716096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.528552:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a122300 with x1873929633716096 ext(372736->376831) 00002000:00010000:1.0:1787119526.528558:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a122300 00000100:00100000:1.0:1787119526.528592:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633715968 00000100:00100000:1.0:1787119526.528596:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633715968 00002000:00100000:1.0:1787119526.528612:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (364544->368639) req@ffff92a62a122d80 x1873929633715968/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.528619:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a122d80 with x1873929633715968 ext(364544->368639) 00002000:00010000:1.0:1787119526.528623:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a122d80 00000100:00100000:1.0:1787119526.528650:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10724 00000100:00100000:1.0:1787119526.528658:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:2373:x1873929633716096:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.528864:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:2373:x1873929633716096:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 205us (533us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119526.528872:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10724 00002000:00100000:1.0:1787119526.528878:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (372736->376831) req@ffff92a62a122300 x1873929633716096/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.528886:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a122300 with x1873929633716096 ext(372736->376831) 00002000:00010000:1.0:1787119526.528890:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a122300 00000100:00100000:1.0:1787119526.528908:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10725 00000100:00100000:1.0:1787119526.528915:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2376:x1873929633715968:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.529005:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2376:x1873929633715968:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 90us (619us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119526.529012:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10725 00002000:00100000:1.0:1787119526.529017:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (364544->368639) req@ffff92a62a122d80 x1873929633715968/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.529026:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a122d80 with x1873929633715968 ext(364544->368639) 00002000:00010000:1.0:1787119526.529030:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a122d80 00000100:00100000:3.0:1787119526.532960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.533055:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633716224 00000100:00100000:2.0:1787119526.533065:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633716224 00000100:00100000:2.0:1787119526.533124:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5595 00000100:00100000:2.0:1787119526.533133:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+53:33957:x1873929633716224:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.533151:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.533170:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ca3 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.533202:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.533212:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 262) 00010000:00010000:2.0:1787119526.533217:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 262) 00010000:00010000:2.0:1787119526.533222:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 54 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.533253:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.533278:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 47 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.533294:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653688448:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.533382:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.536288:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653688448:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119526.536329:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 54 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.536354:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895200, rc 0) 00000100:00100000:2.0:1787119526.536421:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+54:33957:x1873929633716224:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3287us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.536430:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5595 00000100:00100000:3.0:1787119526.540620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.540729:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633716352 00000100:00100000:0.0:1787119526.540740:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633716352 00002000:00100000:0.0:1787119526.540808:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff92a508ffca80 x1873929633716352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.540819:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffca80 with x1873929633716352 ext(376832->380927) 00010000:00010000:0.0:1787119526.540828:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 48 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.540859:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 48 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.540867:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffca80 00000100:00100000:0.0:1787119526.540900:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1401 00000100:00100000:0.0:1787119526.540910:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:2376:x1873929633716352:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.541330:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:2376:x1873929633716352:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 419us (719us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.541338:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1401 00002000:00100000:0.0:1787119526.541346:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff92a508ffca80 x1873929633716352/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.541355:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffca80 with x1873929633716352 ext(376832->380927) 00010000:00010000:0.0:1787119526.541361:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 48 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.541378:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 48 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.541386:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffca80 00000100:00100000:3.0:1787119526.544727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.545487:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633716480 00000100:00100000:0.0:1787119526.545499:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633716480 00000100:00100000:0.0:1787119526.545559:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5596 00000100:00100000:0.0:1787119526.545569:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:33946:x1873929633716480:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.545589:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.545611:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716caa expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.545647:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 262) 00010000:00010000:0.0:1787119526.545653:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 262) 00010000:00010000:0.0:1787119526.545660:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 49 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.545672:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 49 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.545686:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119526.545756:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:33946:x1873929633716480:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 187us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.545763:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5596 00000100:00100000:1.0:1787119526.552374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.552489:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633716608 00000100:00100000:3.0:1787119526.552499:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633716608 00002000:00100000:3.0:1787119526.552552:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (368640->376831) req@ffff92a51282ea00 x1873929633716608/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 8680/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.552564:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ea00 with x1873929633716608 ext(368640->376831) 00010000:00010000:3.0:1787119526.552573:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 49 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.552604:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 49 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.552613:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282ea00 00000100:00100000:3.0:1787119526.552652:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1402 00000100:00100000:3.0:1787119526.552662:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:2376:x1873929633716608:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119526.553069:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:2376:x1873929633716608:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 406us (706us total) trans 4294969269 rc 0/0 00000100:00100000:3.0:1787119526.553076:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1402 00002000:00100000:3.0:1787119526.553083:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (368640->376831) req@ffff92a51282ea00 x1873929633716608/t4294969269(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 8680/448 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.553092:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ea00 with x1873929633716608 ext(368640->376831) 00010000:00010000:3.0:1787119526.553098:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 51 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.553113:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 51 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.553308:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282ea00 00000100:00100000:2.0:1787119526.558559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.558668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633716736 00000100:00100000:1.0:1787119526.558679:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633716736 00010000:00010000:1.0:1787119526.558721:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 51 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.558811:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5636 00000100:00100000:1.0:1787119526.558823:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:2375:x1873929633716736:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119526.558838:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119526.558861:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 51 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.558887:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 51 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.558921:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4603 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [368640->33923071] (req 368640->372735) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c9c expref: 51 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.558949:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 262) 00010000:00010000:1.0:1787119526.558954:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 262) 00010000:00010000:1.0:1787119526.558964:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 53 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.558986:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 53 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.558996:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 262) 00010000:00010000:1.0:1787119526.558999:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 262) 00010000:00010000:1.0:1787119526.559003:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 50 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.559011:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 50 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.559050:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 50 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.559066:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653688576:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.559216:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 53 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.559227:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653688704:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.559252:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079729c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.564706:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653688576:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.564725:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653688704:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.564751:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119526.564824:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2375:x1873929633716736:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6002us (6274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.564836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5636 00000100:00100000:2.0:1787119526.566531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.566660:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633716864 00000100:00100000:0.0:1787119526.566670:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633716864 00002000:00100000:0.0:1787119526.566720:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (368640->376831) req@ffff92a62a120000 x1873929633716864/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.566731:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120000 with x1873929633716864 ext(368640->376831) 00002000:00010000:0.0:1787119526.566737:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120000 00000100:00100000:0.0:1787119526.566767:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10726 00000100:00100000:0.0:1787119526.566776:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+54:2375:x1873929633716864:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.567023:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+54:2375:x1873929633716864:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 247us (500us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1787119526.567031:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10726 00002000:00100000:0.0:1787119526.567039:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (368640->376831) req@ffff92a62a120000 x1873929633716864/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/8632 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.567048:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120000 with x1873929633716864 ext(368640->376831) 00002000:00010000:0.0:1787119526.567051:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a120000 00000100:00100000:3.0:1787119526.574962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.575320:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633716992 00000100:00100000:1.0:1787119526.575331:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633716992 00000100:00100000:1.0:1787119526.575397:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5597 00000100:00100000:1.0:1787119526.575407:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+54:33957:x1873929633716992:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119526.575427:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119526.575487:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716cb1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.575523:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 49 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.575534:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 262) 00010000:00010000:1.0:1787119526.575539:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 262) 00010000:00010000:1.0:1787119526.575545:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.575587:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 49 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.575616:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 49 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.575630:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653688832:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119526.575713:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.577860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.577965:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633717120 00000100:00100000:2.0:1787119526.577974:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633717120 00002000:00100000:2.0:1787119526.578028:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff92a508ffe300 x1873929633717120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.578047:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633717120 ext(376832->380927) 00010000:00010000:2.0:1787119526.578056:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 50 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.578085:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 50 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.578094:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffe300 00000100:00100000:2.0:1787119526.578138:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1403 00000100:00100000:2.0:1787119526.578149:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633717120:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.578380:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633717120:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 231us (529us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119526.578388:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1403 00002000:00100000:2.0:1787119526.578395:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff92a508ffe300 x1873929633717120/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.578403:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633717120 ext(376832->380927) 00010000:00010000:2.0:1787119526.578408:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 50 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.578423:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 50 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.578430:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffe300 00000100:00100000:1.0:1787119526.581829:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653688832:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119526.581871:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.581895:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:1.0:1787119526.581965:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633716992:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6558us (7012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.581974:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5597 00000100:00100000:3.0:1787119526.584916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.585035:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633717248 00000100:00100000:0.0:1787119526.585046:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633717248 00000100:00100000:0.0:1787119526.585110:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5598 00000100:00100000:0.0:1787119526.585121:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:33946:x1873929633717248:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.585152:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.585172:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716cb8 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.585207:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 262) 00010000:00010000:0.0:1787119526.585217:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.585230:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 262) 00010000:00010000:0.0:1787119526.585235:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.585276:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.585291:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.585305:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119526.585370:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:33946:x1873929633717248:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 250us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.585377:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5598 00000100:00100000:3.0:1787119526.586583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.587141:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633717376 00000100:00100000:0.0:1787119526.587151:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633717376 00010000:00010000:0.0:1787119526.587190:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 51 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.587233:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5637 00000100:00100000:0.0:1787119526.587242:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:2376:x1873929633717376:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.587256:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.587278:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 51 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.587310:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 51 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.587335:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4611 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716caa expref: 51 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.587353:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 262) 00010000:00010000:0.0:1787119526.587357:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 262) 00010000:00010000:0.0:1787119526.587365:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.587375:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.587409:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.587426:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 54 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.587494:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653689088:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.587568:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.591772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.592133:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633717504 00000100:00100000:2.0:1787119526.592144:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633717504 00002000:00100000:2.0:1787119526.592195:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (376832->409599) req@ffff92a51282ed80 x1873929633717504/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.592207:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ed80 with x1873929633717504 ext(376832->409599) 00010000:00010000:2.0:1787119526.592215:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.592245:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.592254:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282ed80 00000100:00100000:2.0:1787119526.592287:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1404 00000100:00100000:2.0:1787119526.592297:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2376:x1873929633717504:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.592756:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653689088:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.592779:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.592826:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633717376:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5584us (6247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.592835:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5637 00000100:00100000:2.0:1787119526.596818:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2376:x1873929633717504:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4501us (5034us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1787119526.596833:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1404 00002000:00100000:2.0:1787119526.596845:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (376832->409599) req@ffff92a51282ed80 x1873929633717504/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 32768/32768 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.596856:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ed80 with x1873929633717504 ext(376832->409599) 00010000:00010000:2.0:1787119526.596868:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.596897:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.596912:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282ed80 00000100:00100000:3.0:1787119526.599541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.599775:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633717632 00000100:00100000:2.0:1787119526.599786:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633717632 00000100:00100000:2.0:1787119526.599856:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5599 00000100:00100000:2.0:1787119526.599866:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633717632:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.599886:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.599907:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716cbf expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.599969:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 262) 00010000:00010000:2.0:1787119526.599979:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.599987:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 262) 00010000:00010000:2.0:1787119526.599992:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 56 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.600037:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.600054:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 56 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.600067:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894400, rc 0) 00000100:00100000:2.0:1787119526.600139:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633717632:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 274us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.600146:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5599 00000100:00100000:1.0:1787119526.602032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.602134:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633717760 00000100:00100000:0.0:1787119526.602146:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633717760 00010000:00010000:0.0:1787119526.602183:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 56 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.602227:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5638 00000100:00100000:0.0:1787119526.602236:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2373:x1873929633717760:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.602251:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.602272:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 56 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.602299:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 56 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.602324:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4618 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb1 expref: 56 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.602341:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 262) 00010000:00010000:0.0:1787119526.602346:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 262) 00010000:00010000:0.0:1787119526.602354:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.602364:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.602401:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 49 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.602415:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 49 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.602429:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653689344:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.602561:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.606063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.606431:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633717888 00000100:00100000:2.0:1787119526.606476:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633717888 00010000:00010000:2.0:1787119526.606529:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 50 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.606575:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5639 00000100:00100000:2.0:1787119526.606586:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2374:x1873929633717888:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119526.606603:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119526.606629:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 50 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.606658:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 50 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.606687:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 262) 00010000:00010000:2.0:1787119526.606693:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 262) 00010000:00010000:2.0:1787119526.606702:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.606712:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.606750:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.606770:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a121180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653689472:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119526.606863:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00010000:00010000:0.0:1787119526.608417:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e461f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cb8 expref: 50 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.608461:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653689344:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.608488:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.608548:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2373:x1873929633717760:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6312us (6525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.608557:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5638 00000100:00100000:2.0:1787119526.612365:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a121180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653689472:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119526.612405:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119526.612510:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:2374:x1873929633717888:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5924us (6457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.612531:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5639 00000100:00100000:1.0:1787119526.618559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.618643:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633718016 00000100:00100000:3.0:1787119526.618654:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633718016 00000100:00100000:3.0:1787119526.618706:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5600 00000100:00100000:3.0:1787119526.618716:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:33946:x1873929633718016:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119526.618735:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.618756:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716cc6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.618808:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 54 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.618819:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 262) 00010000:00010000:3.0:1787119526.618825:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 262) 00010000:00010000:3.0:1787119526.618831:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.618877:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 54 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.618908:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 54 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.618924:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653689600:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119526.619017:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.622881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.623141:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633718144 00000100:00100000:0.0:1787119526.623152:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633718144 00010000:00010000:0.0:1787119526.623194:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 55 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.623253:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5640 00000100:00100000:0.0:1787119526.623264:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2375:x1873929633718144:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.623283:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.623318:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 55 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.623345:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 55 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.623375:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 262) 00010000:00010000:0.0:1787119526.623381:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 262) 00010000:00010000:0.0:1787119526.623390:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.623400:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.623479:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.623495:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653689728:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.623573:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00010000:00010000:3.0:1787119526.624395:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cbf expref: 55 pid: 8267 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.624417:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653689600:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119526.624490:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.624503:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:3.0:1787119526.624544:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:33946:x1873929633718016:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5828us (5994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.624551:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5600 00000100:00100000:1.0:1787119526.628156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.628255:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633718272 00000100:00100000:2.0:1787119526.628265:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633718272 00000100:00100000:2.0:1787119526.628324:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5601 00000100:00100000:2.0:1787119526.628333:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633718272:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.628351:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.628370:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ccd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.628402:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.628411:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 262) 00010000:00010000:2.0:1787119526.628416:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 262) 00010000:00010000:2.0:1787119526.628420:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 56 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.628499:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.628526:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 49 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.628542:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653689856:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.628616:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.631625:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653689728:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.631652:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119526.631703:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633718144:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8440us (8832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.631714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5640 00000100:00100000:1.0:1787119526.634365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.634515:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653689856:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119526.634555:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.634578:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894c00, rc 0) 00000100:00100000:3.0:1787119526.634636:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633718272:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6304us (6491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.634645:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5601 00000100:00100000:2.0:1787119526.635090:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633718400 00000100:00100000:2.0:1787119526.635098:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633718400 00002000:00100000:2.0:1787119526.635138:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff92a51282ce00 x1873929633718400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.635148:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ce00 with x1873929633718400 ext(376832->380927) 00010000:00010000:2.0:1787119526.635156:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.635183:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.635190:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282ce00 00000100:00100000:2.0:1787119526.635221:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1405 00000100:00100000:2.0:1787119526.635230:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633718400:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.635405:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633718400:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 175us (1048us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119526.635412:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1405 00002000:00100000:2.0:1787119526.635418:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff92a51282ce00 x1873929633718400/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.635427:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282ce00 with x1873929633718400 ext(376832->380927) 00010000:00010000:2.0:1787119526.635433:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.635478:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.635486:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282ce00 00000100:00100000:1.0:1787119526.639364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.639408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.639507:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633718656 00000100:00100000:3.0:1787119526.639518:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633718656 00010000:00010000:3.0:1787119526.639560:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.639606:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5641 00000100:00100000:3.0:1787119526.639615:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2375:x1873929633718656:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.639631:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.639655:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.639679:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.639704:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e462d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cc6 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.639722:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 262) 00010000:00010000:3.0:1787119526.639727:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 262) 00010000:00010000:3.0:1787119526.639736:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.639746:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.639782:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.639808:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653689984:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.639891:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.640626:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633718528 00000100:00100000:2.0:1787119526.640634:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633718528 00000100:00100000:2.0:1787119526.640683:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5602 00000100:00100000:2.0:1787119526.640691:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:33946:x1873929633718528:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.640705:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.640721:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716cd4 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.640744:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.640753:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 262) 00010000:00010000:2.0:1787119526.640756:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 262) 00010000:00010000:2.0:1787119526.640761:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 51 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.640789:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.640824:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 54 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.641021:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653690112:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.641093:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.645105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.645332:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633718784 00000100:00100000:3.0:1787119526.645341:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633718784 00002000:00100000:3.0:1787119526.645392:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (376832->409599) req@ffff92a51282d500 x1873929633718784/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.645404:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d500 with x1873929633718784 ext(376832->409599) 00010000:00010000:3.0:1787119526.645413:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.645485:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.645494:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282d500 00000100:00100000:3.0:1787119526.645521:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1406 00000100:00100000:3.0:1787119526.645531:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2376:x1873929633718784:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.646497:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653690112:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119526.646543:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 51 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.646563:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894a00, rc 0) 00000100:00100000:2.0:1787119526.646598:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:33946:x1873929633718528:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5906us (7243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.646605:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5602 00000100:00100000:0.0:1787119526.650283:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653689984:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.650313:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.650381:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2375:x1873929633718656:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10766us (10970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.650394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5641 00000100:00100000:0.0:1787119526.651340:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2376:x1873929633718784:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5805us (6241us total) trans 0 rc 32768/32768 00000100:00100000:0.0:1787119526.651350:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1406 00002000:00100000:0.0:1787119526.651360:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (376832->409599) req@ffff92a51282d500 x1873929633718784/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 32768/32768 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.651371:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d500 with x1873929633718784 ext(376832->409599) 00010000:00010000:0.0:1787119526.651380:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.651410:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.651419:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282d500 00000100:00100000:3.0:1787119526.658729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.658783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.659024:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633719040 00000100:00100000:2.0:1787119526.659034:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633719040 00010000:00010000:2.0:1787119526.659075:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.659170:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5642 00000100:00100000:2.0:1787119526.659180:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2375:x1873929633719040:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119526.659196:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119526.659219:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.659249:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.659276:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4634 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ccd expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.659300:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 262) 00010000:00010000:2.0:1787119526.659305:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 262) 00010000:00010000:2.0:1787119526.659314:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.659326:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.659365:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.659379:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a121180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653690240:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119526.659634:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.659821:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633718912 00000100:00100000:0.0:1787119526.659827:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633718912 00000100:00100000:0.0:1787119526.659880:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5603 00000100:00100000:0.0:1787119526.659888:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633718912:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.659903:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.659917:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716cdb expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.659948:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.659955:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 262) 00010000:00010000:0.0:1787119526.659959:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 262) 00010000:00010000:0.0:1787119526.659963:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.659995:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 49 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.660012:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 49 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.660023:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653690368:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119526.660070:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.666166:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653690368:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119526.666206:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.666229:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:2.0:1787119526.666292:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633718912:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6404us (7507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.666301:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5603 00000100:00100000:0.0:1787119526.667055:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a121180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653690240:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.667075:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.667109:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2375:x1873929633719040:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7929us (8390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.667131:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5642 00000100:00100000:2.0:1787119526.668303:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.669432:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633719168 00000100:00100000:1.0:1787119526.669469:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633719168 00010000:00010000:1.0:1787119526.669512:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 50 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.669567:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5643 00000100:00100000:1.0:1787119526.669577:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633719168:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119526.669592:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119526.669617:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 50 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.669645:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 50 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.669672:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e463b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cd4 expref: 50 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.669694:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 262) 00010000:00010000:1.0:1787119526.669699:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 262) 00010000:00010000:1.0:1787119526.669708:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 54 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.669720:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 54 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.669766:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 54 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.669781:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653690496:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.670297:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079729c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.675366:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653690496:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.675395:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119526.675608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.675710:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633719296 00000100:00100000:0.0:1787119526.675718:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633719296 00000100:00100000:0.0:1787119526.675769:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5604 00000100:00100000:0.0:1787119526.675779:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:33946:x1873929633719296:12345-192.168.201.59@tcp:101:mmap_sanity.0 00000100:00100000:1.0:1787119526.675790:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633719168:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6214us (7491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.675800:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5643 00010000:00010000:0.0:1787119526.675813:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.675833:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ce2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.675875:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 54 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.675891:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 262) 00010000:00010000:0.0:1787119526.675896:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 262) 00010000:00010000:0.0:1787119526.675901:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.675992:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 54 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.676017:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 54 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.676031:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653690624:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119526.676654:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.679681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.679745:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633719424 00000100:00100000:3.0:1787119526.679755:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633719424 00010000:00010000:3.0:1787119526.679797:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 55 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.679805:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653690624:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119526.679831:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.679836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5644 00010000:00010000:0.0:1787119526.679849:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:3.0:1787119526.679921:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2376:x1873929633719424:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.679947:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.679970:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 55 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.680007:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 55 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.680031:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4642 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cdb expref: 55 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.680047:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 262) 00010000:00010000:3.0:1787119526.680052:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 262) 00010000:00010000:3.0:1787119526.680062:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.680073:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.680090:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:33946:x1873929633719296:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4313us (4483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.680097:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5604 00010000:00010000:3.0:1787119526.680105:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.680130:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653690752:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.680183:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.685586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.685726:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633719552 00000100:00100000:1.0:1787119526.685734:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633719552 00002000:00100000:1.0:1787119526.685777:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff92a63dc07100 x1873929633719552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.685786:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07100 with x1873929633719552 ext(376832->380927) 00002000:00010000:1.0:1787119526.685790:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07100 00000100:00100000:1.0:1787119526.685910:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10727 00000100:00100000:1.0:1787119526.685920:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2375:x1873929633719552:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.686238:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2375:x1873929633719552:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 318us (661us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119526.686246:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10727 00002000:00100000:1.0:1787119526.686253:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff92a63dc07100 x1873929633719552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.686267:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07100 with x1873929633719552 ext(376832->380927) 00002000:00010000:1.0:1787119526.686271:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07100 00000100:00100000:0.0:1787119526.687061:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653690752:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.687091:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.687138:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+54:2376:x1873929633719424:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7294us (7470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.687147:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5644 00000100:00100000:3.0:1787119526.689604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.689664:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633719680 00000100:00100000:2.0:1787119526.689674:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633719680 00000100:00100000:2.0:1787119526.689779:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5605 00000100:00100000:2.0:1787119526.689789:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+54:33957:x1873929633719680:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.689806:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.689825:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ce9 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.689859:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.689870:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 262) 00010000:00010000:2.0:1787119526.689874:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 262) 00010000:00010000:2.0:1787119526.689879:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.689910:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 49 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.689951:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 49 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.689973:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653690880:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.690057:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.691469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.691560:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633719808 00000100:00100000:3.0:1787119526.691569:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633719808 00002000:00100000:3.0:1787119526.691608:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (380928->385023) req@ffff92a519d1ad80 x1873929633719808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.691617:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1ad80 with x1873929633719808 ext(380928->385023) 00010000:00010000:3.0:1787119526.691623:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.691643:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.691649:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1ad80 00000100:00100000:3.0:1787119526.691679:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1407 00000100:00100000:3.0:1787119526.691688:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633719808:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119526.691900:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633719808:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 211us (461us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119526.691908:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1407 00002000:00100000:3.0:1787119526.691915:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (380928->385023) req@ffff92a519d1ad80 x1873929633719808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.691940:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1ad80 with x1873929633719808 ext(380928->385023) 00010000:00010000:3.0:1787119526.691946:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.691960:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.691967:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1ad80 00000100:00100000:3.0:1787119526.696903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.697321:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633720064 00000100:00100000:2.0:1787119526.697332:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633720064 00002000:00100000:2.0:1787119526.697383:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (376832->385023) req@ffff92a63dc05500 x1873929633720064/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 8680/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.697395:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05500 with x1873929633720064 ext(376832->385023) 00010000:00010000:2.0:1787119526.697405:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.697481:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 50 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.697490:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05500 00000100:00100000:2.0:1787119526.697518:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1408 00000100:00100000:2.0:1787119526.697540:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+50:2376:x1873929633720064:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119526.698498:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633720064:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 954us (1598us total) trans 4294969270 rc 0/0 00000100:00100000:2.0:1787119526.698509:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1408 00002000:00100000:2.0:1787119526.698529:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (376832->385023) req@ffff92a63dc05500 x1873929633720064/t4294969270(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 8680/448 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.698546:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05500 with x1873929633720064 ext(376832->385023) 00010000:00010000:2.0:1787119526.698556:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.698582:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.698589:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05500 00000100:00100000:3.0:1787119526.700223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.700374:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653690880:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119526.700413:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.700435:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894c00, rc 0) 00000100:00100000:0.0:1787119526.700521:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633719680:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10733us (10923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.700529:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5605 00000100:00100000:1.0:1787119526.700751:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633719936 00000100:00100000:1.0:1787119526.700760:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633719936 00002000:00100000:1.0:1787119526.700805:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a63dc05880 x1873929633719936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.700815:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05880 with x1873929633719936 ext(385024->389119) 00010000:00010000:1.0:1787119526.700822:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.700848:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.700856:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05880 00000100:00100000:1.0:1787119526.700884:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1409 00000100:00100000:1.0:1787119526.700894:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633719936:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.701096:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633719936:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 203us (881us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119526.701104:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1409 00002000:00100000:1.0:1787119526.701111:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a63dc05880 x1873929633719936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.701120:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05880 with x1873929633719936 ext(385024->389119) 00010000:00010000:1.0:1787119526.701125:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.701139:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.701146:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc05880 00000100:00100000:3.0:1787119526.705368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.705478:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633720192 00000100:00100000:2.0:1787119526.705489:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633720192 00000100:00100000:2.0:1787119526.705549:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5606 00000100:00100000:2.0:1787119526.705560:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633720192:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.705581:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.705602:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716cf0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.705636:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 262) 00010000:00010000:2.0:1787119526.705642:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 262) 00010000:00010000:2.0:1787119526.705649:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 53 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.705662:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 53 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.705676:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894a00, rc 0) 00000100:00100000:2.0:1787119526.705740:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:33946:x1873929633720192:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 181us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.705746:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5606 00000100:00100000:3.0:1787119526.707684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.707804:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633720320 00000100:00100000:0.0:1787119526.707813:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633720320 00010000:00010000:0.0:1787119526.707859:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 53 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.707907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5645 00000100:00100000:0.0:1787119526.707916:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:2376:x1873929633720320:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.707942:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.707969:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 53 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.707994:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 53 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.708020:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4649 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [376832->33931263] (req 376832->380927) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce2 expref: 53 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.708041:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 262) 00010000:00010000:0.0:1787119526.708046:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 262) 00010000:00010000:0.0:1787119526.708054:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.708063:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.708070:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 262) 00010000:00010000:0.0:1787119526.708072:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 262) 00010000:00010000:0.0:1787119526.708076:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 52 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.708084:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 52 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.708127:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 52 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.708142:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653691008:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.708233:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.708244:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653691136:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.708270:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.712509:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653691008:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.712692:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653691136:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.712717:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.712784:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633720320:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4867us (5106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.712806:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5645 00000100:00100000:2.0:1787119526.717594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.717756:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633720448 00000100:00100000:0.0:1787119526.717768:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633720448 00002000:00100000:0.0:1787119526.717831:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (376832->385023) req@ffff92a519d19180 x1873929633720448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.717959:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19180 with x1873929633720448 ext(376832->385023) 00002000:00010000:0.0:1787119526.717964:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19180 00000100:00100000:0.0:1787119526.718001:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10728 00000100:00100000:0.0:1787119526.718010:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2376:x1873929633720448:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.718419:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2376:x1873929633720448:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 407us (832us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1787119526.718428:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10728 00002000:00100000:0.0:1787119526.718435:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (376832->385023) req@ffff92a519d19180 x1873929633720448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/8632 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.718483:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19180 with x1873929633720448 ext(376832->385023) 00002000:00010000:0.0:1787119526.718488:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d19180 00000100:00100000:3.0:1787119526.724236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.724964:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633720576 00000100:00100000:2.0:1787119526.724975:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633720576 00000100:00100000:2.0:1787119526.725032:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5607 00000100:00100000:2.0:1787119526.725041:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633720576:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.725059:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.725077:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716cf7 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.725124:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 51 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.725135:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 262) 00010000:00010000:2.0:1787119526.725140:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 262) 00010000:00010000:2.0:1787119526.725145:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.725181:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 51 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.725206:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 51 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.725221:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653691264:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.725320:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6088b6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.728803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.729019:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633720704 00000100:00100000:1.0:1787119526.729031:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633720704 00010000:00010000:1.0:1787119526.729073:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 52 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.729133:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5646 00000100:00100000:1.0:1787119526.729144:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633720704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119526.729161:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119526.729185:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 52 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.729214:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 52 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.729244:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 262) 00010000:00010000:1.0:1787119526.729249:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 262) 00010000:00010000:1.0:1787119526.729257:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.729267:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.729312:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.729327:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653691392:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.729409:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.732323:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653691392:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.732351:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119526.732420:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633720704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3276us (3641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.732431:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5646 00010000:00010000:0.0:1787119526.734731:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf0 expref: 51 pid: 20841 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.734763:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653691264:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119526.734923:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.734951:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894400, rc 0) 00000100:00100000:0.0:1787119526.735091:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633720576:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10049us (10864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.735100:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5607 00000100:00100000:3.0:1787119526.736656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.737766:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633720832 00000100:00100000:0.0:1787119526.737778:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633720832 00000100:00100000:0.0:1787119526.737943:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5608 00000100:00100000:0.0:1787119526.737956:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:33946:x1873929633720832:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.737981:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.738005:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716cfe expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.738045:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.738056:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 262) 00010000:00010000:0.0:1787119526.738060:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 262) 00010000:00010000:0.0:1787119526.738065:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 52 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.738103:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.738143:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 55 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.738159:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653691520:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119526.738253:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.740761:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653691520:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119526.740804:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 52 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.740826:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:1.0:1787119526.741098:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633720832:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3142us (4447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.741107:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5608 00000100:00100000:2.0:1787119526.744385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.744482:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633720960 00000100:00100000:3.0:1787119526.744493:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633720960 00002000:00100000:3.0:1787119526.744556:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (385024->409599) req@ffff92a519d19880 x1873929633720960/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.744567:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19880 with x1873929633720960 ext(385024->409599) 00010000:00010000:3.0:1787119526.744577:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.744609:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.744621:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d19880 00000100:00100000:3.0:1787119526.744649:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1410 00000100:00100000:3.0:1787119526.744659:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2376:x1873929633720960:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119526.752515:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2376:x1873929633720960:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7844us (8128us total) trans 0 rc 24576/24576 00000100:00100000:0.0:1787119526.752540:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1410 00002000:00100000:0.0:1787119526.752554:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (385024->409599) req@ffff92a519d19880 x1873929633720960/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 24576/24576 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.752564:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d19880 with x1873929633720960 ext(385024->409599) 00010000:00010000:0.0:1787119526.752574:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.752606:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.752615:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d19880 00000100:00100000:3.0:1787119526.758078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.758287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.758952:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633721216 00000100:00100000:1.0:1787119526.758964:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633721216 00010000:00010000:1.0:1787119526.759076:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.759205:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5647 00000100:00100000:3.0:1787119526.759218:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633721216:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.759236:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.759265:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.759294:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.759324:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e465e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cf7 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.759346:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 262) 00010000:00010000:3.0:1787119526.759352:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 262) 00010000:00010000:3.0:1787119526.759360:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.759370:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.759413:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.759429:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653691648:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.759573:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.761753:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633721088 00000100:00100000:0.0:1787119526.761767:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633721088 00000100:00100000:0.0:1787119526.761860:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5609 00000100:00100000:0.0:1787119526.761870:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633721088:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.761890:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.761910:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d05 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.761958:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.761969:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 262) 00010000:00010000:0.0:1787119526.761985:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 262) 00010000:00010000:0.0:1787119526.761991:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.762025:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.762052:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 51 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.762068:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653691776:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119526.762402:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.765347:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653691776:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119526.765384:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.765407:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119526.765498:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633721088:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3628us (7431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.765506:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5609 00000100:00100000:1.0:1787119526.765799:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653691648:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.765815:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119526.765857:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633721216:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6641us (7570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.765867:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5647 00000100:00100000:3.0:1787119526.769785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.770019:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633721344 00000100:00100000:1.0:1787119526.770030:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633721344 00002000:00100000:1.0:1787119526.770082:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a5066dd180 x1873929633721344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.770094:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633721344 ext(385024->389119) 00010000:00010000:1.0:1787119526.770104:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.770146:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.770155:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dd180 00000100:00100000:1.0:1787119526.770190:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1411 00000100:00100000:1.0:1787119526.770199:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2374:x1873929633721344:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.770400:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2374:x1873929633721344:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 202us (625us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119526.770408:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1411 00002000:00100000:1.0:1787119526.770415:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a5066dd180 x1873929633721344/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.770423:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633721344 ext(385024->389119) 00010000:00010000:1.0:1787119526.770428:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.770483:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 52 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.770497:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a5066dd180 00000100:00100000:0.0:1787119526.774000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.774172:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633721472 00000100:00100000:2.0:1787119526.774183:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633721472 00000100:00100000:2.0:1787119526.774248:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5610 00000100:00100000:2.0:1787119526.774259:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633721472:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.774278:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.774298:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d0c expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.774330:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 262) 00010000:00010000:2.0:1787119526.774339:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.774347:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 262) 00010000:00010000:2.0:1787119526.774352:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.774396:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.774412:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.774427:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894800, rc 0) 00000100:00100000:2.0:1787119526.774536:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:33946:x1873929633721472:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 279us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.774543:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5610 00000100:00100000:2.0:1787119526.776783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.776971:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633721600 00000100:00100000:0.0:1787119526.776993:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633721600 00010000:00010000:0.0:1787119526.777033:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 53 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.777077:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5648 00000100:00100000:0.0:1787119526.777087:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:2375:x1873929633721600:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.777100:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.777133:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 53 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.777161:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 53 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.777187:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4665 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716cfe expref: 53 pid: 6696 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.777208:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 262) 00010000:00010000:0.0:1787119526.777212:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 262) 00010000:00010000:0.0:1787119526.777221:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.777231:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.777267:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.777282:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 55 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.777295:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653692032:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.777387:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.781988:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653692032:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.782016:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.782082:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2375:x1873929633721600:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4996us (5308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.782093:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5648 00000100:00100000:1.0:1787119526.784144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.784294:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633721728 00000100:00100000:3.0:1787119526.784303:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633721728 00010000:00010000:3.0:1787119526.784347:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 56 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.784393:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5649 00000100:00100000:3.0:1787119526.784403:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633721728:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.784418:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.784478:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 56 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.784506:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 56 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.784532:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e466c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d05 expref: 56 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.784550:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 262) 00010000:00010000:3.0:1787119526.784555:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 262) 00010000:00010000:3.0:1787119526.784564:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.784575:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.784615:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.784629:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653692160:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.784712:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.787399:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653692160:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.787430:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119526.787523:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2375:x1873929633721728:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3120us (3388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.787534:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5649 00000100:00100000:0.0:1787119526.794571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.794666:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633721856 00000100:00100000:2.0:1787119526.794675:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633721856 00000100:00100000:2.0:1787119526.794724:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5611 00000100:00100000:2.0:1787119526.794730:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633721856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.794746:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.794761:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d13 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.794799:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.794807:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 262) 00010000:00010000:2.0:1787119526.794810:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 262) 00010000:00010000:2.0:1787119526.794814:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.794846:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 51 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.794865:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 51 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.794877:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653692288:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.794960:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6088b6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.799011:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653692288:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119526.799055:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.799080:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894200, rc 0) 00000100:00100000:2.0:1787119526.799163:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633721856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4430us (4600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.799172:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5611 00000100:00100000:3.0:1787119526.802767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.802829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.802988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.803024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.803055:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633722240 00000100:00100000:3.0:1787119526.803064:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633722240 00000100:00100000:3.0:1787119526.803129:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 598 00000100:00100000:3.0:1787119526.803140:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633722240:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119526.803223:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633722240:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 85us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.803232:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 598 00000100:00080000:3.0:1787119526.803254:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119526.803282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.804248:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633721984 00000100:00100000:1.0:1787119526.804259:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633721984 00000100:00100000:1.0:1787119526.804309:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 526 00000100:00100000:1.0:1787119526.804316:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633721984:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119526.804373:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633721984:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 57us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.804392:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 526 00000100:00100000:1.0:1787119526.805687:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633722496 00000100:00100000:1.0:1787119526.805699:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633722496 00000100:00100000:1.0:1787119526.805761:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 599 00000100:00100000:1.0:1787119526.805770:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633722496:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119526.805863:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633722496:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 93us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.805871:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 599 00000100:00080000:3.0:1787119526.806006:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119526.806492:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633722112 00000100:00100000:0.0:1787119526.806500:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633722112 00000100:00100000:0.0:1787119526.806602:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633722368 00000100:00100000:0.0:1787119526.806606:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633722368 00000100:00100000:1.0:1787119526.806656:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 706 00000100:00100000:1.0:1787119526.806666:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633722112:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119526.806724:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633722112:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 60us (3969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.806732:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 706 00000100:00080000:3.0:1787119526.808566:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119526.808741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.808953:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633722624 00000100:00100000:3.0:1787119526.808964:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633722624 00002000:00100000:3.0:1787119526.809009:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a51282f800 x1873929633722624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.809021:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f800 with x1873929633722624 ext(385024->389119) 00010000:00010000:3.0:1787119526.809031:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.809060:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.809068:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282f800 00000100:00100000:3.0:1787119526.809099:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1412 00000100:00100000:3.0:1787119526.809109:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2375:x1873929633722624:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119526.809737:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2375:x1873929633722624:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 627us (997us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119526.809746:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1412 00002000:00100000:3.0:1787119526.809755:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a51282f800 x1873929633722624/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.809769:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282f800 with x1873929633722624 ext(385024->389119) 00010000:00010000:3.0:1787119526.809776:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.809805:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 52 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.809813:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282f800 00000100:00100000:0.0:1787119526.810012:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 707 00000100:00100000:0.0:1787119526.810022:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+17:2375:x1873929633722368:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119526.813367:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+17:2375:x1873929633722368:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 3329us (10521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.813393:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 707 00000100:00100000:0.0:1787119526.815983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.816077:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633722880 00000100:00100000:1.0:1787119526.816086:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633722880 00000100:00100000:1.0:1787119526.816174:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5612 00000100:00100000:1.0:1787119526.816182:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633722880:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119526.816198:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119526.816213:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d1a expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.816240:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 262) 00010000:00010000:1.0:1787119526.816246:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.816251:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 262) 00010000:00010000:1.0:1787119526.816255:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 53 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.816288:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.816296:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 53 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.816305:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:1.0:1787119526.816348:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:33946:x1873929633722880:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 167us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.816355:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5612 00000100:00100000:3.0:1787119526.816839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.816916:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633722752 00000100:00100000:0.0:1787119526.816921:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633722752 00010000:00010000:0.0:1787119526.816957:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 53 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.817025:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5650 00000100:00100000:0.0:1787119526.817034:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:2376:x1873929633722752:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.817046:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.817068:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 53 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.817092:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 53 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.817115:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d0c expref: 53 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.817135:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 262) 00010000:00010000:0.0:1787119526.817140:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 262) 00010000:00010000:0.0:1787119526.817149:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.817158:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.817186:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.817202:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 55 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.817216:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653692544:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.817285:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.819674:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653692544:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.819699:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119526.819867:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633722752:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2832us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.819878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5650 00000100:00100000:1.0:1787119526.821987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.822305:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633723008 00000100:00100000:0.0:1787119526.822315:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633723008 00002000:00100000:1.0:1787119526.822529:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (385024->409599) req@ffff92a51282e300 x1873929633723008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.822540:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e300 with x1873929633723008 ext(385024->409599) 00010000:00010000:1.0:1787119526.822550:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.822580:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.822588:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282e300 00000100:00100000:1.0:1787119526.822668:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1413 00000100:00100000:1.0:1787119526.822680:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633723008:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.827670:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633723008:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4982us (5680us total) trans 0 rc 24576/24576 00000100:00100000:2.0:1787119526.827683:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1413 00002000:00100000:2.0:1787119526.827696:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (385024->409599) req@ffff92a51282e300 x1873929633723008/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 24576/24576 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.827706:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282e300 with x1873929633723008 ext(385024->409599) 00010000:00010000:2.0:1787119526.827716:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.827745:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.827759:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282e300 00000100:00100000:3.0:1787119526.830573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.830736:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633723136 00000100:00100000:2.0:1787119526.830750:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633723136 00000100:00100000:2.0:1787119526.830817:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5613 00000100:00100000:2.0:1787119526.830827:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633723136:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.830854:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.830872:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d21 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.830903:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 262) 00010000:00010000:2.0:1787119526.830911:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.830918:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 262) 00010000:00010000:2.0:1787119526.830923:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.830973:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.830987:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.830998:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894400, rc 0) 00000100:00100000:2.0:1787119526.831058:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633723136:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 232us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.831066:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5613 00000100:00100000:3.0:1787119526.833108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.833209:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633723264 00000100:00100000:0.0:1787119526.833218:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633723264 00010000:00010000:0.0:1787119526.833251:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 57 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.833290:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5651 00000100:00100000:0.0:1787119526.833298:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2374:x1873929633723264:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.833315:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.833338:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 57 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.833364:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 57 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.833391:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e467a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d13 expref: 57 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.833412:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 262) 00010000:00010000:0.0:1787119526.833416:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 262) 00010000:00010000:0.0:1787119526.833425:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.833434:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.833519:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.833534:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 51 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.833548:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653692800:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.833635:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.839346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.839540:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633723392 00000100:00100000:3.0:1787119526.839550:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633723392 00010000:00010000:3.0:1787119526.839591:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.839636:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5652 00000100:00100000:3.0:1787119526.839645:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2375:x1873929633723392:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119526.839661:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119526.839683:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.839708:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.839742:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 262) 00010000:00010000:3.0:1787119526.839747:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 262) 00010000:00010000:3.0:1787119526.839756:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.839766:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.839815:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.839829:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653692928:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119526.840032:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6105689c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787119526.840128:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d1a expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.840143:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653692800:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.840161:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.840185:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2374:x1873929633723264:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6887us (7085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.840192:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5651 00000100:00100000:1.0:1787119526.843735:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653692928:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.843761:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119526.843829:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:2375:x1873929633723392:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4184us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.843848:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5652 00000100:00100000:1.0:1787119526.850918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.851045:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633723520 00000100:00100000:0.0:1787119526.851056:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633723520 00000100:00100000:0.0:1787119526.851215:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5614 00000100:00100000:0.0:1787119526.851225:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+51:33946:x1873929633723520:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.851243:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.851261:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d28 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.851293:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.851303:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 262) 00010000:00010000:0.0:1787119526.851307:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 262) 00010000:00010000:0.0:1787119526.851312:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.851341:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.851365:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 55 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.851378:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653693056:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119526.851525:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.855157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.855254:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633723648 00000100:00100000:2.0:1787119526.855264:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633723648 00010000:00010000:2.0:1787119526.855304:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.855348:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5653 00000100:00100000:2.0:1787119526.855358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2376:x1873929633723648:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119526.855373:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119526.855396:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.855422:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.855486:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 262) 00010000:00010000:2.0:1787119526.855493:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 262) 00010000:00010000:2.0:1787119526.855503:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.855514:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.855555:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.855576:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653693184:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119526.855652:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6088b6900 going to sleep for 11 seconds 00010000:00010000:1.0:1787119526.856005:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4688 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d21 expref: 56 pid: 12469 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.856025:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653693056:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119526.856052:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.856062:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:1.0:1787119526.856121:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633723520:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4889us (5204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.856130:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5614 00000100:00100000:0.0:1787119526.858727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.858846:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633723776 00000100:00100000:2.0:1787119526.858856:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633723776 00000100:00100000:2.0:1787119526.858911:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5615 00000100:00100000:2.0:1787119526.858920:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633723776:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.858949:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.858970:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d2f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.859013:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.859022:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 262) 00010000:00010000:2.0:1787119526.859027:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 262) 00010000:00010000:2.0:1787119526.859032:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.859066:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 51 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.859090:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 51 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.859112:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653693312:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.859204:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61976d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.863179:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653693184:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.863207:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119526.863268:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2376:x1873929633723648:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7911us (8122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.863279:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5653 00000100:00100000:2.0:1787119526.863646:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653693312:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119526.863673:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.863695:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894a00, rc 0) 00000100:00100000:2.0:1787119526.863736:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633723776:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4817us (5017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.863744:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5615 00000100:00100000:3.0:1787119526.866542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.866786:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633723904 00000100:00100000:2.0:1787119526.866911:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633723904 00002000:00100000:2.0:1787119526.866977:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a509136680 x1873929633723904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.866989:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136680 with x1873929633723904 ext(385024->389119) 00010000:00010000:2.0:1787119526.866998:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.867029:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.867038:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509136680 00000100:00100000:2.0:1787119526.867073:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1414 00000100:00100000:2.0:1787119526.867083:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633723904:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.867337:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633723904:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 254us (805us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119526.867345:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1414 00002000:00100000:2.0:1787119526.867352:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a509136680 x1873929633723904/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.867360:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509136680 with x1873929633723904 ext(385024->389119) 00010000:00010000:2.0:1787119526.867366:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.867381:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.867388:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509136680 00000100:00100000:2.0:1787119526.871308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.871632:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633724032 00000100:00100000:0.0:1787119526.871644:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633724032 00010000:00010000:0.0:1787119526.871690:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.871731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5654 00000100:00100000:0.0:1787119526.871741:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2376:x1873929633724032:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119526.871757:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119526.871780:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.871816:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.871915:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e468f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d28 expref: 52 pid: 6695 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.871955:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 262) 00010000:00010000:0.0:1787119526.871961:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 262) 00010000:00010000:0.0:1787119526.871969:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.871979:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.872019:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119526.872033:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653693440:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119526.872309:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ebdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.875640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.875729:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633724160 00000100:00100000:1.0:1787119526.875739:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633724160 00000100:00100000:1.0:1787119526.875811:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5616 00000100:00100000:1.0:1787119526.875821:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633724160:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119526.875914:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119526.875947:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d36 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.875984:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.875995:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 262) 00010000:00010000:1.0:1787119526.876000:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 262) 00010000:00010000:1.0:1787119526.876005:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 53 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.876046:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.876074:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 55 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.876088:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653693568:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119526.876184:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.878539:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653693440:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119526.878567:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.878612:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:2376:x1873929633724032:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6872us (7315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.878623:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5654 00000100:00100000:1.0:1787119526.879916:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20843:1873929653693568:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119526.879965:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.879988:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:1.0:1787119526.880043:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633724160:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4223us (4413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.880052:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5616 00000100:00100000:2.0:1787119526.883698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119526.883776:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119526.883960:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633724288 00000100:00100000:1.0:1787119526.883971:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633724288 00002000:00100000:1.0:1787119526.884023:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (385024->409599) req@ffff92a519d1bb80 x1873929633724288/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.884035:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1bb80 with x1873929633724288 ext(385024->409599) 00010000:00010000:1.0:1787119526.884044:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 56 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.884079:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 56 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.884087:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1bb80 00000100:00100000:1.0:1787119526.884194:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1415 00000100:00100000:1.0:1787119526.884205:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633724288:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.890702:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633724288:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6486us (7000us total) trans 0 rc 24576/24576 00000100:00100000:1.0:1787119526.890716:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1415 00002000:00100000:1.0:1787119526.890730:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (385024->409599) req@ffff92a519d1bb80 x1873929633724288/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/440 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 24576/24576 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.890742:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d1bb80 with x1873929633724288 ext(385024->409599) 00010000:00010000:1.0:1787119526.890754:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 56 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.890786:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 56 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.890807:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d1bb80 00000100:00100000:2.0:1787119526.894641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.894763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.895290:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633724544 00000100:00100000:1.0:1787119526.895301:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633724544 00010000:00010000:1.0:1787119526.895341:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 56 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.895396:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5655 00000100:00100000:1.0:1787119526.895406:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2376:x1873929633724544:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119526.895422:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119526.895466:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 56 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.895492:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 56 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.895519:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4696 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d2f expref: 56 pid: 6693 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.895540:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 262) 00010000:00010000:1.0:1787119526.895545:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 262) 00010000:00010000:1.0:1787119526.895554:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.895565:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.895605:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 51 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.895620:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653693696:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.895711:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.899243:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633724416 00000100:00100000:3.0:1787119526.899261:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633724416 00000100:00100000:1.0:1787119526.900158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.900284:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633724672 00000100:00100000:0.0:1787119526.900290:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633724672 00002000:00100000:0.0:1787119526.900338:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a51282d180 x1873929633724672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.900356:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d180 with x1873929633724672 ext(385024->389119) 00002000:00010000:0.0:1787119526.900362:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a51282d180 00000100:00100000:0.0:1787119526.900396:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10729 00000100:00100000:0.0:1787119526.900406:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2375:x1873929633724672:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.900748:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5617 00000100:00100000:2.0:1787119526.900756:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633724416:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.900767:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.900784:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d3d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.900823:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.900986:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 262) 00010000:00010000:2.0:1787119526.900992:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 262) 00010000:00010000:2.0:1787119526.900998:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.901034:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.901060:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.901075:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653693824:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119526.901291:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653693696:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119526.901314:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119526.901376:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2375:x1873929633724672:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 970us (1222us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119526.901396:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10729 00002000:00100000:0.0:1787119526.901404:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a51282d180 x1873929633724672/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119526.901413:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282d180 with x1873929633724672 ext(385024->389119) 00010000:00010000:0.0:1787119526.901421:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.901464:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119526.901472:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282d180 00000100:00100000:2.0:1787119526.901764:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61976d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.901996:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2376:x1873929633724544:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6591us (7231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.902006:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5655 00000100:00100000:1.0:1787119526.907169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.907300:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633724800 00000100:00100000:3.0:1787119526.907310:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633724800 00002000:00100000:3.0:1787119526.907360:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff92a51282c700 x1873929633724800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.907378:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c700 with x1873929633724800 ext(389120->393215) 00010000:00010000:3.0:1787119526.907387:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.907418:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.907426:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282c700 00000100:00100000:3.0:1787119526.907480:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1416 00000100:00100000:3.0:1787119526.907491:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2374:x1873929633724800:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119526.907669:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a51282c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:2374:x1873929633724800:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 179us (509us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119526.907676:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1416 00002000:00100000:3.0:1787119526.907683:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff92a51282c700 x1873929633724800/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.907692:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a51282c700 with x1873929633724800 ext(389120->393215) 00010000:00010000:3.0:1787119526.907697:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.907711:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 52 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.907718:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a51282c700 00000100:00100000:3.0:1787119526.909242:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653693824:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119526.909279:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 56 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.909301:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895800, rc 0) 00000100:00100000:3.0:1787119526.909341:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633724416:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8586us (14711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.909350:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5617 00000100:00100000:2.0:1787119526.913707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.913751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.913841:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633725056 00000100:00100000:0.0:1787119526.913851:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633725056 00000100:00100000:0.0:1787119526.913905:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5618 00000100:00100000:0.0:1787119526.913914:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+52:33946:x1873929633725056:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119526.913941:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119526.913961:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d44 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.913996:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 262) 00010000:00010000:0.0:1787119526.914001:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 262) 00010000:00010000:0.0:1787119526.914008:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 53 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.914020:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 53 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119526.914034:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119526.914090:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:33946:x1873929633725056:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 177us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119526.914097:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5618 00000100:00100000:3.0:1787119526.914686:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633724928 00000100:00100000:3.0:1787119526.914692:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633724928 00002000:00100000:3.0:1787119526.914724:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a509231880 x1873929633724928/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 4584/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.914735:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633724928 ext(385024->389119) 00010000:00010000:3.0:1787119526.914742:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 53 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.914770:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 53 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.914776:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231880 00000100:00100000:3.0:1787119526.914815:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1417 00000100:00100000:3.0:1787119526.914823:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+53:2376:x1873929633724928:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119526.915351:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:2376:x1873929633724928:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 526us (1596us total) trans 4294969271 rc 0/0 00000100:00100000:3.0:1787119526.915359:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1417 00002000:00100000:3.0:1787119526.915366:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a509231880 x1873929633724928/t4294969271(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 4584/448 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119526.915374:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633724928 ext(385024->389119) 00010000:00010000:3.0:1787119526.915380:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 55 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.915394:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 55 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119526.915401:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231880 00000100:00100000:0.0:1787119526.919364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.920098:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633725184 00000100:00100000:1.0:1787119526.920110:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633725184 00010000:00010000:1.0:1787119526.920224:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 55 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.920308:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5656 00000100:00100000:1.0:1787119526.920320:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:2376:x1873929633725184:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119526.920338:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119526.920364:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 55 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.920390:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 55 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.920417:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e469d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [385024->33939455] (req 385024->389119) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d36 expref: 55 pid: 20843 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.920436:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 262) 00010000:00010000:1.0:1787119526.920484:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 262) 00010000:00010000:1.0:1787119526.920492:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.920502:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.920512:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 262) 00010000:00010000:1.0:1787119526.920515:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 262) 00010000:00010000:1.0:1787119526.920519:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.920527:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.920567:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.920583:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653693952:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.920740:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.920750:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653694080:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.920775:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.925721:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a51282dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653693952:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119526.925741:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653694080:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119526.925770:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119526.925843:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:2376:x1873929633725184:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5525us (6489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.925854:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5656 00000100:00100000:0.0:1787119526.943074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.943122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.943241:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633725440 00000100:00100000:2.0:1787119526.943252:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633725440 00002000:00100000:2.0:1787119526.943296:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a511f57100 x1873929633725440/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.943308:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57100 with x1873929633725440 ext(385024->389119) 00002000:00010000:2.0:1787119526.943313:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57100 00000100:00100000:2.0:1787119526.943340:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633725312 00000100:00100000:2.0:1787119526.943343:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633725312 00002000:00100000:2.0:1787119526.943356:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff92a508ffc380 x1873929633725312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.943365:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc380 with x1873929633725312 ext(389120->393215) 00002000:00010000:2.0:1787119526.943368:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffc380 00000100:00100000:2.0:1787119526.943392:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10730 00000100:00100000:2.0:1787119526.943401:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2376:x1873929633725440:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.943624:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2376:x1873929633725440:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 223us (558us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119526.943631:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10730 00002000:00100000:2.0:1787119526.943638:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff92a511f57100 x1873929633725440/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.943646:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57100 with x1873929633725440 ext(385024->389119) 00002000:00010000:2.0:1787119526.943650:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511f57100 00000100:00100000:2.0:1787119526.943668:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10731 00000100:00100000:2.0:1787119526.943675:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:2376:x1873929633725312:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.943766:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:2376:x1873929633725312:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 90us (650us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119526.943772:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10731 00002000:00100000:2.0:1787119526.943778:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff92a508ffc380 x1873929633725312/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.943785:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc380 with x1873929633725312 ext(389120->393215) 00002000:00010000:2.0:1787119526.943803:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffc380 00000100:00100000:0.0:1787119526.953910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119526.953967:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.954132:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633725568 00000100:00100000:2.0:1787119526.954142:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633725568 00000100:00100000:2.0:1787119526.954198:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5619 00000100:00100000:2.0:1787119526.954206:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633725568:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.954223:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.954241:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d4b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.954275:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 53 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.954285:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(70 262) 00010000:00010000:2.0:1787119526.954289:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 262) 00010000:00010000:2.0:1787119526.954294:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.954330:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 53 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.954355:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 53 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.954376:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653694208:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.954493:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119526.954734:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633725696 00000100:00100000:1.0:1787119526.954740:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633725696 00002000:00100000:1.0:1787119526.954772:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a511633b80 x1873929633725696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.954782:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633b80 with x1873929633725696 ext(393216->397311) 00010000:00010000:1.0:1787119526.954789:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 54 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.954805:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 54 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.954812:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633b80 00000100:00100000:1.0:1787119526.954847:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1418 00000100:00100000:1.0:1787119526.954855:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:2376:x1873929633725696:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.955096:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:2376:x1873929633725696:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 240us (1126us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119526.955103:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1418 00002000:00100000:1.0:1787119526.955119:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a511633b80 x1873929633725696/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.955127:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633b80 with x1873929633725696 ext(393216->397311) 00010000:00010000:1.0:1787119526.955133:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 54 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.955146:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 54 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.955152:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511633b80 00000100:00100000:3.0:1787119526.959432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.959533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.959647:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653694208:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119526.959686:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.959711:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894e00, rc 0) 00000100:00100000:2.0:1787119526.959768:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633725568:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5561us (5870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.959777:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5619 00000100:00100000:2.0:1787119526.959812:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633725952 00000100:00100000:2.0:1787119526.959818:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633725952 00000100:00100000:2.0:1787119526.959867:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5620 00000100:00100000:2.0:1787119526.959875:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+54:33946:x1873929633725952:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.959888:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.959904:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d52 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.959940:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 262) 00010000:00010000:2.0:1787119526.959945:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 262) 00010000:00010000:2.0:1787119526.959951:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.959962:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.959971:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894000, rc 0) 00000100:00100000:2.0:1787119526.959991:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:33946:x1873929633725952:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 117us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.959997:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5620 00000100:00100000:1.0:1787119526.960623:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633725824 00000100:00100000:1.0:1787119526.960630:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633725824 00002000:00100000:1.0:1787119526.960662:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff92a509135180 x1873929633725824/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 4584/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.960679:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135180 with x1873929633725824 ext(389120->393215) 00010000:00010000:1.0:1787119526.960686:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 55 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.960710:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 55 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.960717:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509135180 00000100:00100000:1.0:1787119526.960745:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1419 00000100:00100000:1.0:1787119526.960753:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:2376:x1873929633725824:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119526.961188:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2376:x1873929633725824:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 435us (1766us total) trans 4294969272 rc 0/0 00000100:00100000:1.0:1787119526.961196:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1419 00002000:00100000:1.0:1787119526.961203:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff92a509135180 x1873929633725824/t4294969272(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:562/0 lens 4584/448 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.961210:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135180 with x1873929633725824 ext(389120->393215) 00010000:00010000:1.0:1787119526.961216:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.961231:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119526.961239:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509135180 00000100:00100000:0.0:1787119526.969080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.969246:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633726080 00000100:00100000:2.0:1787119526.969258:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633726080 00010000:00010000:2.0:1787119526.969301:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.969344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5657 00000100:00100000:2.0:1787119526.969353:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2375:x1873929633726080:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119526.969371:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119526.969396:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.969424:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.969494:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e46ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [389120->33943551] (req 389120->393215) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d44 expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.969516:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 262) 00010000:00010000:2.0:1787119526.969521:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 262) 00010000:00010000:2.0:1787119526.969530:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.969541:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.969550:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 262) 00010000:00010000:2.0:1787119526.969552:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 262) 00010000:00010000:2.0:1787119526.969557:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.969566:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.969601:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.969618:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653694336:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119526.969719:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.969729:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653694464:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119526.969759:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119526.972815:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653694336:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119526.972841:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653694464:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119526.972873:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119526.973061:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633726080:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3708us (3990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.973073:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5657 00000100:00100000:3.0:1787119526.976810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.977026:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633726208 00000100:00100000:1.0:1787119526.977036:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633726208 00002000:00100000:1.0:1787119526.977082:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff92a509135c00 x1873929633726208/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.977094:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135c00 with x1873929633726208 ext(389120->393215) 00002000:00010000:1.0:1787119526.977100:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135c00 00000100:00100000:1.0:1787119526.977144:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10732 00000100:00100000:1.0:1787119526.977154:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2375:x1873929633726208:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119526.977363:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2375:x1873929633726208:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 209us (563us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119526.977370:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10732 00002000:00100000:1.0:1787119526.977377:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff92a509135c00 x1873929633726208/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/4536 e 0 to 0 dl 1787119537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119526.977386:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135c00 with x1873929633726208 ext(389120->393215) 00002000:00010000:1.0:1787119526.977390:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509135c00 00000100:00100000:0.0:1787119526.980105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119526.980486:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633726336 00000100:00100000:3.0:1787119526.980495:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633726336 00000100:00100000:3.0:1787119526.980545:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5621 00000100:00100000:3.0:1787119526.980555:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633726336:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119526.980573:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119526.980592:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d59 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.980626:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.980637:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 262) 00010000:00010000:3.0:1787119526.980641:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 262) 00010000:00010000:3.0:1787119526.980647:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.980683:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.980709:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 55 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119526.980724:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653694592:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119526.980818:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119526.983773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.983904:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653694592:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119526.983954:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.983984:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84400, rc 0) 00000100:00100000:2.0:1787119526.984051:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633726336:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3497us (3955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119526.984060:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5621 00000100:00100000:1.0:1787119526.984535:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633726464 00000100:00100000:1.0:1787119526.984542:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633726464 00010000:00010000:1.0:1787119526.984574:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.984611:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5658 00000100:00100000:1.0:1787119526.984621:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633726464:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119526.984634:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119526.984658:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.984685:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.984711:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e46b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d52 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.984729:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 262) 00010000:00010000:1.0:1787119526.984735:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 262) 00010000:00010000:1.0:1787119526.984743:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.984754:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119526.985107:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119526.985123:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653694720:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119526.985246:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.989345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119526.991746:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653694720:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119526.991777:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119526.992090:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:2376:x1873929633726464:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7468us (8324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119526.992102:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5658 00000100:00100000:2.0:1787119526.992760:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633726592 00000100:00100000:2.0:1787119526.992771:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633726592 00000100:00100000:2.0:1787119526.992839:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5622 00000100:00100000:2.0:1787119526.992850:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:33946:x1873929633726592:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119526.992867:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119526.992888:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d60 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.992934:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.992946:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 262) 00010000:00010000:2.0:1787119526.992950:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 262) 00010000:00010000:2.0:1787119526.992955:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 56 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.992995:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.993020:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 57 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119526.993036:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653694848:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119526.993105:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119526.993674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119526.995670:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633726720 00000100:00100000:2.0:1787119526.995684:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633726720 00002000:00100000:2.0:1787119526.995739:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a50512e680 x1873929633726720/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/0 e 0 to 0 dl 1787119537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.995750:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512e680 with x1873929633726720 ext(393216->409599) 00010000:00010000:2.0:1787119526.995759:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.995909:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.995919:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512e680 00000100:00100000:2.0:1787119526.996011:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1420 00000100:00100000:2.0:1787119526.996021:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2373:x1873929633726720:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119526.996317:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2373:x1873929633726720:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 296us (2644us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787119526.996326:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1420 00002000:00100000:2.0:1787119526.996333:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a50512e680 x1873929633726720/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:562/0 lens 488/16824 e 0 to 0 dl 1787119537 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119526.996341:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a50512e680 with x1873929633726720 ext(393216->409599) 00010000:00010000:2.0:1787119526.996347:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119526.996360:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119526.996367:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a50512e680 00000100:00100000:3.0:1787119526.996922:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653694848:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119526.996965:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 56 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119526.996983:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894a00, rc 0) 00000100:00100000:3.0:1787119526.997012:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a50512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633726592:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4164us (7678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119526.997018:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5622 00000100:00100000:3.0:1787119527.001003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.001053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.001082:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633726976 00000100:00100000:3.0:1787119527.001092:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633726976 00010000:00010000:3.0:1787119527.001321:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.001376:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5659 00000100:00100000:3.0:1787119527.001387:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633726976:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.001405:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119527.001431:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.001489:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.001517:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e46c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d59 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.001537:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 262) 00010000:00010000:3.0:1787119527.001542:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 262) 00010000:00010000:3.0:1787119527.001553:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.001564:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.001606:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.001622:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509135500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653694976:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.001702:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6105689c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.004817:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633726848 00000100:00100000:3.0:1787119527.004835:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633726848 00000100:00100000:3.0:1787119527.004882:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5623 00000100:00100000:3.0:1787119527.004890:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633726848:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.004908:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.004936:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d67 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.004970:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.004984:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 262) 00010000:00010000:3.0:1787119527.004989:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 262) 00010000:00010000:3.0:1787119527.004994:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 59 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.005027:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.005052:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 55 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.005067:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653695104:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119527.005348:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.007615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.007702:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633727104 00000100:00100000:3.0:1787119527.007711:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633727104 00002000:00100000:3.0:1787119527.007761:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a6181aed80 x1873929633727104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.007773:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aed80 with x1873929633727104 ext(393216->397311) 00010000:00010000:3.0:1787119527.007782:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.007953:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.007962:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6181aed80 00000100:00100000:3.0:1787119527.008072:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1421 00000100:00100000:3.0:1787119527.008083:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633727104:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119527.008391:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633727104:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 310us (787us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119527.008400:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1421 00002000:00100000:3.0:1787119527.008407:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a6181aed80 x1873929633727104/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.008417:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181aed80 with x1873929633727104 ext(393216->397311) 00010000:00010000:3.0:1787119527.008423:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.008476:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.008489:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6181aed80 00000100:00100000:3.0:1787119527.008537:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653695104:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119527.008563:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 59 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.008583:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:3.0:1787119527.008611:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33957:x1873929633726848:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3722us (7620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.008619:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5623 00000100:00100000:3.0:1787119527.011807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.012011:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633727232 00000100:00100000:1.0:1787119527.012021:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633727232 00000100:00100000:1.0:1787119527.012081:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5624 00000100:00100000:1.0:1787119527.012091:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633727232:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119527.012377:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119527.012401:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d6e expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.012454:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 262) 00010000:00010000:1.0:1787119527.012464:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.012472:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 262) 00010000:00010000:1.0:1787119527.012477:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 57 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.012517:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.012531:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 57 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.012545:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:1.0:1787119527.012596:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633727232:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 506us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.012607:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5624 00000100:00100000:0.0:1787119527.013955:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509135500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653694976:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.014038:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.014152:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633726976:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12766us (13098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.014168:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5659 00000100:00100000:2.0:1787119527.018181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.018286:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633727360 00000100:00100000:0.0:1787119527.018297:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633727360 00010000:00010000:0.0:1787119527.018337:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.018419:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5660 00000100:00100000:0.0:1787119527.018431:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2375:x1873929633727360:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.018474:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.018499:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.018524:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.018551:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e46c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d60 expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.018573:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 262) 00010000:00010000:0.0:1787119527.018579:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 262) 00010000:00010000:0.0:1787119527.018588:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.018598:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.018645:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.018662:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 57 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.018676:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653695360:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.018769:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.022962:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653695360:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.022991:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.023053:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633727360:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4623us (4942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.023064:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5660 00000100:00100000:3.0:1787119527.024253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.024468:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633727488 00000100:00100000:1.0:1787119527.024478:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633727488 00010000:00010000:1.0:1787119527.024523:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.024558:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5661 00000100:00100000:1.0:1787119527.024568:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633727488:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.024584:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.024610:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.024639:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.024669:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e46ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d67 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.024686:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 262) 00010000:00010000:1.0:1787119527.024691:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 262) 00010000:00010000:1.0:1787119527.024700:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.024710:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.024752:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.024766:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653695488:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.024853:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.028848:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653695488:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.028876:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.028941:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2376:x1873929633727488:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4373us (4692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.028952:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5661 00000100:00100000:3.0:1787119527.034369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.034486:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633727616 00000100:00100000:2.0:1787119527.034496:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633727616 00000100:00100000:2.0:1787119527.034559:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5625 00000100:00100000:2.0:1787119527.034570:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633727616:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.034590:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.034611:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d75 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.034656:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.034667:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 262) 00010000:00010000:2.0:1787119527.034671:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 262) 00010000:00010000:2.0:1787119527.034677:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.034713:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.034739:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 55 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.034754:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653695616:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.034840:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.038072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.038215:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653695616:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119527.038259:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.038285:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895c00, rc 0) 00000100:00100000:2.0:1787119527.038357:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633727616:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3789us (3999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.038370:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5625 00000100:00100000:0.0:1787119527.040938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633727744 00000100:00100000:0.0:1787119527.040953:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633727744 00010000:00010000:0.0:1787119527.041013:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 56 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.041063:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5662 00000100:00100000:0.0:1787119527.041073:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633727744:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.041534:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.041562:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 56 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.041600:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 56 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.041626:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e46d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d6e expref: 56 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.041653:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 262) 00010000:00010000:0.0:1787119527.041658:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 262) 00010000:00010000:0.0:1787119527.041667:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.041679:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.041721:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.041738:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653695744:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.041942:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60983ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.043324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.046370:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633727872 00000100:00100000:0.0:1787119527.046386:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633727872 00000100:00100000:0.0:1787119527.046486:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5626 00000100:00100000:0.0:1787119527.046497:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633727872:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.046516:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.046538:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d7c expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.046573:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.046583:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 262) 00010000:00010000:0.0:1787119527.046588:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 262) 00010000:00010000:0.0:1787119527.046594:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.046628:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.046666:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 57 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.046682:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653695872:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.046762:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.049994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.050083:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653695872:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119527.050130:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.050157:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:3.0:1787119527.050252:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653695744:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.050266:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.050330:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633728000 00000100:00100000:2.0:1787119527.050337:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633728000 00002000:00100000:2.0:1787119527.050386:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a63dc07480 x1873929633728000/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.050397:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07480 with x1873929633728000 ext(393216->409599) 00010000:00010000:2.0:1787119527.050407:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.050435:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.050459:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc07480 00000100:00100000:2.0:1787119527.050485:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1422 00000100:00100000:2.0:1787119527.050495:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633728000:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119527.050999:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633727872:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4502us (7681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.051009:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5626 00000100:00100000:3.0:1787119527.051514:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633727744:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10442us (13449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.051524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5662 00000100:00100000:2.0:1787119527.051687:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633728000:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1192us (1712us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787119527.051695:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1422 00002000:00100000:2.0:1787119527.051703:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a63dc07480 x1873929633728000/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.051713:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07480 with x1873929633728000 ext(393216->409599) 00010000:00010000:2.0:1787119527.051721:0:18546:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.051745:0:18546:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.051754:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc07480 00000100:00100000:1.0:1787119527.057175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.057223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.057387:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633728128 00000100:00100000:2.0:1787119527.057397:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633728128 00000100:00100000:2.0:1787119527.057470:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5627 00000100:00100000:2.0:1787119527.057481:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633728128:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.057499:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.057517:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d83 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.057551:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 262) 00010000:00010000:2.0:1787119527.057559:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.057566:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 262) 00010000:00010000:2.0:1787119527.057571:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 59 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.057609:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.057625:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 59 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.057638:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895400, rc 0) 00000100:00100000:2.0:1787119527.057690:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33957:x1873929633728128:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 210us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.057698:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5627 00000100:00100000:0.0:1787119527.058846:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633728256 00000100:00100000:0.0:1787119527.058854:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633728256 00010000:00010000:0.0:1787119527.058889:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.058987:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5663 00000100:00100000:0.0:1787119527.058997:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633728256:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.059011:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.059036:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.059066:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.059090:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e46dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d75 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.059119:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 262) 00010000:00010000:0.0:1787119527.059125:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 262) 00010000:00010000:0.0:1787119527.059134:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.059145:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.059186:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.059200:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 55 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.059214:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653696128:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.059293:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.062581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.062711:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633728384 00000100:00100000:3.0:1787119527.062722:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633728384 00002000:00100000:3.0:1787119527.062772:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a508cfc000 x1873929633728384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.062784:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc000 with x1873929633728384 ext(393216->397311) 00010000:00010000:3.0:1787119527.062800:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.062829:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.062837:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfc000 00000100:00100000:3.0:1787119527.062871:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1423 00000100:00100000:3.0:1787119527.062882:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633728384:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119527.063252:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633728384:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 371us (680us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119527.063262:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1423 00002000:00100000:3.0:1787119527.063269:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a508cfc000 x1873929633728384/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.063278:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508cfc000 with x1873929633728384 ext(393216->397311) 00010000:00010000:3.0:1787119527.063284:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.063299:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.063306:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508cfc000 00000100:00100000:0.0:1787119527.063913:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653696128:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.063956:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.064285:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633728256:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5288us (7060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.064295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5663 00000100:00100000:1.0:1787119527.067431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.067509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.067603:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633728512 00000100:00100000:3.0:1787119527.067613:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633728512 00000100:00100000:3.0:1787119527.067671:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5628 00000100:00100000:3.0:1787119527.067681:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633728512:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.067700:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.067720:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d8a expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.067752:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 262) 00010000:00010000:3.0:1787119527.067760:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.067768:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 262) 00010000:00010000:3.0:1787119527.067773:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 57 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.067824:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.067839:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 57 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.067852:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:3.0:1787119527.067905:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633728512:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 224us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.067912:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5628 00000100:00100000:2.0:1787119527.069419:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633728640 00000100:00100000:2.0:1787119527.069430:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633728640 00010000:00010000:2.0:1787119527.069477:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.069537:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5664 00000100:00100000:3.0:1787119527.069548:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2375:x1873929633728640:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.069565:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119527.069591:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.069619:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.069642:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d7c expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.069659:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 262) 00010000:00010000:3.0:1787119527.069664:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 262) 00010000:00010000:3.0:1787119527.069673:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.069684:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.069716:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.069731:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 57 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.069745:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653696384:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.069836:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.072141:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653696384:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.072171:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119527.072227:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633728640:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2680us (4716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.072238:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5664 00000100:00100000:3.0:1787119527.075092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.075249:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633728768 00000100:00100000:0.0:1787119527.075260:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633728768 00010000:00010000:0.0:1787119527.075300:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.075342:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5665 00000100:00100000:0.0:1787119527.075351:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633728768:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.075366:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.075390:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.075423:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.075468:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e46ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d83 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.075487:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 262) 00010000:00010000:0.0:1787119527.075492:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 262) 00010000:00010000:0.0:1787119527.075500:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.075511:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.075617:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.075629:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653696512:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.075701:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.078038:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653696512:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.078061:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.078105:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2375:x1873929633728768:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2755us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.078115:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5665 00000100:00100000:1.0:1787119527.088311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.088422:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633728896 00000100:00100000:2.0:1787119527.088434:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633728896 00000100:00100000:2.0:1787119527.088528:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5629 00000100:00100000:2.0:1787119527.088538:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633728896:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.088558:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.088581:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d91 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.088615:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.088625:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 262) 00010000:00010000:2.0:1787119527.088630:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 262) 00010000:00010000:2.0:1787119527.088636:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.088671:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 55 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.088698:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 55 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.088714:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653696640:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.088810:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.102322:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653696640:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119527.102368:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.102390:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895600, rc 0) 00000100:00100000:2.0:1787119527.102490:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633728896:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13952us (14188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.102499:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5629 00000100:00100000:3.0:1787119527.103951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.104061:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633729152 00000100:00100000:0.0:1787119527.104071:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633729152 00000100:00100000:0.0:1787119527.104139:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5630 00000100:00100000:0.0:1787119527.104149:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633729152:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.104165:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.104185:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d98 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.104213:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 262) 00010000:00010000:0.0:1787119527.104221:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.104228:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 262) 00010000:00010000:0.0:1787119527.104232:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.104268:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.104283:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.104295:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119527.104349:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633729152:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 201us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.104356:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5630 00000100:00100000:1.0:1787119527.106186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.106273:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633729024 00000100:00100000:0.0:1787119527.106281:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633729024 00010000:00010000:0.0:1787119527.106313:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 57 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.106350:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5666 00000100:00100000:0.0:1787119527.106361:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a61948f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2376:x1873929633729024:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.106374:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.106396:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 57 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.106421:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 57 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.106481:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e46f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d8a expref: 57 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.106498:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 262) 00010000:00010000:0.0:1787119527.106503:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 262) 00010000:00010000:0.0:1787119527.106511:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.106522:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.106559:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.106576:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 57 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.106590:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653696896:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.106673:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6028a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.110992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.111100:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653696896:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.111142:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.111201:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a61948f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633729024:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4841us (5021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.111212:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5666 00000100:00100000:1.0:1787119527.111324:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633729280 00000100:00100000:1.0:1787119527.111332:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633729280 00002000:00100000:1.0:1787119527.111379:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a509134a80 x1873929633729280/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.111390:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134a80 with x1873929633729280 ext(393216->409599) 00010000:00010000:1.0:1787119527.111399:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.111434:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.111482:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509134a80 00000100:00100000:1.0:1787119527.111504:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1424 00000100:00100000:1.0:1787119527.111513:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633729280:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.111762:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633729280:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 249us (789us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1787119527.111769:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1424 00002000:00100000:1.0:1787119527.111775:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a509134a80 x1873929633729280/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.111783:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134a80 with x1873929633729280 ext(393216->409599) 00010000:00010000:1.0:1787119527.111788:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.111801:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.111808:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509134a80 00000100:00100000:3.0:1787119527.117705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.117763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.117919:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633729536 00000100:00100000:2.0:1787119527.117939:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633729536 00010000:00010000:2.0:1787119527.117997:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.118047:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5667 00000100:00100000:2.0:1787119527.118056:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633729536:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.118070:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.118100:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.118135:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.118164:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e46f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d91 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.118183:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 262) 00010000:00010000:2.0:1787119527.118189:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 262) 00010000:00010000:2.0:1787119527.118197:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.118208:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.118245:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.118270:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653697024:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.118375:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.118914:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633729408 00000100:00100000:1.0:1787119527.118930:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633729408 00000100:00100000:1.0:1787119527.118976:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5631 00000100:00100000:1.0:1787119527.118984:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633729408:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119527.119002:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119527.119017:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716d9f expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.119040:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.119049:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 262) 00010000:00010000:1.0:1787119527.119053:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 262) 00010000:00010000:1.0:1787119527.119058:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 59 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.119083:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 55 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.119102:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 55 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.119113:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653697152:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119527.119168:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.123268:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653697024:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.123301:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.123360:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633729536:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5304us (5596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.123372:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5667 00000100:00100000:1.0:1787119527.123853:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653697152:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119527.123880:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.123902:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:1.0:1787119527.123958:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633729408:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4974us (6269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.123966:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5631 00000100:00100000:3.0:1787119527.126826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.126961:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633729664 00000100:00100000:2.0:1787119527.126971:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633729664 00002000:00100000:2.0:1787119527.127022:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509135500 x1873929633729664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.127034:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135500 with x1873929633729664 ext(393216->397311) 00010000:00010000:2.0:1787119527.127043:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.127074:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.127083:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509135500 00000100:00100000:2.0:1787119527.127127:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1425 00000100:00100000:2.0:1787119527.127137:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633729664:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119527.127404:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633729664:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 267us (593us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119527.127417:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1425 00002000:00100000:2.0:1787119527.127425:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509135500 x1873929633729664/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.127432:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509135500 with x1873929633729664 ext(393216->397311) 00010000:00010000:2.0:1787119527.127484:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.127506:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.127514:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509135500 00000100:00100000:2.0:1787119527.134212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.134299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.134373:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633729920 00000100:00100000:3.0:1787119527.134384:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633729920 00010000:00010000:3.0:1787119527.134426:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.134491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5668 00000100:00100000:3.0:1787119527.134502:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633729920:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.134516:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119527.134539:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.134566:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.134598:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e46ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d98 expref: 56 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.134617:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 262) 00010000:00010000:3.0:1787119527.134622:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 262) 00010000:00010000:3.0:1787119527.134630:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.134640:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.134680:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.134694:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653697280:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.134771:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a610568240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.138014:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653697280:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.138043:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.138098:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:2376:x1873929633729920:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3597us (3797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.138118:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5668 00000100:00100000:0.0:1787119527.140803:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633729792 00000100:00100000:0.0:1787119527.140820:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633729792 00000100:00100000:0.0:1787119527.140888:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5632 00000100:00100000:0.0:1787119527.140899:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:33946:x1873929633729792:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.140917:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.140953:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716da6 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.140998:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.141008:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 262) 00010000:00010000:0.0:1787119527.141013:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 262) 00010000:00010000:0.0:1787119527.141018:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.141057:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.141083:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.141098:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653697408:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.141198:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5056f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.146337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.146362:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633730048 00000100:00100000:0.0:1787119527.146370:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633730048 00010000:00010000:0.0:1787119527.146414:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.146477:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5669 00000100:00100000:0.0:1787119527.146487:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633730048:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.146502:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.146525:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.146552:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.146581:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 262) 00010000:00010000:0.0:1787119527.146587:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 262) 00010000:00010000:0.0:1787119527.146595:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.146603:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.146634:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.146643:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653697536:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.146706:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00010000:00010000:2.0:1787119527.146901:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4706 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716d9f expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.146912:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653697408:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119527.146948:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.146963:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:2.0:1787119527.147005:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633729792:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6108us (12805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.147013:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5632 00000100:00100000:0.0:1787119527.155747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.155960:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633730176 00000100:00100000:2.0:1787119527.155972:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633730176 00000100:00100000:2.0:1787119527.156033:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5633 00000100:00100000:2.0:1787119527.156043:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633730176:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.156063:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.156086:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716dad expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.156128:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.156140:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 262) 00010000:00010000:2.0:1787119527.156145:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 262) 00010000:00010000:2.0:1787119527.156150:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 59 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.156194:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.156219:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 55 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.156233:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653697664:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.156313:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6037783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.160061:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653697664:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119527.160102:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 59 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.160139:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895000, rc 0) 00000100:00100000:0.0:1787119527.160420:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33957:x1873929633730176:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4377us (4681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.160429:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5633 00000100:00100000:1.0:1787119527.160764:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653697536:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.160779:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.162095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.162137:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633730304 00000100:00100000:0.0:1787119527.162146:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633730304 00010000:00010000:0.0:1787119527.162182:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.162225:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5670 00000100:00100000:0.0:1787119527.162235:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633730304:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.162248:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.162273:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.162299:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.162326:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e470d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716da6 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.162343:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 262) 00010000:00010000:0.0:1787119527.162348:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 262) 00010000:00010000:0.0:1787119527.162357:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.162368:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.162405:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.162420:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653697792:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.162505:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999540 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.165014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.165047:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633730432 00000100:00100000:0.0:1787119527.165058:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633730432 00000100:00100000:0.0:1787119527.165127:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5634 00000100:00100000:0.0:1787119527.165137:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633730432:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.165156:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.165178:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716db4 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.165210:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.165220:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 262) 00010000:00010000:0.0:1787119527.165224:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 262) 00010000:00010000:0.0:1787119527.165230:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.165263:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.165288:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.165303:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653697920:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.165364:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.168100:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633730048:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 21605us (21761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.168127:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5669 00000100:00100000:1.0:1787119527.188057:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653697792:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.188093:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.188150:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2375:x1873929633730304:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 25916us (26060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.188160:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5670 00000100:00100000:1.0:1787119527.188234:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653697920:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119527.188260:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.188284:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:1.0:1787119527.188309:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633730432:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 23174us (23306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.188317:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5634 00000100:00100000:0.0:1787119527.196746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.196829:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633730560 00000100:00100000:1.0:1787119527.196840:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633730560 00002000:00100000:1.0:1787119527.196892:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a519d18380 x1873929633730560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.196910:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633730560 ext(393216->409599) 00010000:00010000:1.0:1787119527.196932:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.196962:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.196970:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d18380 00000100:00100000:1.0:1787119527.197004:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1426 00000100:00100000:1.0:1787119527.197014:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633730560:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.197300:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633730560:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 287us (564us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1787119527.197308:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1426 00002000:00100000:1.0:1787119527.197315:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a519d18380 x1873929633730560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.197324:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d18380 with x1873929633730560 ext(393216->409599) 00010000:00010000:1.0:1787119527.197330:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.197346:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.197354:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a519d18380 00000100:00100000:0.0:1787119527.210540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.210586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.210618:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633730816 00000100:00100000:0.0:1787119527.210627:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633730816 00010000:00010000:0.0:1787119527.210669:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.210708:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5671 00000100:00100000:0.0:1787119527.210718:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633730816:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.210734:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.210758:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.210797:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.210824:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4714 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dad expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.210842:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 262) 00010000:00010000:0.0:1787119527.210847:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 262) 00010000:00010000:0.0:1787119527.210856:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.210867:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.210911:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.210938:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653698048:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.211071:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633730688 00000100:00100000:3.0:1787119527.211076:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633730688 00000100:00100000:3.0:1787119527.211121:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5635 00000100:00100000:3.0:1787119527.211130:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633730688:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.211147:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.211163:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716dbb expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.211183:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.211191:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 262) 00010000:00010000:3.0:1787119527.211194:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 262) 00010000:00010000:3.0:1787119527.211198:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 59 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.211219:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.211234:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 55 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.211244:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653698176:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.211319:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.217986:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a620d32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.220011:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653698048:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.220041:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.220101:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633730816:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9383us (9513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.220125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5671 00000100:00100000:0.0:1787119527.220352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.220756:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633730944 00000100:00100000:2.0:1787119527.220765:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633730944 00002000:00100000:2.0:1787119527.222328:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a6068bc000 x1873929633730944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.222342:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633730944 ext(393216->397311) 00010000:00010000:2.0:1787119527.222355:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.222390:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.222400:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6068bc000 00000100:00100000:2.0:1787119527.222466:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1427 00000100:00100000:2.0:1787119527.222484:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633730944:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119527.223432:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633730944:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 951us (3074us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119527.223463:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1427 00002000:00100000:2.0:1787119527.223473:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a6068bc000 x1873929633730944/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.223483:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bc000 with x1873929633730944 ext(393216->397311) 00010000:00010000:2.0:1787119527.223492:0:18555:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.223515:0:18555:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.223523:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6068bc000 00000100:00100000:2.0:1787119527.233330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.233360:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633731072 00000100:00100000:2.0:1787119527.233369:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633731072 00000100:00100000:2.0:1787119527.233421:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5636 00000100:00100000:2.0:1787119527.233433:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633731072:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.233467:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.233487:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716dc2 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.233522:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 262) 00010000:00010000:2.0:1787119527.233533:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.233540:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 262) 00010000:00010000:2.0:1787119527.233546:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.233590:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.233605:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.233619:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895e00, rc 0) 00000100:00100000:2.0:1787119527.233673:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633731072:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 242us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.233680:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5636 00000100:00100000:2.0:1787119527.234945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.235535:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633731200 00000100:00100000:0.0:1787119527.235548:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633731200 00010000:00010000:0.0:1787119527.235589:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 57 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.235631:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5672 00000100:00100000:0.0:1787119527.235640:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2375:x1873929633731200:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.235655:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.235679:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 57 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.235706:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 57 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.235741:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 262) 00010000:00010000:0.0:1787119527.235747:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 262) 00010000:00010000:0.0:1787119527.235757:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.235768:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.235884:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.235901:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.235914:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653698432:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.235999:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.242336:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653698432:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.242366:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.242432:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2375:x1873929633731200:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6792us (7493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.242462:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5672 00010000:00010000:3.0:1787119527.244758:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e471b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716db4 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.244796:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653698176:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119527.244830:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.244842:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.244868:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:3.0:1787119527.244983:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633730688:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 33853us (34453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.244993:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5635 00000100:00100000:3.0:1787119527.261608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.261672:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633731328 00000100:00100000:1.0:1787119527.261682:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633731328 00010000:00010000:1.0:1787119527.261723:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.261769:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5673 00000100:00100000:1.0:1787119527.261778:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2373:x1873929633731328:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.261793:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.261819:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.261846:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.261874:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e4722 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dbb expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.261890:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 262) 00010000:00010000:1.0:1787119527.261896:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 262) 00010000:00010000:1.0:1787119527.261904:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.261914:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.261962:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.261978:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653698560:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.262053:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5079726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.273764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.273898:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653698560:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.273938:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.273939:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633731456 00000100:00100000:0.0:1787119527.273947:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633731456 00000100:00100000:3.0:1787119527.273994:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2373:x1873929633731328:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 12216us (12396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.274002:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5637 00000100:00100000:3.0:1787119527.274003:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5673 00000100:00100000:0.0:1787119527.274011:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633731456:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.274029:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.274051:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716dc9 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.274084:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.274093:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 262) 00010000:00010000:0.0:1787119527.274097:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 262) 00010000:00010000:0.0:1787119527.274102:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.274147:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.274174:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 55 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.274188:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653698688:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.274240:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.287124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.291665:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633731584 00000100:00100000:2.0:1787119527.291680:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633731584 00010000:00010000:2.0:1787119527.291730:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.291775:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5674 00000100:00100000:2.0:1787119527.291785:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633731584:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.291803:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.291829:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.291863:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.291892:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 262) 00010000:00010000:2.0:1787119527.291897:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 262) 00010000:00010000:2.0:1787119527.291906:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.291927:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.291968:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.291983:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653698816:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.292076:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3540 going to sleep for 11 seconds 00010000:00010000:0.0:1787119527.293403:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e4729 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc2 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.293429:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653698688:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119527.293614:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.293627:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119527.296993:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633731456:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 22970us (23227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.297007:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5637 00000100:00100000:2.0:1787119527.311465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.311554:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653698816:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.311579:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.311629:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:2376:x1873929633731584:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 19844us (24513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.311640:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5674 00000100:00100000:2.0:1787119527.314152:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633731712 00000100:00100000:2.0:1787119527.314178:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633731712 00000100:00100000:2.0:1787119527.314337:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5638 00000100:00100000:2.0:1787119527.314347:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:33946:x1873929633731712:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.314368:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.314391:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716dd0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.314429:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.314458:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 262) 00010000:00010000:2.0:1787119527.314463:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 262) 00010000:00010000:2.0:1787119527.314470:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.314505:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.314530:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 57 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.314545:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653698944:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.314633:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.318495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.318585:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633731840 00000100:00100000:3.0:1787119527.318595:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633731840 00002000:00100000:3.0:1787119527.318644:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a511f56300 x1873929633731840/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.318657:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56300 with x1873929633731840 ext(393216->409599) 00010000:00010000:3.0:1787119527.318667:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.318697:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.318706:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f56300 00000100:00100000:3.0:1787119527.318733:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1428 00000100:00100000:3.0:1787119527.318744:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633731840:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119527.319014:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633731840:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 271us (528us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119527.319021:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1428 00002000:00100000:3.0:1787119527.319028:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a511f56300 x1873929633731840/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.319036:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f56300 with x1873929633731840 ext(393216->409599) 00010000:00010000:3.0:1787119527.319042:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.319056:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.319063:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f56300 00000100:00100000:3.0:1787119527.324180:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653698944:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119527.324216:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.324240:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895000, rc 0) 00000100:00100000:3.0:1787119527.324294:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633731712:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9948us (12861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.324303:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5638 00000100:00100000:3.0:1787119527.325706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.326914:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633731968 00000100:00100000:2.0:1787119527.326937:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633731968 00000100:00100000:2.0:1787119527.326996:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5639 00000100:00100000:2.0:1787119527.327005:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633731968:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.327025:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.327047:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716dd7 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.327079:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 262) 00010000:00010000:2.0:1787119527.327087:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.327094:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 262) 00010000:00010000:2.0:1787119527.327099:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 59 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.327152:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.327166:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 59 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.327179:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895400, rc 0) 00000100:00100000:2.0:1787119527.327238:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33957:x1873929633731968:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 233us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.327245:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5639 00000100:00100000:3.0:1787119527.327877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.328629:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633732096 00000100:00100000:2.0:1787119527.328639:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633732096 00010000:00010000:2.0:1787119527.328673:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.328705:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5675 00000100:00100000:2.0:1787119527.328714:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633732096:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.328727:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.328748:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.328772:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.328807:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e4730 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dc9 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.328820:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 262) 00010000:00010000:2.0:1787119527.328825:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 262) 00010000:00010000:2.0:1787119527.328833:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.328843:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.328874:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.328889:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 55 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.328903:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653699200:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.328988:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.334582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.334616:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633732224 00000100:00100000:0.0:1787119527.334627:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633732224 00002000:00100000:0.0:1787119527.334674:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509134e00 x1873929633732224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119527.334684:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134e00 with x1873929633732224 ext(393216->397311) 00000100:00100000:1.0:1787119527.334688:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653699200:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.334692:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.334709:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119527.334718:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119527.334726:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509134e00 00000100:00100000:0.0:1787119527.334752:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1429 00000100:00100000:1.0:1787119527.334762:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633732096:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6049us (6886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.334762:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633732224:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.334771:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5675 00000100:00100000:0.0:1787119527.335054:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633732224:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 292us (481us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119527.335061:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1429 00002000:00100000:0.0:1787119527.335068:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509134e00 x1873929633732224/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119527.335077:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134e00 with x1873929633732224 ext(393216->397311) 00010000:00010000:0.0:1787119527.335083:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.335099:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119527.335106:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509134e00 00000100:00100000:0.0:1787119527.338431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.338878:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633732352 00000100:00100000:3.0:1787119527.338887:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633732352 00000100:00100000:3.0:1787119527.338948:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5640 00000100:00100000:3.0:1787119527.338959:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633732352:12345-192.168.201.59@tcp:101:mmap_sanity.0 00000100:00100000:1.0:1787119527.339277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.339299:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633732480 00000100:00100000:1.0:1787119527.339303:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633732480 00010000:00010000:1.0:1787119527.339347:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 57 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.339378:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5676 00000100:00100000:1.0:1787119527.339385:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2376:x1873929633732480:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.339406:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.339422:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716dde expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.339464:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 262) 00010000:00010000:3.0:1787119527.339472:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.339480:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 262) 00010000:00010000:3.0:1787119527.339485:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.339522:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.339535:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.339549:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00010000:00010000:1.0:1787119527.339669:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.339692:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.339711:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.339726:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e4737 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd0 expref: 58 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.339735:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 262) 00010000:00010000:1.0:1787119527.339738:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 262) 00010000:00010000:1.0:1787119527.339743:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.339749:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.339767:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.339777:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 57 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.339983:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633732352:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1024us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.339990:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5640 00000100:00100000:1.0:1787119527.340043:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653699456:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.342400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.342521:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633732608 00000100:00100000:2.0:1787119527.342531:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633732608 00010000:00010000:2.0:1787119527.342566:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 58 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.342598:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5677 00000100:00100000:2.0:1787119527.342607:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2373:x1873929633732608:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.342622:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.342644:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 58 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.342668:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 58 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.342694:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 262) 00010000:00010000:2.0:1787119527.342698:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 262) 00010000:00010000:2.0:1787119527.342706:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 56 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.342716:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 56 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.342756:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 56 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.342768:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653699584:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.343046:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.343261:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd480 going to sleep for 11 seconds 00010000:00010000:1.0:1787119527.343290:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e473e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dd7 expref: 58 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.343302:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653699456:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.343319:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.343344:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633732480:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3960us (4069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.343352:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5676 00000100:00100000:1.0:1787119527.346283:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653699584:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.346313:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.346367:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2373:x1873929633732608:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3760us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.346377:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5677 00000100:00100000:1.0:1787119527.355803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.355960:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633732736 00000100:00100000:3.0:1787119527.355971:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633732736 00000100:00100000:3.0:1787119527.356028:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5641 00000100:00100000:3.0:1787119527.356038:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633732736:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.356055:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.356074:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716de5 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.356105:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.356115:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 262) 00010000:00010000:3.0:1787119527.356120:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 262) 00010000:00010000:3.0:1787119527.356125:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.356157:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.356182:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 55 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.356197:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509135f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653699712:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119527.356287:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60cc23600 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.366551:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509135f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653699712:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119527.366591:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.366615:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:3.0:1787119527.366665:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633732736:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 10629us (10870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.366673:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5641 00000100:00100000:0.0:1787119527.367892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.368093:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633732864 00000100:00100000:3.0:1787119527.368102:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633732864 00002000:00100000:3.0:1787119527.368145:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a6068bf480 x1873929633732864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.368156:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633732864 ext(393216->397311) 00010000:00010000:3.0:1787119527.368165:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.368189:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.368197:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6068bf480 00000100:00100000:3.0:1787119527.368232:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1430 00000100:00100000:3.0:1787119527.368241:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633732864:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119527.369106:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633732864:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 861us (1215us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119527.369116:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1430 00002000:00100000:3.0:1787119527.369125:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a6068bf480 x1873929633732864/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.369135:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6068bf480 with x1873929633732864 ext(393216->397311) 00010000:00010000:3.0:1787119527.369143:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.369163:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.369171:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6068bf480 00000100:00100000:1.0:1787119527.378991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.379032:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633732992 00000100:00100000:1.0:1787119527.379041:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633732992 00000100:00100000:1.0:1787119527.379090:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5642 00000100:00100000:1.0:1787119527.379098:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633732992:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119527.379116:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119527.379135:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716dec expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379167:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 262) 00010000:00010000:1.0:1787119527.379176:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379184:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 262) 00010000:00010000:1.0:1787119527.379189:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379227:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379242:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379255:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:1.0:1787119527.379304:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633732992:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 206us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.379310:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5642 00000100:00100000:1.0:1787119527.379363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.379387:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633733120 00000100:00100000:1.0:1787119527.379392:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633733120 00010000:00010000:1.0:1787119527.379409:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.379432:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5678 00000100:00100000:1.0:1787119527.379456:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2376:x1873929633733120:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.379466:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.379487:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379527:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379548:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4745 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dde expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379558:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 262) 00010000:00010000:1.0:1787119527.379562:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 262) 00010000:00010000:1.0:1787119527.379571:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379580:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379604:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.379619:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 57 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.379633:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653699968:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.379684:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.385868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.385902:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633733248 00000100:00100000:1.0:1787119527.385911:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633733248 00002000:00100000:1.0:1787119527.385976:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6072fa680 x1873929633733248/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.385989:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fa680 with x1873929633733248 ext(393216->409599) 00010000:00010000:1.0:1787119527.385999:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.386031:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.386045:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072fa680 00000100:00100000:1.0:1787119527.386071:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1431 00000100:00100000:1.0:1787119527.386080:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633733248:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.386330:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633733248:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 250us (477us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1787119527.386338:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1431 00002000:00100000:1.0:1787119527.386345:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6072fa680 x1873929633733248/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.386354:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fa680 with x1873929633733248 ext(393216->409599) 00010000:00010000:1.0:1787119527.386360:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.386375:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 58 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.386469:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072fa680 00000100:00100000:3.0:1787119527.386858:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653699968:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.386878:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119527.387237:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633733120:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7796us (7872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.387247:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5678 00000100:00100000:3.0:1787119527.392140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.393099:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633733376 00000100:00100000:0.0:1787119527.393110:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633733376 00000100:00100000:0.0:1787119527.393173:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5643 00000100:00100000:0.0:1787119527.393183:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633733376:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.393200:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.393218:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716df3 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.393259:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 262) 00010000:00010000:0.0:1787119527.393269:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.393277:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 262) 00010000:00010000:0.0:1787119527.393283:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 59 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.393343:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.393359:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 59 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.393374:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119527.393480:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33957:x1873929633733376:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 298us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.393488:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5643 00000100:00100000:3.0:1787119527.397897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.398083:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633733504 00000100:00100000:0.0:1787119527.398094:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633733504 00010000:00010000:0.0:1787119527.398147:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.398200:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5679 00000100:00100000:0.0:1787119527.398210:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633733504:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.398226:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.398248:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.398272:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.398303:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e474c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716de5 expref: 59 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.398319:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 262) 00010000:00010000:0.0:1787119527.398324:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 262) 00010000:00010000:0.0:1787119527.398332:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.398342:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.398379:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 55 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.398395:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 55 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.398408:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653700224:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.399001:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.401484:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653700224:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.404480:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.404572:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633733504:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6357us (6680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.404584:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5679 00000100:00100000:2.0:1787119527.410056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.410091:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633733632 00000100:00100000:2.0:1787119527.410100:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633733632 00010000:00010000:2.0:1787119527.410981:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.411028:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5680 00000100:00100000:2.0:1787119527.411042:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633733632:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.411063:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.411087:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.411114:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.411142:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4753 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dec expref: 56 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.411954:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 262) 00010000:00010000:2.0:1787119527.411965:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 262) 00010000:00010000:2.0:1787119527.411977:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.411990:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.412039:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.412057:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653700352:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.412167:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.415644:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653700352:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.415678:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119527.415732:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:2375:x1873929633733632:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4694us (5684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.415743:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5680 00000100:00100000:1.0:1787119527.437594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.437634:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633733760 00000100:00100000:3.0:1787119527.437645:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633733760 00000100:00100000:1.0:1787119527.437679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.437702:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5644 00000100:00100000:3.0:1787119527.437714:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:33946:x1873929633733760:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.437735:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.437754:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716dfa expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.437788:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.437798:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 262) 00010000:00010000:3.0:1787119527.437803:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 262) 00010000:00010000:3.0:1787119527.437808:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 56 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.438755:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633733888 00000100:00100000:2.0:1787119527.438765:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633733888 00002000:00100000:2.0:1787119527.438862:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6072f8a80 x1873929633733888/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.438873:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8a80 with x1873929633733888 ext(393216->409599) 00010000:00010000:2.0:1787119527.438881:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.438893:0:19255:0:(ldlm_lockd.c:595:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.438900:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072f8a80 00000100:00100000:1.0:1787119527.438973:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1432 00000100:00100000:1.0:1787119527.438983:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633733888:12345-192.168.201.59@tcp:3:kworker.0 00010000:00010000:3.0:1787119527.439168:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.439198:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.439215:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653700480:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119527.439291:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.440073:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633733888:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1087us (2390us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1787119527.440089:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1432 00002000:00100000:1.0:1787119527.440100:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6072f8a80 x1873929633733888/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.440111:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8a80 with x1873929633733888 ext(393216->409599) 00010000:00010000:1.0:1787119527.440119:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.440142:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.440150:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072f8a80 00000100:00100000:0.0:1787119527.449364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.449457:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653700480:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119527.449493:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 56 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.449517:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:0.0:1787119527.449571:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633733760:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 11860us (11986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.449580:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5644 00000100:00100000:0.0:1787119527.449613:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633734016 00000100:00100000:0.0:1787119527.449619:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633734016 00000100:00100000:0.0:1787119527.449662:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5645 00000100:00100000:0.0:1787119527.449672:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633734016:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.449688:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.449706:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e01 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.449731:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 262) 00010000:00010000:0.0:1787119527.449741:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.449749:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 262) 00010000:00010000:0.0:1787119527.449754:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 59 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.449790:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.449803:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 59 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.449812:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:0.0:1787119527.449909:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33957:x1873929633734016:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 164us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.449925:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5645 00000100:00100000:0.0:1787119527.453009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.453136:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633734144 00000100:00100000:0.0:1787119527.453269:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633734144 00010000:00010000:0.0:1787119527.453314:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.453355:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5681 00000100:00100000:0.0:1787119527.453366:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633734144:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.453382:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.453409:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.453436:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.453492:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e475a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716df3 expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.453517:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 262) 00010000:00010000:0.0:1787119527.453523:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 262) 00010000:00010000:0.0:1787119527.453534:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.453545:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.453589:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.453606:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 55 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.453622:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb2b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653700736:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.453705:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.462639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.462683:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633734272 00000100:00100000:1.0:1787119527.462695:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633734272 00000100:00100000:0.0:1787119527.462719:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb2b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653700736:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.462744:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1787119527.462745:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a63eb28380 x1873929633734272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.462757:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633734272 ext(393216->397311) 00010000:00010000:1.0:1787119527.462766:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.462794:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.462803:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28380 00000100:00100000:1.0:1787119527.462904:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1433 00000100:00100000:1.0:1787119527.462925:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633734272:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.463179:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633734272:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 265us (551us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119527.463187:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1433 00002000:00100000:1.0:1787119527.463193:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a63eb28380 x1873929633734272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.463201:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb28380 with x1873929633734272 ext(393216->397311) 00010000:00010000:1.0:1787119527.463207:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.463357:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.463366:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63eb28380 00000100:00100000:0.0:1787119527.464010:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633734144:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10641us (11006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.464033:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5681 00000100:00100000:0.0:1787119527.478148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.478254:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633734400 00000100:00100000:2.0:1787119527.478265:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633734400 00000100:00100000:2.0:1787119527.478335:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5646 00000100:00100000:2.0:1787119527.478347:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633734400:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.478363:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.478384:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e08 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.478414:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 262) 00010000:00010000:2.0:1787119527.478422:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.478430:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 262) 00010000:00010000:2.0:1787119527.478436:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.478611:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.478622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119527.478629:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 57 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.478643:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895400, rc 0) 00000100:00100000:2.0:1787119527.478750:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633734400:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 405us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.478757:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5646 00000100:00100000:1.0:1787119527.478845:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633734528 00000100:00100000:1.0:1787119527.478851:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633734528 00010000:00010000:1.0:1787119527.478876:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.478906:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5682 00000100:00100000:1.0:1787119527.478926:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2376:x1873929633734528:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.478937:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.478959:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.478984:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.478999:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e4761 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716dfa expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.479007:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 262) 00010000:00010000:1.0:1787119527.479009:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 262) 00010000:00010000:1.0:1787119527.479015:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.479021:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.479038:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.479047:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 57 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.479058:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653700992:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.479099:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.482845:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653700992:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.482873:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.482950:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633734528:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4034us (4329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.482962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.482964:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5682 00000100:00100000:1.0:1787119527.483002:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633734656 00000100:00100000:1.0:1787119527.483008:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633734656 00010000:00010000:1.0:1787119527.483038:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.483075:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5683 00000100:00100000:1.0:1787119527.483085:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633734656:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.483098:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.483120:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.483146:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.483172:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4768 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e01 expref: 58 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.483188:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 262) 00010000:00010000:1.0:1787119527.483192:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 262) 00010000:00010000:1.0:1787119527.483200:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.483210:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.483244:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.483259:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653701120:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.483329:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.490846:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653701120:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.490888:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.490962:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2376:x1873929633734656:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7877us (8133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.490974:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5683 00000100:00100000:3.0:1787119527.497028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.497118:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633734784 00000100:00100000:0.0:1787119527.497130:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633734784 00000100:00100000:0.0:1787119527.497189:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5647 00000100:00100000:0.0:1787119527.497197:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633734784:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.497216:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.497234:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e0f expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.497268:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.497279:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 262) 00010000:00010000:0.0:1787119527.497284:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 262) 00010000:00010000:0.0:1787119527.497291:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.497325:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.497351:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 55 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.497366:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653701248:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.497472:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.500117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.500248:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633734912 00000100:00100000:1.0:1787119527.500257:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633734912 00002000:00100000:1.0:1787119527.500303:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a606156d80 x1873929633734912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.500314:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156d80 with x1873929633734912 ext(393216->397311) 00010000:00010000:1.0:1787119527.500323:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.500351:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.500359:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606156d80 00000100:00100000:1.0:1787119527.500394:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1434 00000100:00100000:1.0:1787119527.500403:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633734912:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.500705:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633734912:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 301us (596us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119527.500713:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1434 00002000:00100000:1.0:1787119527.500720:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a606156d80 x1873929633734912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.500728:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606156d80 with x1873929633734912 ext(393216->397311) 00010000:00010000:1.0:1787119527.500734:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.500748:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.500755:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606156d80 00000100:00100000:3.0:1787119527.501102:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653701248:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119527.501132:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.501156:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:3.0:1787119527.501195:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633734784:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3998us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.501201:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5647 00000100:00100000:3.0:1787119527.504533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.504963:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633735040 00000100:00100000:0.0:1787119527.504973:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633735040 00000100:00100000:0.0:1787119527.505048:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5648 00000100:00100000:0.0:1787119527.505065:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633735040:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.505084:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.505104:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e16 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.505136:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 262) 00010000:00010000:0.0:1787119527.505145:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.505288:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 262) 00010000:00010000:0.0:1787119527.505295:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.505339:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.505354:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.505366:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119527.505431:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633735040:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 373us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.505477:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5648 00000100:00100000:2.0:1787119527.506296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.511584:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633735168 00000100:00100000:0.0:1787119527.511600:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633735168 00010000:00010000:0.0:1787119527.511652:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 57 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.511698:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5684 00000100:00100000:0.0:1787119527.511708:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2376:x1873929633735168:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.511723:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.511745:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 57 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.511773:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 57 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.511802:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e476f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e08 expref: 57 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.511818:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 262) 00010000:00010000:0.0:1787119527.511824:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 262) 00010000:00010000:0.0:1787119527.511844:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.511853:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.511895:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.511909:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.511934:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653701504:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.512037:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.516960:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653701504:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.516989:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.517057:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633735168:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5349us (10763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.517069:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5684 00000100:00100000:2.0:1787119527.519650:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.520266:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633735296 00000100:00100000:1.0:1787119527.520277:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633735296 00002000:00100000:1.0:1787119527.520330:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a511f57480 x1873929633735296/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.520341:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633735296 ext(393216->409599) 00010000:00010000:1.0:1787119527.520351:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.520381:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.520389:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57480 00000100:00100000:1.0:1787119527.520426:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1435 00000100:00100000:1.0:1787119527.520472:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633735296:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.520758:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633735296:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 322us (1120us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1787119527.520766:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1435 00002000:00100000:1.0:1787119527.520772:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a511f57480 x1873929633735296/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.520780:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57480 with x1873929633735296 ext(393216->409599) 00010000:00010000:1.0:1787119527.520785:0:20838:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.520799:0:20838:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.520806:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a511f57480 00000100:00100000:2.0:1787119527.527110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.527179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.527285:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633735424 00000100:00100000:0.0:1787119527.527297:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633735424 00000100:00100000:0.0:1787119527.527364:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5649 00000100:00100000:0.0:1787119527.527375:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633735424:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.527394:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.527414:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e1d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.527479:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 262) 00010000:00010000:0.0:1787119527.527489:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.527497:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 262) 00010000:00010000:0.0:1787119527.527502:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 59 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.527524:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633735552 00000100:00100000:3.0:1787119527.527530:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633735552 00010000:00010000:0.0:1787119527.527543:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.527556:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 60 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.527561:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 60 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.527583:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:3.0:1787119527.527601:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5685 00000100:00100000:3.0:1787119527.527611:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+60:2376:x1873929633735552:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.527622:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787119527.527640:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+60:33957:x1873929633735424:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 265us (542us total) trans 0 rc 0/0 00010000:00010000:3.0:1787119527.527646:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 60 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.527654:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5649 00010000:00010000:3.0:1787119527.527681:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.527703:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e4776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e0f expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.527718:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 262) 00010000:00010000:3.0:1787119527.527722:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 262) 00010000:00010000:3.0:1787119527.527731:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.527741:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.527765:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.527785:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 55 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.527801:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653701760:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.528281:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.535123:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653701760:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.535151:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119527.535214:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633735552:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7603us (8032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.535753:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5685 00000100:00100000:2.0:1787119527.539738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.540013:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633735680 00000100:00100000:1.0:1787119527.540091:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633735680 00010000:00010000:1.0:1787119527.540136:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.540254:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5686 00000100:00100000:1.0:1787119527.540266:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633735680:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.540282:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.540308:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.540341:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.540365:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e477d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e16 expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.540383:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 262) 00010000:00010000:1.0:1787119527.540388:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 262) 00010000:00010000:1.0:1787119527.540396:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.540405:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.540496:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.540511:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653701888:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.540594:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.545591:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653701888:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.545624:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.545675:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:2375:x1873929633735680:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5411us (5945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.545688:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5686 00000100:00100000:3.0:1787119527.550765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.551400:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633735808 00000100:00100000:2.0:1787119527.551412:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633735808 00000100:00100000:2.0:1787119527.551513:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5650 00000100:00100000:2.0:1787119527.551525:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+55:33946:x1873929633735808:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.551543:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.551561:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e24 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.551596:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.551606:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 262) 00010000:00010000:2.0:1787119527.551611:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 262) 00010000:00010000:2.0:1787119527.551616:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.551651:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.551677:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 57 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.551692:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653702016:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.551793:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.557251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.557273:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653702016:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.557313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119527.557319:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 56 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.557346:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894a00, rc 0) 00000100:00100000:3.0:1787119527.557403:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633736064 00000100:00100000:3.0:1787119527.557411:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633736064 00000100:00100000:0.0:1787119527.557417:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633735808:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5893us (6662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.557429:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5650 00000100:00100000:3.0:1787119527.557491:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5651 00000100:00100000:3.0:1787119527.557500:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633736064:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.557528:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787119527.557536:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633735936 00000100:00100000:1.0:1787119527.557542:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633735936 00010000:00010000:3.0:1787119527.557547:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e2b expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.557567:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 60 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.557574:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 262) 00010000:00010000:3.0:1787119527.557591:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.557595:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5687 00010000:00010000:3.0:1787119527.557606:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 262) 00000100:00100000:1.0:1787119527.557607:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+60:2375:x1873929633735936:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.557616:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 60 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.557623:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.557650:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 60 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.557656:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.558016:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 60 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.559072:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 60 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.559092:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:2.0:1787119527.565932:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+60:33957:x1873929633736064:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8411us (8597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.565948:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5651 00010000:00010000:1.0:1787119527.567994:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a734c/0xcaba3de8463e4784 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e1d expref: 59 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.568030:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 262) 00010000:00010000:1.0:1787119527.568036:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 262) 00010000:00010000:1.0:1787119527.568045:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.568057:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.568108:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.568137:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 55 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.568164:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653702272:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.568255:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd600 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.571932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.572280:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653702272:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.572306:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633736192 00010000:00010000:1.0:1787119527.572307:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119527.572315:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633736192 00002000:00100000:3.0:1787119527.572366:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a62a120e00 x1873929633736192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787119527.572373:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633735936:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 14766us (15131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.572387:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5687 00002000:00100000:3.0:1787119527.574360:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120e00 with x1873929633736192 ext(393216->397311) 00010000:00010000:3.0:1787119527.574434:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.574488:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.574498:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a120e00 00000100:00100000:3.0:1787119527.574659:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1436 00000100:00100000:3.0:1787119527.574676:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633736192:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119527.575032:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633736192:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 364us (3121us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119527.575040:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1436 00002000:00100000:3.0:1787119527.575049:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a62a120e00 x1873929633736192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.575058:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a120e00 with x1873929633736192 ext(393216->397311) 00010000:00010000:3.0:1787119527.575063:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.575078:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 56 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.575085:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a120e00 00000100:00100000:2.0:1787119527.579643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.579689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.579762:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633736320 00000100:00100000:3.0:1787119527.579765:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633736448 00000100:00100000:3.0:1787119527.579775:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633736448 00000100:00100000:0.0:1787119527.579775:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633736320 00010000:00010000:3.0:1787119527.579944:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 57 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.580030:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5652 00000100:00100000:3.0:1787119527.580037:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5688 00000100:00100000:0.0:1787119527.580043:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:33946:x1873929633736320:12345-192.168.201.59@tcp:101:mmap_sanity.0 00000100:00100000:3.0:1787119527.580051:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2375:x1873929633736448:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.580063:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.580069:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.580082:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e32 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.580094:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 57 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.580112:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 262) 00010000:00010000:0.0:1787119527.580121:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.580129:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 262) 00010000:00010000:0.0:1787119527.580135:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.580181:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.580197:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 58 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.588565:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.588598:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:0.0:1787119527.588681:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+58:33946:x1873929633736320:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8641us (9046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.588691:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5652 00010000:00010000:3.0:1787119527.591362:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e478b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e24 expref: 57 pid: 12469 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.591406:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 262) 00010000:00010000:3.0:1787119527.591413:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 262) 00010000:00010000:3.0:1787119527.591423:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.591434:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.591730:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 57 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.591759:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 57 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.591775:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653702528:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.591883:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.607847:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653702528:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.607882:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.607945:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2375:x1873929633736448:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 27898us (28254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.607957:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5688 00000100:00100000:2.0:1787119527.614763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.614941:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633736576 00000100:00100000:0.0:1787119527.614953:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633736576 00002000:00100000:0.0:1787119527.615005:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a62a123800 x1873929633736576/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119527.615016:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123800 with x1873929633736576 ext(393216->409599) 00010000:00010000:0.0:1787119527.615036:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.615069:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119527.615077:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a123800 00000100:00100000:0.0:1787119527.615116:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1437 00000100:00100000:0.0:1787119527.615126:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633736576:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119527.615485:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633736576:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 359us (732us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1787119527.615494:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1437 00002000:00100000:0.0:1787119527.615501:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a62a123800 x1873929633736576/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119527.615509:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a123800 with x1873929633736576 ext(393216->409599) 00010000:00010000:0.0:1787119527.615516:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.615531:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 58 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119527.615537:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a123800 00000100:00100000:2.0:1787119527.622003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.622061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.622809:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633736832 00000100:00100000:3.0:1787119527.622830:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633736832 00000100:00100000:3.0:1787119527.622895:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5653 00000100:00100000:3.0:1787119527.622905:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633736832:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.622934:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.622955:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e39 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.622993:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 262) 00010000:00010000:3.0:1787119527.623004:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.623011:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 262) 00010000:00010000:3.0:1787119527.623017:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 59 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.623057:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.623070:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 59 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.623082:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:3.0:1787119527.623134:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33957:x1873929633736832:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 230us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.623141:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5653 00000100:00100000:0.0:1787119527.623599:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633736704 00000100:00100000:0.0:1787119527.623605:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633736704 00010000:00010000:0.0:1787119527.623630:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.623668:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5689 00000100:00100000:0.0:1787119527.623676:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2374:x1873929633736704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.623686:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787119527.623706:0:20609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb blocks from disk: 519 -> 775 00010000:00010000:0.0:1787119527.623713:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.623736:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.623755:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4792 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e2b expref: 59 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.623767:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 262) 00010000:00010000:0.0:1787119527.623771:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 262) 00010000:00010000:0.0:1787119527.623778:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.623786:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.623810:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 55 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.623954:0:20609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 55 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.623971:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653702784:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.624088:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.629224:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653702784:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.629250:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.629344:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2374:x1873929633736704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5667us (7349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.629354:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5689 00000100:00100000:2.0:1787119527.636995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.638656:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633736960 00000100:00100000:3.0:1787119527.638671:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633736960 00010000:00010000:3.0:1787119527.638713:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.638758:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5690 00000100:00100000:3.0:1787119527.638767:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:2376:x1873929633736960:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.638793:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119527.638817:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.638844:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.638883:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e4799 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e32 expref: 56 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.638902:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 262) 00010000:00010000:3.0:1787119527.638907:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 262) 00010000:00010000:3.0:1787119527.638924:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 57 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.638935:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 57 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.638974:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 57 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.638990:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653702912:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.639083:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.639531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.639651:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633737088 00000100:00100000:1.0:1787119527.639657:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633737088 00000100:00100000:1.0:1787119527.639688:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5654 00000100:00100000:1.0:1787119527.639695:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633737088:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119527.639708:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119527.639720:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e40 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.639740:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 57 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.639747:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 262) 00010000:00010000:1.0:1787119527.639751:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 262) 00010000:00010000:1.0:1787119527.639755:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 57 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.639779:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 57 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.639796:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 57 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.639807:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653703040:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119527.639860:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.656687:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653702912:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.656719:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119527.656774:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+57:2376:x1873929633736960:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 18007us (19789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.656792:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5690 00000100:00100000:0.0:1787119527.661061:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653703040:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119527.661098:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 56 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.661134:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:0.0:1787119527.661210:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+56:33946:x1873929633737088:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 21512us (21678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.661230:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5654 00000100:00100000:0.0:1787119527.662466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.662534:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633737216 00000100:00100000:3.0:1787119527.662543:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633737216 00002000:00100000:3.0:1787119527.662587:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a606157b80 x1873929633737216/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.662597:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157b80 with x1873929633737216 ext(393216->409599) 00010000:00010000:3.0:1787119527.662605:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 58 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.662636:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 58 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.662645:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157b80 00000100:00100000:1.0:1787119527.662716:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1438 00000100:00100000:1.0:1787119527.662730:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633737216:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.663013:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633737216:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 286us (582us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1787119527.663021:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1438 00002000:00100000:1.0:1787119527.663028:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a606157b80 x1873929633737216/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.663037:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157b80 with x1873929633737216 ext(393216->409599) 00010000:00010000:1.0:1787119527.663043:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 58 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.663060:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 58 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.663067:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157b80 00000100:00100000:2.0:1787119527.676930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.676989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.677175:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633737344 00000100:00100000:3.0:1787119527.677186:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633737344 00000100:00100000:3.0:1787119527.677254:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5655 00000100:00100000:3.0:1787119527.677264:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633737344:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.677283:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.677301:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e47 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.677335:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 262) 00010000:00010000:3.0:1787119527.677344:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.677357:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 262) 00010000:00010000:3.0:1787119527.677363:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 59 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.677411:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.677425:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 59 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.677460:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:3.0:1787119527.677509:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33957:x1873929633737344:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 246us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.677516:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5655 00000100:00100000:1.0:1787119527.682338:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633737472 00000100:00100000:1.0:1787119527.682355:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633737472 00010000:00010000:1.0:1787119527.682592:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 59 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.682639:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5691 00000100:00100000:1.0:1787119527.682649:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633737472:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.682664:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.682689:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 59 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.682714:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 59 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.682737:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e39 expref: 59 pid: 20843 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.682753:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 262) 00010000:00010000:1.0:1787119527.682758:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 262) 00010000:00010000:1.0:1787119527.682765:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.683233:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.683290:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.683309:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 55 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.683324:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653703296:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.683477:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.687600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.687787:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653703296:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.687812:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119527.687906:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633737600 00000100:00100000:3.0:1787119527.687925:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633737600 00000100:00100000:1.0:1787119527.687953:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633737472:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5304us (10962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.687964:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5691 00002000:00100000:3.0:1787119527.687975:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a606157800 x1873929633737600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.687987:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157800 with x1873929633737600 ext(393216->397311) 00010000:00010000:3.0:1787119527.687997:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 56 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.688479:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 56 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.688497:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157800 00000001:00080000:0.0:1787119527.688685:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969265 is committed 00000001:00080000:0.0:1787119527.688715:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969272 is committed 00000100:00100000:3.0:1787119527.691920:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1439 00000100:00100000:3.0:1787119527.691945:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633737600:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119527.694865:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633737600:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 275us (4620us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119527.694882:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1439 00002000:00100000:3.0:1787119527.694899:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a606157800 x1873929633737600/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.694925:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606157800 with x1873929633737600 ext(393216->397311) 00010000:00010000:3.0:1787119527.694936:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.694966:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.694974:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a606157800 00000100:00100000:0.0:1787119527.695628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.695709:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633737856 00000100:00100000:2.0:1787119527.695719:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633737856 00010000:00010000:2.0:1787119527.695755:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.695801:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5692 00000100:00100000:2.0:1787119527.695810:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633737856:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.695835:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.695859:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.695878:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.695906:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e47a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e40 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.695939:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 262) 00010000:00010000:2.0:1787119527.695945:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 262) 00010000:00010000:2.0:1787119527.695954:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.695964:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.696001:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.696020:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653703424:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.696106:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.713963:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.714032:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633737728 00000100:00100000:3.0:1787119527.714044:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633737728 00000100:00100000:3.0:1787119527.714119:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5656 00000100:00100000:3.0:1787119527.714130:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633737728:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.714151:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.714169:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e4e expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.714357:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.714370:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 262) 00010000:00010000:3.0:1787119527.714374:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 262) 00010000:00010000:3.0:1787119527.714380:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.714417:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.714470:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 21 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.714486:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653703552:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119527.714563:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.726678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.727751:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633737984 00000100:00100000:0.0:1787119527.727763:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633737984 00010000:00010000:0.0:1787119527.727809:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 22 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.727881:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5693 00000100:00100000:0.0:1787119527.727892:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633737984:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.727908:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.727944:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 22 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.727970:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 22 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.728001:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 262) 00010000:00010000:0.0:1787119527.728006:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 262) 00010000:00010000:0.0:1787119527.728015:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.728025:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.728070:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.728087:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606157100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653703680:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.728175:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.729724:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653703552:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119527.729764:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.729781:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:3.0:1787119527.729862:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633737728:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 15733us (15911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.729872:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5656 00010000:00010000:2.0:1787119527.730809:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e47ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e47 expref: 22 pid: 8267 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.732979:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653703424:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.733008:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.733072:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633737856:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 37262us (37447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.733083:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5692 00000100:00100000:1.0:1787119527.740093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.740490:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633738112 00000100:00100000:2.0:1787119527.740509:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633738112 00000100:00100000:2.0:1787119527.740563:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5657 00000100:00100000:2.0:1787119527.740571:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633738112:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.740590:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.740607:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e55 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.740640:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.740650:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 262) 00010000:00010000:2.0:1787119527.740655:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 262) 00010000:00010000:2.0:1787119527.740660:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 23 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.740694:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.740722:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 39 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.740738:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653703808:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.740836:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.741366:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606157100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653703680:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.741405:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.741473:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2376:x1873929633737984:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13582us (14805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.741484:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5693 00000100:00100000:2.0:1787119527.748322:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653703808:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119527.748363:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.748398:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895000, rc 0) 00000100:00100000:2.0:1787119527.748578:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633738112:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7934us (8423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.748588:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5657 00000100:00100000:3.0:1787119527.749414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.750607:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633738240 00000100:00100000:1.0:1787119527.750618:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633738240 00002000:00100000:1.0:1787119527.750663:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509134380 x1873929633738240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.750671:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134380 with x1873929633738240 ext(393216->397311) 00010000:00010000:1.0:1787119527.750678:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.750701:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.750706:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509134380 00000100:00100000:1.0:1787119527.750737:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1440 00000100:00100000:1.0:1787119527.750745:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633738240:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.750993:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633738240:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 246us (1582us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119527.751000:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1440 00002000:00100000:1.0:1787119527.751007:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509134380 x1873929633738240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119527.751015:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509134380 with x1873929633738240 ext(393216->397311) 00010000:00010000:1.0:1787119527.751020:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.751033:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119527.751039:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509134380 00000100:00100000:0.0:1787119527.759009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.759068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.759136:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633738496 00000100:00100000:2.0:1787119527.759147:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633738496 00010000:00010000:2.0:1787119527.759192:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.759242:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5694 00000100:00100000:2.0:1787119527.759253:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633738496:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.759268:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.759360:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.759366:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633738368 00000100:00100000:1.0:1787119527.759370:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633738368 00010000:00010000:2.0:1787119527.759399:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 41 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.759425:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e47b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e4e expref: 41 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.759469:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 262) 00010000:00010000:2.0:1787119527.759476:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 262) 00010000:00010000:2.0:1787119527.759485:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.759496:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.759540:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.759558:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653703936:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.759588:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5658 00000100:00100000:0.0:1787119527.759599:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633738368:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.759615:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.759631:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e5c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.759651:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787119527.759656:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.759666:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 262) 00010000:00010000:0.0:1787119527.759669:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 262) 00010000:00010000:0.0:1787119527.759674:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.759695:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.759711:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 21 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.759727:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653704064:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.759753:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.768108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.768937:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653704064:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.768981:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653703936:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.768981:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.769001:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633738624 00010000:00010000:2.0:1787119527.769001:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119527.769007:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:3.0:1787119527.769011:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633738624 00002000:00100000:3.0:1787119527.769058:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6181ad880 x1873929633738624/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.769070:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ad880 with x1873929633738624 ext(393216->409599) 00010000:00010000:3.0:1787119527.769079:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.769122:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.769131:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6181ad880 00000100:00100000:3.0:1787119527.769164:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1441 00000100:00100000:3.0:1787119527.769174:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633738624:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119527.769214:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633738496:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9961us (10143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.769224:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5694 00000100:00100000:2.0:1787119527.772369:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633738624:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3185us (4260us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787119527.772625:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1441 00002000:00100000:2.0:1787119527.772639:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6181ad880 x1873929633738624/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.772651:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6181ad880 with x1873929633738624 ext(393216->409599) 00010000:00010000:2.0:1787119527.772661:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.772694:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.772703:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6181ad880 00000100:00100000:0.0:1787119527.773537:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633738368:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 13934us (14533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.773548:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5658 00000100:00100000:2.0:1787119527.777795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.778015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.778107:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633738752 00000100:00100000:1.0:1787119527.778117:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633738752 00000100:00100000:3.0:1787119527.778221:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633738880 00000100:00100000:3.0:1787119527.778225:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633738880 00010000:00010000:3.0:1787119527.778252:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 23 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.778279:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5659 00000100:00100000:1.0:1787119527.778293:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633738752:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119527.778309:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119527.778327:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e63 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.778356:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 262) 00010000:00010000:1.0:1787119527.778366:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.778373:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 262) 00010000:00010000:1.0:1787119527.778378:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 24 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.778670:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.778686:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 24 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.778701:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119527.778723:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5695 00000100:00100000:3.0:1787119527.778732:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2376:x1873929633738880:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.778742:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787119527.778758:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+24:33957:x1873929633738752:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 469us (973us total) trans 0 rc 0/0 00010000:00010000:3.0:1787119527.778764:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 24 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.778766:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5659 00010000:00010000:3.0:1787119527.778807:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 23 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.778832:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e47bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e55 expref: 23 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.778846:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 262) 00010000:00010000:3.0:1787119527.778849:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 262) 00010000:00010000:3.0:1787119527.778857:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.778866:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.778893:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.778908:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 39 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.778933:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653704320:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.778990:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.784478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.784668:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633739008 00000100:00100000:0.0:1787119527.784679:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633739008 00010000:00010000:0.0:1787119527.784721:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.784783:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5696 00000100:00100000:0.0:1787119527.784795:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633739008:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.784813:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.784840:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.784868:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.784901:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 262) 00010000:00010000:0.0:1787119527.784907:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 262) 00010000:00010000:0.0:1787119527.784929:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.784948:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.784990:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.785006:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653704448:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.785100:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e47c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e5c expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.785110:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.785122:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653704320:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.785147:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.787766:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653704448:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119527.787860:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119527.787940:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633739008:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3146us (3503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.787951:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5696 00000100:00100000:2.0:1787119527.789302:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633738880:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10562us (11278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.789315:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5695 00000100:00100000:1.0:1787119527.797090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.797269:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633739136 00000100:00100000:3.0:1787119527.797294:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633739136 00000100:00100000:3.0:1787119527.797408:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5660 00000100:00100000:3.0:1787119527.797421:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633739136:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.797490:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.797516:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e6a expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.797556:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.797567:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 262) 00010000:00010000:3.0:1787119527.797571:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 262) 00010000:00010000:3.0:1787119527.797578:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.797623:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.797654:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 21 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.797679:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653704576:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119527.797841:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.802675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.802788:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653704576:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119527.802834:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.802858:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:3.0:1787119527.802938:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633739136:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5518us (5858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.802947:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5660 00000100:00100000:0.0:1787119527.804711:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633739264 00000100:00100000:0.0:1787119527.804725:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633739264 00002000:00100000:0.0:1787119527.804898:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6072fb480 x1873929633739264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119527.804921:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb480 with x1873929633739264 ext(393216->409599) 00010000:00010000:0.0:1787119527.804932:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.804964:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119527.804977:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072fb480 00000100:00100000:0.0:1787119527.805012:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1442 00000100:00100000:0.0:1787119527.805023:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633739264:12345-192.168.201.59@tcp:3:ldlm_bl.0 00000100:00100000:0.0:1787119527.805651:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633739264:12345-192.168.201.59@tcp:3:ldlm_bl.0 Request processed in 626us (2983us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1787119527.805659:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1442 00002000:00100000:0.0:1787119527.805667:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6072fb480 x1873929633739264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119527.805675:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb480 with x1873929633739264 ext(393216->409599) 00010000:00010000:0.0:1787119527.805680:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.805697:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119527.805704:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072fb480 00000100:00100000:1.0:1787119527.809656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.809854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.810008:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633739520 00000100:00100000:0.0:1787119527.810018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633739520 00010000:00010000:0.0:1787119527.810059:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.810113:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5697 00000100:00100000:0.0:1787119527.810123:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633739520:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119527.810139:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119527.810163:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.810189:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.810229:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e47ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e63 expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.810245:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 262) 00010000:00010000:0.0:1787119527.810250:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 262) 00010000:00010000:0.0:1787119527.810258:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.810268:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.810318:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.810333:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653704704:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.810423:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787119527.811197:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633739392 00000100:00100000:3.0:1787119527.811204:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633739392 00000100:00100000:0.0:1787119527.811605:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5661 00000100:00100000:0.0:1787119527.811614:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633739392:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.811633:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.811649:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e71 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.811672:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.811681:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 262) 00010000:00010000:0.0:1787119527.811685:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 262) 00010000:00010000:0.0:1787119527.811690:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 23 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.811713:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.811732:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 39 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.811745:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653704832:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.811805:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.814850:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653704704:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.814877:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.814944:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2376:x1873929633739520:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4821us (5089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.814956:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5697 00000100:00100000:2.0:1787119527.815637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.815707:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633739648 00000100:00100000:3.0:1787119527.815715:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633739648 00002000:00100000:3.0:1787119527.815760:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a508ffd180 x1873929633739648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.815770:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd180 with x1873929633739648 ext(393216->397311) 00010000:00010000:3.0:1787119527.815788:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.815826:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.815833:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffd180 00000100:00100000:3.0:1787119527.815902:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1443 00000100:00100000:3.0:1787119527.815922:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633739648:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119527.816163:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633739648:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 252us (527us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119527.816170:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1443 00002000:00100000:3.0:1787119527.816177:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a508ffd180 x1873929633739648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.816185:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd180 with x1873929633739648 ext(393216->397311) 00010000:00010000:3.0:1787119527.816190:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.816205:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.816224:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffd180 00000100:00100000:0.0:1787119527.816739:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653704832:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119527.816769:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.816800:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119527.816847:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633739392:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5234us (7203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.816855:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5661 00000100:00100000:1.0:1787119527.820157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.820463:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633739776 00000100:00100000:3.0:1787119527.820473:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633739776 00010000:00010000:3.0:1787119527.820515:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.820561:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5698 00000100:00100000:3.0:1787119527.820571:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2374:x1873929633739776:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.820587:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119527.820613:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.820645:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.820671:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e47d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e6a expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.820689:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 262) 00010000:00010000:3.0:1787119527.820693:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 262) 00010000:00010000:3.0:1787119527.820701:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.820712:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.820751:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.820767:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653704960:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.820992:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.822059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.823125:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653704960:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119527.823154:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119527.823220:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2374:x1873929633739776:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2642us (3065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.823231:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5698 00000100:00100000:0.0:1787119527.824368:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633739904 00000100:00100000:0.0:1787119527.824379:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633739904 00000100:00100000:0.0:1787119527.824497:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5662 00000100:00100000:0.0:1787119527.824509:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633739904:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.824528:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.824547:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e78 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.824579:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.824590:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 262) 00010000:00010000:0.0:1787119527.824594:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 262) 00010000:00010000:0.0:1787119527.824599:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.824635:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.824661:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 21 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.824675:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653705088:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.824929:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.829216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.829390:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653705088:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119527.829469:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.829500:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:2.0:1787119527.829518:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633740032 00000100:00100000:2.0:1787119527.829528:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633740032 00000100:00100000:0.0:1787119527.829561:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633739904:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5054us (7508us total) trans 0 rc 0/0 00010000:00010000:2.0:1787119527.829566:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.829570:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5662 00000100:00100000:2.0:1787119527.829671:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5699 00000100:00100000:2.0:1787119527.829683:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633740032:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.829698:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.829727:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.829759:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.829796:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e47d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e71 expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.829821:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 262) 00010000:00010000:2.0:1787119527.829826:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 262) 00010000:00010000:2.0:1787119527.829835:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.829845:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.829886:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.829903:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653705216:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.830002:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.834675:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653705216:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.834703:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.834895:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2376:x1873929633740032:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5213us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.834907:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5699 00000100:00100000:1.0:1787119527.836065:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.836156:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633740160 00000100:00100000:2.0:1787119527.836164:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633740160 00000100:00100000:2.0:1787119527.836389:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5663 00000100:00100000:2.0:1787119527.836401:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+21:33957:x1873929633740160:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.836421:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.836481:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.836516:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.836526:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 262) 00010000:00010000:2.0:1787119527.836531:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 262) 00010000:00010000:2.0:1787119527.836536:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.836573:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.836600:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 39 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.836614:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653705344:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.836698:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.840394:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653705344:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119527.840432:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.840484:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894800, rc 0) 00000100:00100000:2.0:1787119527.840553:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633740160:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4153us (4493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.840563:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5663 00000100:00100000:0.0:1787119527.842666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.842823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633740288 00000100:00100000:2.0:1787119527.842833:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633740288 00010000:00010000:2.0:1787119527.842874:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.842925:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5700 00000100:00100000:2.0:1787119527.842935:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633740288:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.842949:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.842973:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.842998:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.843023:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e47df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e78 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.843041:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 262) 00010000:00010000:2.0:1787119527.843046:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 262) 00010000:00010000:2.0:1787119527.843054:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.843063:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.843111:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.843127:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653705472:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.843196:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.849131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.849359:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633740416 00000100:00100000:3.0:1787119527.849370:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633740416 00000100:00100000:0.0:1787119527.849830:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5664 00000100:00100000:0.0:1787119527.849841:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633740416:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.849860:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.849881:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e86 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.849927:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.849937:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 262) 00010000:00010000:0.0:1787119527.849942:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 262) 00010000:00010000:0.0:1787119527.849947:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.849985:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.850011:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 21 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.850025:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653705600:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.850112:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.852425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.853165:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653705472:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.853190:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.853256:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633740288:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10322us (10597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.853266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5700 00000100:00100000:1.0:1787119527.853359:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653705600:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119527.853389:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 40 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.853411:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:1.0:1787119527.853436:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633740416:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3597us (4316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.853478:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5664 00000100:00100000:3.0:1787119527.856119:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633740544 00000100:00100000:3.0:1787119527.856135:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633740544 00002000:00100000:0.0:1787119527.859168:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a62041df80 x1873929633740544/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119527.859184:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041df80 with x1873929633740544 ext(393216->409599) 00010000:00010000:0.0:1787119527.859196:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.859228:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119527.859236:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041df80 00000100:00100000:0.0:1787119527.859338:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1444 00000100:00100000:0.0:1787119527.859350:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633740544:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119527.859665:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633740544:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 317us (7290us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1787119527.859673:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1444 00002000:00100000:0.0:1787119527.859680:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a62041df80 x1873929633740544/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119527.859696:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041df80 with x1873929633740544 ext(393216->409599) 00010000:00010000:0.0:1787119527.859702:0:19246:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.859717:0:19246:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119527.859724:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041df80 00000100:00100000:0.0:1787119527.866172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.866267:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633740672 00000100:00100000:2.0:1787119527.866278:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633740672 00000100:00100000:2.0:1787119527.866344:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5665 00000100:00100000:2.0:1787119527.866355:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633740672:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.866375:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.866407:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e8d expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.866476:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 262) 00010000:00010000:2.0:1787119527.866486:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.866493:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 262) 00010000:00010000:2.0:1787119527.866499:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 23 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.866542:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.866558:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 23 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.866572:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894a00, rc 0) 00000100:00100000:2.0:1787119527.866638:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633740672:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 285us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.866645:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5665 00000100:00100000:0.0:1787119527.868183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119527.868269:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633740800 00000100:00100000:3.0:1787119527.868278:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633740800 00010000:00010000:3.0:1787119527.868317:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 23 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.868364:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5701 00000100:00100000:3.0:1787119527.868374:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2375:x1873929633740800:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119527.868399:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119527.868424:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 23 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.868490:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 23 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.868514:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e47e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e7f expref: 23 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.868533:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 262) 00010000:00010000:3.0:1787119527.868537:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 262) 00010000:00010000:3.0:1787119527.868546:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.868557:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.868590:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.868601:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 39 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119527.868611:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653705856:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.868671:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.871378:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653705856:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.871426:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.871513:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633740800:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3140us (3339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.871524:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5701 00000100:00100000:0.0:1787119527.875215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.875353:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633740928 00000100:00100000:2.0:1787119527.875364:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633740928 00002000:00100000:2.0:1787119527.875573:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a62041f480 x1873929633740928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.875585:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f480 with x1873929633740928 ext(393216->397311) 00010000:00010000:2.0:1787119527.875594:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.875626:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.875636:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041f480 00000100:00100000:2.0:1787119527.875962:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1445 00000100:00100000:2.0:1787119527.875975:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633740928:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119527.876223:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633740928:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 251us (1016us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119527.876235:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1445 00002000:00100000:2.0:1787119527.876241:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a62041f480 x1873929633740928/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.876250:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041f480 with x1873929633740928 ext(393216->397311) 00010000:00010000:2.0:1787119527.876257:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.876273:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.876281:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041f480 00000100:00100000:0.0:1787119527.880346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.880389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.880498:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633741184 00000100:00100000:1.0:1787119527.880508:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633741184 00010000:00010000:1.0:1787119527.880552:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.880586:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5702 00000100:00100000:1.0:1787119527.880595:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2374:x1873929633741184:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.880612:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.880635:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.880663:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.880691:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e47ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e86 expref: 40 pid: 6695 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.880710:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 262) 00010000:00010000:1.0:1787119527.880810:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 262) 00010000:00010000:1.0:1787119527.880879:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.880891:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.880939:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.880954:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653705984:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.881062:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.881504:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633741056 00000100:00100000:2.0:1787119527.881509:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633741056 00000100:00100000:2.0:1787119527.881545:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5666 00000100:00100000:2.0:1787119527.881553:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633741056:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.881568:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.881583:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e94 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.881606:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.881614:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 262) 00010000:00010000:2.0:1787119527.881618:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 262) 00010000:00010000:2.0:1787119527.881622:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.881644:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.881661:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 21 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.881672:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653706112:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.881703:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.886267:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653705984:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.886296:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.886353:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633741184:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5758us (5963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.886364:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5702 00000100:00100000:2.0:1787119527.886541:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653706112:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119527.886564:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.886586:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894000, rc 0) 00000100:00100000:2.0:1787119527.886613:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633741056:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5060us (6275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.886620:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5666 00000100:00100000:0.0:1787119527.892293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.892394:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633741312 00000100:00100000:2.0:1787119527.892407:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633741312 00010000:00010000:2.0:1787119527.892490:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.892535:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5703 00000100:00100000:2.0:1787119527.892545:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2373:x1873929633741312:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.892566:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.892592:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.892618:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.892647:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e47f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e8d expref: 22 pid: 20841 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.892668:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 262) 00010000:00010000:2.0:1787119527.892673:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 262) 00010000:00010000:2.0:1787119527.892682:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.892694:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.892732:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.892748:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653706240:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.892860:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.895767:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653706240:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.895797:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.895860:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2373:x1873929633741312:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3315us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.895871:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5703 00000100:00100000:3.0:1787119527.903603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.905109:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633741440 00000100:00100000:2.0:1787119527.905124:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633741440 00000100:00100000:2.0:1787119527.905191:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5667 00000100:00100000:2.0:1787119527.905202:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+21:33957:x1873929633741440:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.905231:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.905251:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716e9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.905288:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.905299:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 262) 00010000:00010000:2.0:1787119527.905304:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 262) 00010000:00010000:2.0:1787119527.905309:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.905344:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.905369:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 39 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.905383:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653706368:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119527.905517:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3600 going to sleep for 11 seconds 00010000:00010000:2.0:1787119527.905551:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119527.912435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.912532:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633741568 00000100:00100000:2.0:1787119527.912543:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633741568 00002000:00100000:2.0:1787119527.912593:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a62041d500 x1873929633741568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.912605:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633741568 ext(393216->397311) 00010000:00010000:2.0:1787119527.912614:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.912642:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.912650:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041d500 00000100:00100000:1.0:1787119527.912668:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653706368:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119527.912702:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.912720:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894a00, rc 0) 00000100:00100000:2.0:1787119527.912733:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1446 00000100:00100000:2.0:1787119527.912742:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2374:x1873929633741568:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119527.912789:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633741440:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7589us (9194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.912795:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5667 00000100:00100000:2.0:1787119527.913041:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2374:x1873929633741568:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 298us (614us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119527.913049:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1446 00002000:00100000:2.0:1787119527.913146:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a62041d500 x1873929633741568/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.913157:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633741568 ext(393216->397311) 00010000:00010000:2.0:1787119527.913163:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.913185:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 40 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.913191:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62041d500 00000100:00100000:0.0:1787119527.916349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.916460:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633741696 00000100:00100000:1.0:1787119527.916471:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633741696 00000100:00100000:1.0:1787119527.916576:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5668 00000100:00100000:1.0:1787119527.916586:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633741696:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119527.916604:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119527.916624:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ea2 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.916656:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 262) 00010000:00010000:1.0:1787119527.916664:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.916672:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 262) 00010000:00010000:1.0:1787119527.916678:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.916726:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.916741:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.916752:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:1.0:1787119527.916812:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633741696:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 227us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.916819:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5668 00000100:00100000:0.0:1787119527.919842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.919895:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633741824 00000100:00100000:1.0:1787119527.919905:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633741824 00010000:00010000:1.0:1787119527.919959:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 41 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.920004:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5704 00000100:00100000:1.0:1787119527.920014:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633741824:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.920030:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.920052:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 41 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.920074:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 41 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.920098:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e47fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e94 expref: 41 pid: 6696 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.920114:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 262) 00010000:00010000:1.0:1787119527.920238:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 262) 00010000:00010000:1.0:1787119527.920247:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.920258:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.920295:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.920310:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 21 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.920320:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653706624:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.920388:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.923301:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653706624:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119527.923322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:1.0:1787119527.923330:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.923396:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633741824:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3382us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.923408:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5704 00000100:00100000:3.0:1787119527.923477:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633741952 00000100:00100000:3.0:1787119527.923485:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633741952 00002000:00100000:3.0:1787119527.923538:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a62a126680 x1873929633741952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.923549:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126680 with x1873929633741952 ext(393216->409599) 00010000:00010000:3.0:1787119527.923558:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 22 pid: 6693 timeout: 1153 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.923592:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.923599:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a126680 00000100:00100000:3.0:1787119527.925586:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1447 00000100:00100000:3.0:1787119527.925609:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633741952:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119527.925932:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633741952:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 331us (2611us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119527.925941:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1447 00002000:00100000:3.0:1787119527.925951:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a62a126680 x1873929633741952/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119527.925962:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126680 with x1873929633741952 ext(393216->409599) 00010000:00010000:3.0:1787119527.925972:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.926011:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119527.926019:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a62a126680 00000100:00100000:0.0:1787119527.932974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.933057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.933124:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633742080 00000100:00100000:2.0:1787119527.933133:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633742080 00000100:00100000:2.0:1787119527.933181:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5669 00000100:00100000:2.0:1787119527.933187:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633742080:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119527.933203:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119527.933218:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ea9 expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.933247:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(140 262) 00010000:00010000:2.0:1787119527.933255:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.933262:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 262) 00010000:00010000:2.0:1787119527.933267:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 23 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.933307:0:20843:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.933319:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 23 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.933332:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894000, rc 0) 00000100:00100000:2.0:1787119527.933385:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633742080:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 199us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.933390:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5669 00000100:00100000:1.0:1787119527.934070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633742208 00000100:00100000:1.0:1787119527.934075:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633742208 00010000:00010000:1.0:1787119527.934097:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 23 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.934123:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5705 00000100:00100000:1.0:1787119527.934131:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2374:x1873929633742208:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.934142:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.934167:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 23 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.934191:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 23 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.934211:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4802 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716e9b expref: 23 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.934228:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 262) 00010000:00010000:1.0:1787119527.934231:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 262) 00010000:00010000:1.0:1787119527.934237:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.934253:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.934828:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.934850:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 39 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.934866:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653706880:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.934997:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.939776:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653706880:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.939812:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.939887:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2374:x1873929633742208:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5755us (6923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.939899:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5705 00000100:00100000:0.0:1787119527.946402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.946708:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633742336 00000100:00100000:2.0:1787119527.946719:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633742336 00010000:00010000:2.0:1787119527.946762:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.946825:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5706 00000100:00100000:2.0:1787119527.946835:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2373:x1873929633742336:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.946853:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.946877:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.946916:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.946949:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4809 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea2 expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.946967:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 262) 00010000:00010000:2.0:1787119527.946974:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 262) 00010000:00010000:2.0:1787119527.946984:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 21 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.946996:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 21 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.947035:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 21 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.947052:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653707008:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.947418:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.951380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.952522:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653707008:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.952550:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.953012:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2373:x1873929633742336:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6175us (6618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.953023:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5706 00000100:00100000:3.0:1787119527.954476:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633742464 00000100:00100000:3.0:1787119527.954490:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633742464 00000100:00100000:0.0:1787119527.955108:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5670 00000100:00100000:0.0:1787119527.955121:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633742464:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.955141:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.955162:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716eb0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.955197:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 21 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.955208:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 262) 00010000:00010000:0.0:1787119527.955213:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(143 262) 00010000:00010000:0.0:1787119527.955218:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.955267:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 21 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.955296:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 21 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119527.955311:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653707136:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119527.955404:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119527.963207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.963300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.963501:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653707136:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119527.963543:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.963568:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:3.0:1787119527.963596:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633742720 00000100:00100000:3.0:1787119527.963606:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633742720 00000100:00100000:2.0:1787119527.963644:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633742464:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8525us (12277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.963655:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5670 00000100:00100000:3.0:1787119527.963665:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5671 00000100:00100000:3.0:1787119527.963677:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633742720:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119527.963695:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119527.963712:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716eb7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.963737:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(143 262) 00010000:00010000:3.0:1787119527.963744:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.963752:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 262) 00010000:00010000:3.0:1787119527.963757:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.963803:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.963816:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119527.963828:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:3.0:1787119527.963852:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633742720:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 178us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119527.963858:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5671 00000100:00100000:1.0:1787119527.964210:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633742592 00000100:00100000:1.0:1787119527.964216:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633742592 00010000:00010000:1.0:1787119527.964241:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 23 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.964282:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5707 00000100:00100000:1.0:1787119527.964290:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2376:x1873929633742592:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.964300:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.964322:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 23 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.964348:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 23 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.964373:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ea9 expref: 23 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.964389:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 262) 00010000:00010000:1.0:1787119527.964393:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 262) 00010000:00010000:1.0:1787119527.964400:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.964409:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.964501:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 39 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.964518:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 39 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.964533:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653707392:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.964600:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.969426:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653707392:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119527.969542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.969641:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633742848 00000100:00100000:2.0:1787119527.969650:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633742848 00002000:00100000:2.0:1787119527.969717:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509231180 x1873929633742848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.969729:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633742848 ext(393216->397311) 00010000:00010000:2.0:1787119527.969740:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 40 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.969773:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 40 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.969782:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231180 00000100:00100000:2.0:1787119527.969828:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1448 00000100:00100000:2.0:1787119527.969838:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633742848:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119527.970105:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633742848:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 267us (1017us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119527.970113:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1448 00002000:00100000:2.0:1787119527.970131:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509231180 x1873929633742848/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:563/0 lens 488/4536 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.970140:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633742848 ext(393216->397311) 00010000:00010000:2.0:1787119527.970146:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 40 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.970160:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 40 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.970168:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509231180 00010000:00010000:1.0:1787119527.970831:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.970874:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2376:x1873929633742592:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6582us (7676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.970885:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5707 00000100:00100000:3.0:1787119527.972720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.972795:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633742976 00000100:00100000:1.0:1787119527.972805:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633742976 00000100:00100000:1.0:1787119527.972938:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5672 00000100:00100000:1.0:1787119527.972948:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633742976:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119527.972966:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119527.972985:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ebe expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.973021:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 262) 00010000:00010000:1.0:1787119527.973030:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.973037:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(146 262) 00010000:00010000:1.0:1787119527.973043:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.973085:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.973100:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.973114:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:1.0:1787119527.973952:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633742976:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1001us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.973961:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5672 00000100:00100000:3.0:1787119527.974602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119527.975487:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633743104 00000100:00100000:1.0:1787119527.975507:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633743104 00010000:00010000:1.0:1787119527.975548:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 41 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.975597:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5708 00000100:00100000:1.0:1787119527.975609:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633743104:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119527.975625:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119527.975653:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 41 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.975682:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 41 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.975722:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039135abd/0xcaba3de8463e4817 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb0 expref: 41 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.975743:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 262) 00010000:00010000:1.0:1787119527.975749:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 262) 00010000:00010000:1.0:1787119527.975758:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.975770:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.975808:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119527.975834:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 21 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119527.975848:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653707648:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119527.975953:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119527.978847:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653707648:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119527.978882:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119527.978964:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633743104:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3355us (4364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119527.978977:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5708 00000100:00100000:3.0:1787119527.981724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.981828:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633743232 00000100:00100000:2.0:1787119527.981838:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633743232 00002000:00100000:2.0:1787119527.981883:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6358ef050 x1873929633743232/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/0 e 0 to 0 dl 1787119538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.981894:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358ef050 with x1873929633743232 ext(393216->409599) 00010000:00010000:2.0:1787119527.981903:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.981945:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.981954:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6358ef050 00000100:00100000:2.0:1787119527.982004:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1449 00000100:00100000:2.0:1787119527.982014:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6358ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633743232:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119527.982304:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6358ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633743232:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 286us (583us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787119527.982313:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1449 00002000:00100000:2.0:1787119527.982320:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a6358ef050 x1873929633743232/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:563/0 lens 488/16824 e 0 to 0 dl 1787119538 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119527.982329:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6358ef050 with x1873929633743232 ext(393216->409599) 00010000:00010000:2.0:1787119527.982334:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.982348:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119527.982361:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6358ef050 00000100:00100000:3.0:1787119527.991856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119527.992478:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633743360 00000100:00100000:0.0:1787119527.992488:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633743360 00000100:00100000:0.0:1787119527.992558:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5673 00000100:00100000:0.0:1787119527.992569:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633743360:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119527.992587:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119527.992607:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ec5 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.992641:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 262) 00010000:00010000:0.0:1787119527.992651:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.992660:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 262) 00010000:00010000:0.0:1787119527.992665:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 23 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.992707:0:12469:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.992723:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 23 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119527.992737:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119527.992820:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633743360:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 253us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119527.992828:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5673 00000100:00100000:0.0:1787119527.995972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119527.996144:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633743488 00000100:00100000:2.0:1787119527.996156:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633743488 00010000:00010000:2.0:1787119527.996198:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 23 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.996239:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5709 00000100:00100000:2.0:1787119527.996249:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2373:x1873929633743488:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119527.996264:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119527.996288:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 23 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.996313:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 23 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.996340:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e481e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eb7 expref: 23 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.996359:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 262) 00010000:00010000:2.0:1787119527.996364:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 262) 00010000:00010000:2.0:1787119527.996372:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.996382:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.996422:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119527.996624:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 39 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119527.996642:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653707904:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119527.996731:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119527.999588:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653707904:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119527.999615:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119527.999677:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2373:x1873929633743488:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3428us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119527.999688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5709 00000100:00100000:3.0:1787119528.002511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.002764:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633743616 00000100:00100000:1.0:1787119528.002783:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633743616 00010000:00010000:1.0:1787119528.002842:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.002878:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5710 00000100:00100000:1.0:1787119528.002889:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2373:x1873929633743616:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.002903:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.002938:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.002975:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.003006:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4825 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ebe expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.003023:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 262) 00010000:00010000:1.0:1787119528.003028:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 262) 00010000:00010000:1.0:1787119528.003036:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.003047:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.003085:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.003111:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653708032:192.168.201.59@tcp:105: 00000100:00080000:3.0:1787119528.003239:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787119528.003375:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.007280:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653708032:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.007311:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.007414:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2373:x1873929633743616:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4526us (4913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.007426:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5710 00000100:00100000:2.0:1787119528.013851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.014407:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633743744 00000100:00100000:0.0:1787119528.014418:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633743744 00000100:00100000:0.0:1787119528.014566:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5674 00000100:00100000:0.0:1787119528.014577:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633743744:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119528.014599:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119528.014619:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ecc expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.014652:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.014662:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 262) 00010000:00010000:0.0:1787119528.014667:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(150 262) 00010000:00010000:0.0:1787119528.014671:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.014706:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 21 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.014731:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 21 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.014744:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653708160:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119528.014986:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.018688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.018734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.018823:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633744000 00000100:00100000:3.0:1787119528.018833:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633744000 00000100:00100000:3.0:1787119528.018904:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5675 00000100:00100000:3.0:1787119528.018928:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633744000:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.018947:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.018985:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ed3 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.019016:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(150 262) 00010000:00010000:3.0:1787119528.019024:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.019031:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 262) 00010000:00010000:3.0:1787119528.019037:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.019082:0:6693:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.019107:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.019120:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:3.0:1787119528.019172:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633744000:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 247us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.019179:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5675 00000100:00080000:2.0:1787119528.019401:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787119528.019699:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633743872 00000100:00100000:1.0:1787119528.019705:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633743872 00010000:00010000:1.0:1787119528.019727:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 23 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.019762:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5711 00000100:00100000:1.0:1787119528.019769:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2375:x1873929633743872:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.019779:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.019802:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 23 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.019826:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 23 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.019845:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(152 262) 00010000:00010000:1.0:1787119528.019849:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(152 262) 00010000:00010000:1.0:1787119528.019856:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.019865:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.019889:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.019902:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.019929:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653708416:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.020224:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd840 going to sleep for 11 seconds 00010000:00010000:0.0:1787119528.022968:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e482c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ec5 expref: 23 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.022996:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653708160:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.023030:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.023042:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.023062:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119528.023664:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633743744:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 9086us (9820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.023675:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5674 00000100:00100000:1.0:1787119528.027027:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653708416:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.027056:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.027239:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633743872:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7468us (8560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.027251:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5711 00000100:00100000:3.0:1787119528.030419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.030544:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633744128 00000100:00100000:0.0:1787119528.030555:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633744128 00002000:00100000:0.0:1787119528.030605:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509230a80 x1873929633744128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.030616:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633744128 ext(393216->397311) 00010000:00010000:0.0:1787119528.030625:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.030657:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119528.030666:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230a80 00000100:00100000:0.0:1787119528.030705:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1450 00000100:00100000:0.0:1787119528.030716:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633744128:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119528.031022:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633744128:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 307us (612us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119528.031035:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1450 00002000:00100000:0.0:1787119528.031042:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509230a80 x1873929633744128/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.031050:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230a80 with x1873929633744128 ext(393216->397311) 00010000:00010000:0.0:1787119528.031056:0:19243:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.031072:0:19243:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119528.031080:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230a80 00000100:00100000:2.0:1787119528.036303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.036352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.036561:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633744256 00000100:00100000:1.0:1787119528.036572:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633744256 00000100:00100000:1.0:1787119528.036638:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5676 00000100:00100000:1.0:1787119528.036649:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633744256:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119528.036670:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119528.036690:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716eda expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.036722:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(152 262) 00010000:00010000:1.0:1787119528.036730:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.036739:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 262) 00010000:00010000:1.0:1787119528.036744:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.036804:0:6695:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.036819:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.036833:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:1.0:1787119528.036895:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633744256:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 247us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.036902:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5676 00000100:00100000:0.0:1787119528.037667:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633744384 00000100:00100000:0.0:1787119528.037674:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633744384 00010000:00010000:0.0:1787119528.037704:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 41 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.037744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5712 00000100:00100000:0.0:1787119528.037753:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633744384:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.037766:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.037801:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 41 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.037826:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 41 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.037853:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e4833 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ecc expref: 41 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.037871:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 262) 00010000:00010000:0.0:1787119528.037876:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 262) 00010000:00010000:0.0:1787119528.037884:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.037894:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.037943:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.038206:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 21 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.038224:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653708672:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.038341:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.044682:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.045123:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653708672:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.045148:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.045213:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633744384:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7461us (8860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.045228:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5712 00000100:00100000:3.0:1787119528.045471:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633744512 00000100:00100000:3.0:1787119528.045480:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633744512 00002000:00100000:3.0:1787119528.045531:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a508fffb80 x1873929633744512/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.045542:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fffb80 with x1873929633744512 ext(393216->409599) 00010000:00010000:3.0:1787119528.045552:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.045581:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119528.045590:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508fffb80 00000100:00100000:3.0:1787119528.045625:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1451 00000100:00100000:3.0:1787119528.045635:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633744512:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.045887:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633744512:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 253us (1216us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1787119528.045894:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1451 00002000:00100000:3.0:1787119528.045900:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (393216->409599) req@ffff92a508fffb80 x1873929633744512/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/16824 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.045920:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fffb80 with x1873929633744512 ext(393216->409599) 00010000:00010000:3.0:1787119528.045925:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.045939:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119528.045945:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508fffb80 00000100:00100000:0.0:1787119528.051809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.051986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.052313:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633744768 00000100:00100000:3.0:1787119528.052324:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633744768 00010000:00010000:3.0:1787119528.052365:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.052412:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5713 00000100:00100000:3.0:1787119528.052422:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633744768:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.052479:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.052504:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.052530:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.052560:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e483a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ed3 expref: 22 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.052579:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 262) 00010000:00010000:3.0:1787119528.052586:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 262) 00010000:00010000:3.0:1787119528.052595:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.052605:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.052647:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.052662:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653708800:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.052738:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.055336:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653708800:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119528.055369:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119528.055426:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2375:x1873929633744768:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3004us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.055466:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5713 00000100:00100000:1.0:1787119528.056559:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633744640 00000100:00100000:1.0:1787119528.056569:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633744640 00000100:00100000:1.0:1787119528.056626:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5677 00000100:00100000:1.0:1787119528.056634:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+21:33957:x1873929633744640:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119528.056651:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119528.056669:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ee1 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.056701:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.056710:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 262) 00010000:00010000:1.0:1787119528.056714:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 262) 00010000:00010000:1.0:1787119528.056719:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.056750:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.056772:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 39 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.056798:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653708928:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119528.057067:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.060845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.061528:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653708928:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.061564:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.061589:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:3.0:1787119528.061654:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633744640:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5020us (9854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.061664:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5677 00000100:00100000:2.0:1787119528.062946:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633744896 00000100:00100000:2.0:1787119528.062971:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633744896 00010000:00010000:2.0:1787119528.063021:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.063061:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5714 00000100:00100000:2.0:1787119528.063069:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633744896:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119528.063084:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119528.063276:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.063303:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.063327:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e4841 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716eda expref: 40 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.063344:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 262) 00010000:00010000:2.0:1787119528.063348:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 262) 00010000:00010000:2.0:1787119528.063357:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.063366:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.063402:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.063415:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653709056:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119528.063537:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.066719:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653709056:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.066746:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.066892:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633744896:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3822us (6058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.066916:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5714 00000100:00100000:1.0:1787119528.073202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.073302:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633745024 00000100:00100000:3.0:1787119528.073312:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633745024 00000100:00100000:3.0:1787119528.073405:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5678 00000100:00100000:3.0:1787119528.073416:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:33946:x1873929633745024:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.073435:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.073475:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ee8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.073512:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.073523:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 262) 00010000:00010000:3.0:1787119528.073527:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(156 262) 00010000:00010000:3.0:1787119528.073532:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.073567:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 21 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.073593:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 21 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.073608:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653709184:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.073692:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.076629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.076733:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633745152 00000100:00100000:1.0:1787119528.076744:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633745152 00010000:00010000:1.0:1787119528.076791:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 22 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.076830:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5715 00000100:00100000:1.0:1787119528.076841:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633745152:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.076856:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.076880:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 22 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.076920:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 22 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.076950:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(156 262) 00010000:00010000:1.0:1787119528.076965:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(156 262) 00010000:00010000:1.0:1787119528.076980:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.076991:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.077032:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.077047:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072faa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653709312:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.077125:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd480 going to sleep for 11 seconds 00010000:00010000:3.0:1787119528.077475:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e4848 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee1 expref: 22 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.077491:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653709184:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.077523:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.077533:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:3.0:1787119528.077569:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633745024:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4156us (4376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.077577:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5678 00000100:00100000:2.0:1787119528.086249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.086495:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072faa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653709312:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.086520:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.086584:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2375:x1873929633745152:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9743us (9964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.086595:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5715 00000100:00100000:1.0:1787119528.088136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.088349:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633745408 00000100:00100000:2.0:1787119528.088360:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633745408 00002000:00100000:2.0:1787119528.088418:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a6072fad80 x1873929633745408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.088429:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fad80 with x1873929633745408 ext(393216->397311) 00002000:00010000:2.0:1787119528.088435:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fad80 00000100:00100000:2.0:1787119528.088494:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10733 00000100:00100000:2.0:1787119528.088503:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633745408:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.088748:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633745408:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 245us (621us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119528.088756:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10733 00002000:00100000:2.0:1787119528.088762:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a6072fad80 x1873929633745408/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.088770:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fad80 with x1873929633745408 ext(393216->397311) 00002000:00010000:2.0:1787119528.088774:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fad80 00000100:00100000:0.0:1787119528.092550:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633745280 00000100:00100000:0.0:1787119528.092567:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633745280 00000100:00100000:1.0:1787119528.092726:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5679 00000100:00100000:1.0:1787119528.092739:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+21:33957:x1873929633745280:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119528.092761:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119528.092793:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716eef expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.092828:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 39 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.092838:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(156 262) 00010000:00010000:1.0:1787119528.092842:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 262) 00010000:00010000:1.0:1787119528.092847:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.092884:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 39 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.092921:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 39 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.092937:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653709440:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119528.093148:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.097395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.097667:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633745536 00000100:00100000:2.0:1787119528.097678:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633745536 00002000:00100000:2.0:1787119528.097733:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff92a6072f9500 x1873929633745536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.097745:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9500 with x1873929633745536 ext(397312->401407) 00010000:00010000:2.0:1787119528.097756:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.097801:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.097810:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072f9500 00000100:00100000:2.0:1787119528.097848:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1452 00000100:00100000:2.0:1787119528.097859:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633745536:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.098141:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633745536:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 284us (757us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119528.098149:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1452 00002000:00100000:2.0:1787119528.098156:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff92a6072f9500 x1873929633745536/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.098165:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f9500 with x1873929633745536 ext(397312->401407) 00010000:00010000:2.0:1787119528.098170:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.098185:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.098192:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072f9500 00000100:00100000:3.0:1787119528.098936:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653709440:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.098970:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.098990:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1800, rc 0) 00000100:00100000:3.0:1787119528.099043:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633745280:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6307us (12807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.099050:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5679 00000100:00100000:2.0:1787119528.122510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.122561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.122592:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633745664 00000100:00100000:2.0:1787119528.122602:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633745664 00002000:00100000:2.0:1787119528.122655:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a508ffc700 x1873929633745664/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 4584/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.122666:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc700 with x1873929633745664 ext(393216->397311) 00010000:00010000:2.0:1787119528.122676:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.122707:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 40 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.122716:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffc700 00000100:00100000:2.0:1787119528.122750:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1453 00000100:00100000:2.0:1787119528.122759:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633745664:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119528.126144:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633745792 00000100:00100000:2.0:1787119528.126161:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633745792 00000100:00100000:2.0:1787119528.126220:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5680 00000100:00100000:2.0:1787119528.126230:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633745792:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.126248:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.126268:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ef6 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.126303:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 262) 00010000:00010000:2.0:1787119528.126309:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 262) 00010000:00010000:2.0:1787119528.126317:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.126330:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.126342:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895600, rc 0) 00000100:00100000:2.0:1787119528.126419:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633745792:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 189us (3857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.126426:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5680 00000100:00100000:2.0:1787119528.126771:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2376:x1873929633745664:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 4011us (4272us total) trans 4294969273 rc 0/0 00000100:00100000:2.0:1787119528.126779:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1453 00002000:00100000:2.0:1787119528.126788:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a508ffc700 x1873929633745664/t4294969273(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 4584/448 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.126798:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc700 with x1873929633745664 ext(393216->397311) 00010000:00010000:2.0:1787119528.126805:0:20606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 43 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.126830:0:20606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 43 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.126838:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a508ffc700 00000100:00100000:2.0:1787119528.137352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.138030:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633745920 00000100:00100000:1.0:1787119528.138041:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633745920 00010000:00010000:1.0:1787119528.138083:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 43 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.138129:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5716 00000100:00100000:1.0:1787119528.138139:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2374:x1873929633745920:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.138154:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787119528.138174:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119525 -> 1787119526 00002000:00010000:1.0:1787119528.138178:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119525 -> 1787119526 00010000:00010000:1.0:1787119528.138185:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 43 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.138211:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 43 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.138244:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e484f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [393216->33947647] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ee8 expref: 43 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.138261:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 262) 00010000:00010000:1.0:1787119528.138266:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 262) 00010000:00010000:1.0:1787119528.138275:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.138285:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.138295:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 262) 00010000:00010000:1.0:1787119528.138297:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 262) 00010000:00010000:1.0:1787119528.138302:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.138311:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.138349:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.138366:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653709568:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.138492:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 21 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.138504:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653709696:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.138529:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.144502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.144630:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633746048 00000100:00100000:0.0:1787119528.144642:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633746048 00002000:00100000:0.0:1787119528.144694:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509231c00 x1873929633746048/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.144705:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633746048 ext(393216->397311) 00002000:00010000:0.0:1787119528.144710:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231c00 00000100:00100000:0.0:1787119528.144742:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10734 00000100:00100000:0.0:1787119528.144751:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633746048:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119528.144940:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633746048:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 189us (449us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119528.144947:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10734 00002000:00100000:0.0:1787119528.144964:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff92a509231c00 x1873929633746048/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.144972:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231c00 with x1873929633746048 ext(393216->397311) 00002000:00010000:0.0:1787119528.144975:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231c00 00000100:00100000:2.0:1787119528.145508:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653709568:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119528.145525:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653709696:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.145551:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.145593:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2374:x1873929633745920:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7456us (8253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.145602:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5716 00000100:00100000:3.0:1787119528.149831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.150069:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633746176 00000100:00100000:2.0:1787119528.150079:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633746176 00000100:00100000:2.0:1787119528.150194:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5681 00000100:00100000:2.0:1787119528.150205:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633746176:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.150226:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.150246:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716efd expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.150286:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.150298:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 262) 00010000:00010000:2.0:1787119528.150303:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 262) 00010000:00010000:2.0:1787119528.150309:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.150351:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 41 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.150383:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 41 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.150407:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653709824:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.150508:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.162414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.162593:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653709824:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.162633:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 23 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.162658:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894800, rc 0) 00000100:00100000:3.0:1787119528.162722:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633746176:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 12519us (12901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.162732:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5681 00000100:00100000:2.0:1787119528.163278:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633746304 00000100:00100000:2.0:1787119528.163288:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633746304 00002000:00100000:2.0:1787119528.163335:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff92a512845f80 x1873929633746304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.163346:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845f80 with x1873929633746304 ext(397312->401407) 00010000:00010000:2.0:1787119528.163355:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.163384:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.163393:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845f80 00000100:00100000:2.0:1787119528.163420:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1454 00000100:00100000:2.0:1787119528.163429:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633746304:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.163709:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633746304:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 279us (1305us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119528.163717:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1454 00002000:00100000:2.0:1787119528.163725:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff92a512845f80 x1873929633746304/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.163733:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845f80 with x1873929633746304 ext(397312->401407) 00010000:00010000:2.0:1787119528.163739:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.163753:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.163760:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512845f80 00000100:00100000:0.0:1787119528.176602:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.176686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.176762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633746560 00000100:00100000:2.0:1787119528.176781:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633746560 00010000:00010000:2.0:1787119528.176827:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.176871:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5717 00000100:00100000:2.0:1787119528.176881:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633746560:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119528.176899:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119528.176935:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.176968:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.176992:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e485d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ef6 expref: 42 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.177011:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 262) 00010000:00010000:2.0:1787119528.177016:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 262) 00010000:00010000:2.0:1787119528.177025:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.177034:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.177068:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.177081:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653709952:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119528.177172:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.178036:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633746432 00000100:00100000:1.0:1787119528.178045:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633746432 00000100:00100000:1.0:1787119528.178227:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5682 00000100:00100000:1.0:1787119528.178239:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633746432:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119528.178257:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119528.178279:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f04 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.178307:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.178316:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 262) 00010000:00010000:1.0:1787119528.178320:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 262) 00010000:00010000:1.0:1787119528.178325:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 43 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.178354:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.178376:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 22 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.178395:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653710080:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119528.178548:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.183586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.183790:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653709952:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.183820:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.183891:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2375:x1873929633746560:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7010us (7203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.183916:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5717 00000100:00100000:1.0:1787119528.184228:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633746688 00000100:00100000:1.0:1787119528.184237:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633746688 00002000:00100000:1.0:1787119528.184285:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a512846d80 x1873929633746688/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.184296:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846d80 with x1873929633746688 ext(397312->409599) 00010000:00010000:1.0:1787119528.184306:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 23 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.184335:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 23 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119528.184343:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512846d80 00000100:00100000:1.0:1787119528.184376:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1455 00000100:00100000:1.0:1787119528.184395:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2376:x1873929633746688:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.184637:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2376:x1873929633746688:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 242us (1059us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119528.184645:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1455 00002000:00100000:1.0:1787119528.184652:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a512846d80 x1873929633746688/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/12728 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787119528.184658:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653710080:192.168.201.59@tcp:104: 00002000:00100000:1.0:1787119528.184663:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846d80 with x1873929633746688 ext(397312->409599) 00010000:00010000:1.0:1787119528.184672:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 23 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.184690:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 42 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.184691:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 23 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119528.184716:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a512846d80 00010000:00010000:3.0:1787119528.184735:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:3.0:1787119528.185221:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633746432:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6972us (8617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.185229:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5682 00000100:00100000:0.0:1787119528.192643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.192731:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633746816 00000100:00100000:3.0:1787119528.192744:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633746816 00000100:00100000:3.0:1787119528.192818:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5683 00000100:00100000:3.0:1787119528.192828:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633746816:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.192847:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.192866:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f0b expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.192899:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 262) 00010000:00010000:3.0:1787119528.192921:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.192928:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(161 262) 00010000:00010000:3.0:1787119528.192933:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 24 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.192988:0:20841:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.193005:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 24 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.193019:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:3.0:1787119528.193088:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+24:33957:x1873929633746816:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 261us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.193096:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5683 00000100:00100000:1.0:1787119528.194883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.194992:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633746944 00000100:00100000:0.0:1787119528.195003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633746944 00010000:00010000:0.0:1787119528.195041:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 24 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.195083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5718 00000100:00100000:0.0:1787119528.195093:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2376:x1873929633746944:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.195108:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.195133:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 24 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.195161:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 24 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.195188:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e4864 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716efd expref: 24 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.195210:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 262) 00010000:00010000:0.0:1787119528.195215:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 262) 00010000:00010000:0.0:1787119528.195224:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.195235:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.195271:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.195294:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 41 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.195308:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653710336:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.195405:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.201221:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653710336:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.201252:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.201318:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2376:x1873929633746944:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6225us (6442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.201332:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5718 00000100:00100000:3.0:1787119528.202563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.203672:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633747072 00000100:00100000:2.0:1787119528.203685:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633747072 00010000:00010000:2.0:1787119528.203728:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 42 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.203763:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5719 00000100:00100000:2.0:1787119528.203771:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2373:x1873929633747072:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119528.203785:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119528.203809:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 42 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.203842:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 42 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.203945:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e486b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f04 expref: 42 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.203964:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 262) 00010000:00010000:2.0:1787119528.203969:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 262) 00010000:00010000:2.0:1787119528.204026:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.204038:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.204084:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.204099:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653710464:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119528.204187:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.207265:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653710464:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.207294:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.207550:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633747072:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3777us (4991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.207563:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5719 00000100:00100000:0.0:1787119528.224069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.224248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.224485:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633747328 00000100:00100000:3.0:1787119528.224497:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633747328 00002000:00100000:3.0:1787119528.224563:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a512845880 x1873929633747328/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.224576:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845880 with x1873929633747328 ext(397312->409599) 00002000:00010000:3.0:1787119528.224585:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845880 00000100:00100000:3.0:1787119528.224634:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10735 00000100:00100000:3.0:1787119528.224646:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2376:x1873929633747328:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.225593:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2376:x1873929633747328:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 944us (1340us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1787119528.225603:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10735 00002000:00100000:3.0:1787119528.225611:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a512845880 x1873929633747328/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/12728 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.225621:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845880 with x1873929633747328 ext(397312->409599) 00002000:00010000:3.0:1787119528.225626:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845880 00000100:00100000:2.0:1787119528.230796:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633747200 00000100:00100000:2.0:1787119528.230815:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633747200 00000100:00100000:2.0:1787119528.233239:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5684 00000100:00100000:2.0:1787119528.233255:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633747200:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.233282:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.233307:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f12 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.233345:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.233355:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 262) 00010000:00010000:2.0:1787119528.233359:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 262) 00010000:00010000:2.0:1787119528.233364:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.233417:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 22 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.233479:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 22 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.233497:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653710592:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.233591:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.249550:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653710592:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.249595:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.249621:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894400, rc 0) 00000100:00100000:2.0:1787119528.249752:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633747200:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 16499us (25697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.249762:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5684 00000100:00100000:1.0:1787119528.259475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.259666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.259818:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633747456 00000100:00100000:2.0:1787119528.259830:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633747456 00000100:00100000:2.0:1787119528.259897:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5685 00000100:00100000:2.0:1787119528.259919:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633747456:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.259941:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.259963:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f19 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.259996:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 262) 00010000:00010000:2.0:1787119528.260004:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.260011:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 262) 00010000:00010000:2.0:1787119528.260017:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 24 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.260057:0:8267:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.260073:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 24 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.260087:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894000, rc 0) 00000100:00100000:2.0:1787119528.260142:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+24:33957:x1873929633747456:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 224us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.260151:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5685 00000100:00100000:0.0:1787119528.264267:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633747584 00000100:00100000:0.0:1787119528.264283:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633747584 00010000:00010000:0.0:1787119528.264332:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 24 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.264367:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5720 00000100:00100000:0.0:1787119528.264376:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2375:x1873929633747584:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.264403:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.264427:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 24 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.264473:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 24 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.264507:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4872 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f0b expref: 24 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.264524:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 262) 00010000:00010000:0.0:1787119528.264530:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 262) 00010000:00010000:0.0:1787119528.264539:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.264551:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60080000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.264596:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.264613:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 41 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.264628:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653710848:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.264732:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.272402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.272541:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653710848:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.272567:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.272626:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2375:x1873929633747584:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8250us (12960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.272638:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5720 00000100:00100000:3.0:1787119528.273098:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633747712 00000100:00100000:3.0:1787119528.273108:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633747712 00002000:00100000:3.0:1787119528.273256:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff92a6072f8000 x1873929633747712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.273268:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8000 with x1873929633747712 ext(397312->401407) 00010000:00010000:3.0:1787119528.273278:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.273311:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119528.273319:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072f8000 00000100:00100000:3.0:1787119528.273355:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1456 00000100:00100000:3.0:1787119528.273366:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633747712:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.274875:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633747712:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1315us (2289us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119528.274889:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1456 00002000:00100000:3.0:1787119528.274909:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff92a6072f8000 x1873929633747712/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.274920:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8000 with x1873929633747712 ext(397312->401407) 00010000:00010000:3.0:1787119528.274931:0:20836:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.278018:0:20836:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119528.278154:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072f8000 00000100:00100000:1.0:1787119528.278568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.278654:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633747840 00000100:00100000:0.0:1787119528.278664:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633747840 00010000:00010000:0.0:1787119528.278703:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.278744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5721 00000100:00100000:0.0:1787119528.278754:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2374:x1873929633747840:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.278779:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.278804:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.278823:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.278847:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e4879 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f12 expref: 42 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.278869:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 262) 00010000:00010000:0.0:1787119528.278874:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 262) 00010000:00010000:0.0:1787119528.278883:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.278894:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.278942:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.278956:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653710976:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.279043:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.286192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.286349:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653710976:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.286376:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.286497:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633747840:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7743us (7930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.286508:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5721 00000100:00100000:3.0:1787119528.286625:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633747968 00000100:00100000:3.0:1787119528.286633:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633747968 00000100:00100000:3.0:1787119528.286685:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5686 00000100:00100000:3.0:1787119528.286695:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633747968:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.286712:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.286730:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f20 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.287627:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.287641:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 262) 00010000:00010000:3.0:1787119528.287645:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 262) 00010000:00010000:3.0:1787119528.287651:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 42 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.287688:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 22 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.287716:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 22 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.287733:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653711104:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.287856:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.295052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.295201:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633748096 00000100:00100000:1.0:1787119528.295211:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633748096 00010000:00010000:1.0:1787119528.295256:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 23 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.295311:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5722 00000100:00100000:1.0:1787119528.295322:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2375:x1873929633748096:12345-192.168.201.59@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787119528.295331:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653711104:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119528.295339:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.295370:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 23 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.295376:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 42 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.295401:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00010000:00010000:1.0:1787119528.295493:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 23 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.295497:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633747968:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 8795us (9308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.295510:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5686 00010000:00010000:1.0:1787119528.295525:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e4880 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f19 expref: 23 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.295543:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 262) 00010000:00010000:1.0:1787119528.295549:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 262) 00010000:00010000:1.0:1787119528.295557:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.295568:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.295600:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.295614:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653711232:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.295666:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.314397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.314658:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653711232:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.314703:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.314770:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2375:x1873929633748096:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 19449us (19730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.314782:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5722 00000100:00100000:2.0:1787119528.314792:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633748224 00000100:00100000:2.0:1787119528.314804:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633748224 00000100:00100000:2.0:1787119528.314925:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5687 00000100:00100000:2.0:1787119528.314938:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+22:33957:x1873929633748224:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.314962:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.314988:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f27 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.315031:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.315043:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 262) 00010000:00010000:2.0:1787119528.315047:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 262) 00010000:00010000:2.0:1787119528.315052:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 23 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.315088:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.315113:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 41 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.315128:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653711360:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.315204:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.317065:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653711360:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.317110:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 23 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.317135:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895e00, rc 0) 00000100:00100000:2.0:1787119528.317209:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+23:33957:x1873929633748224:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2272us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.317218:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5687 00000100:00100000:3.0:1787119528.317681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.317954:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633748352 00000100:00100000:2.0:1787119528.317962:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633748352 00010000:00010000:2.0:1787119528.317995:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 42 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.318214:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5723 00000100:00100000:2.0:1787119528.318223:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633748352:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119528.318238:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119528.318261:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 42 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.318285:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 42 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.318321:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e4887 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f20 expref: 42 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.318342:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 262) 00010000:00010000:2.0:1787119528.318346:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 262) 00010000:00010000:2.0:1787119528.318354:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 22 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.318363:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 22 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.318395:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 22 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.318408:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653711488:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119528.318534:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.323846:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653711488:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.323871:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.323966:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633748352:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5742us (6286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.323978:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5723 00000100:00100000:1.0:1787119528.327404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.327568:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633748480 00000100:00100000:2.0:1787119528.327582:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633748480 00002000:00100000:2.0:1787119528.327639:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a6072fbb80 x1873929633748480/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.327652:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fbb80 with x1873929633748480 ext(397312->409599) 00002000:00010000:2.0:1787119528.327658:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fbb80 00000100:00100000:1.0:1787119528.327735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.327818:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633748608 00000100:00100000:3.0:1787119528.327823:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633748608 00000100:00100000:3.0:1787119528.327860:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5688 00000100:00100000:3.0:1787119528.327868:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633748608:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.327881:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.327909:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f2e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.327946:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 23 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.327957:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 262) 00010000:00010000:3.0:1787119528.327961:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 262) 00010000:00010000:3.0:1787119528.327966:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.328009:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 23 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.328038:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 23 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.328054:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653711616:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.328131:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.328251:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1457 00000100:00100000:2.0:1787119528.328259:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2374:x1873929633748480:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.328466:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2374:x1873929633748480:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 207us (1070us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119528.328474:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1457 00002000:00100000:2.0:1787119528.328480:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a6072fbb80 x1873929633748480/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/12728 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.328489:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fbb80 with x1873929633748480 ext(397312->409599) 00010000:00010000:2.0:1787119528.328495:0:19245:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 23 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.328510:0:19245:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 23 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.328518:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a6072fbb80 00000100:00100000:3.0:1787119528.334200:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653711616:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.334246:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 42 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.334272:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430c00, rc 0) 00000100:00100000:3.0:1787119528.334344:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633748608:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6474us (6607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.334353:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5688 00000100:00100000:3.0:1787119528.358206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.358320:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633748736 00000100:00100000:1.0:1787119528.358331:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633748736 00002000:00100000:1.0:1787119528.358391:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (0->409599) req@ffff92a509230000 x1873929633748736/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 504/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.358402:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633748736 ext(0->409599) 00010000:00010000:1.0:1787119528.358434:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 23 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.358511:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 23 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119528.358520:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230000 00000100:00100000:1.0:1787119528.358564:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1458 00000100:00100000:1.0:1787119528.358575:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+23:2376:x1873929633748736:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1787119528.365924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.367314:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633748864 00000100:00100000:1.0:1787119528.367324:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633748864 00000100:00100000:1.0:1787119528.367394:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5689 00000100:00100000:1.0:1787119528.367404:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633748864:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119528.367422:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119528.367473:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f35 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.367513:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.367523:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 262) 00010000:00010000:1.0:1787119528.367528:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 262) 00010000:00010000:1.0:1787119528.367533:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 27 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.367581:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 41 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.367594:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 41 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.367608:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653711744:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.367690:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633748736:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 9115us (9493us total) trans 4294969274 rc 0/0 00000100:00100000:2.0:1787119528.367700:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1458 00002000:00100000:2.0:1787119528.367710:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (0->409599) req@ffff92a509230000 x1873929633748736/t4294969274(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 504/448 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.367720:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509230000 with x1873929633748736 ext(0->409599) 00010000:00010000:2.0:1787119528.367745:0:19255:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 27 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.367773:0:19255:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 27 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.367782:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a509230000 00000100:00100000:1.0:1787119528.377009:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.387374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.387618:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633748992 00000100:00100000:1.0:1787119528.387629:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633748992 00010000:00010000:1.0:1787119528.387669:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 27 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.387713:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5724 00000100:00100000:1.0:1787119528.387723:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633748992:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.387739:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787119528.387760:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1787119526 -> 1787119527 00002000:00010000:1.0:1787119528.387763:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1787119526 -> 1787119527 00010000:00010000:1.0:1787119528.387770:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 27 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.387782:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 27 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.387822:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e488e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f27 expref: 27 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.387839:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 262) 00010000:00010000:1.0:1787119528.387844:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 262) 00010000:00010000:1.0:1787119528.387853:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.387863:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.387915:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 41 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.387929:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653711872:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.388015:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.389088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.389165:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633749120 00000100:00100000:3.0:1787119528.389171:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633749120 00010000:00010000:3.0:1787119528.389202:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 42 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.389241:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5725 00000100:00100000:3.0:1787119528.389250:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2375:x1873929633749120:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.389263:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.389279:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 42 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.389310:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 42 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.389334:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 262) 00010000:00010000:3.0:1787119528.389339:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 262) 00010000:00010000:3.0:1787119528.389348:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.389357:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.389388:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.389400:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653712000:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.389497:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00010000:00010000:1.0:1787119528.389879:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004def2f00/0xcaba3de8463e3b60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047161f9 expref: 42 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.389912:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653711744:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119528.389940:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 26 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.389952:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0000, rc 0) 00000100:00100000:1.0:1787119528.390103:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633748864:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 22699us (24200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.390112:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5689 00000100:00100000:1.0:1787119528.395996:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1873929653711872:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.396034:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.396109:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2376:x1873929633748992:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8387us (8745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.396120:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5724 00000100:00100000:2.0:1787119528.396584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.397608:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633749248 00000100:00100000:1.0:1787119528.397620:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633749248 00002000:00100000:1.0:1787119528.397671:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff92a508ffea00 x1873929633749248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.397682:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffea00 with x1873929633749248 ext(397312->401407) 00002000:00010000:1.0:1787119528.397688:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffea00 00000100:00100000:1.0:1787119528.397713:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10737 00000100:00100000:1.0:1787119528.397722:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633749248:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.397939:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:2376:x1873929633749248:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 218us (2395us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119528.397948:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10737 00002000:00100000:1.0:1787119528.397955:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff92a508ffea00 x1873929633749248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.397964:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffea00 with x1873929633749248 ext(397312->401407) 00002000:00010000:1.0:1787119528.397968:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffea00 00000100:00100000:3.0:1787119528.398532:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653712000:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.398744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119528.399270:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119528.399335:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633749120:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10083us (10249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.399346:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5725 00000100:00100000:1.0:1787119528.401526:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633749376 00000100:00100000:1.0:1787119528.401541:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633749376 00002000:00100000:1.0:1787119528.401605:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (86016->122879) req@ffff92a512846a00 x1873929633749376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.401616:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633749376 ext(86016->122879) 00002000:00010000:1.0:1787119528.401621:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846a00 00000100:00100000:1.0:1787119528.401651:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10738 00000100:00100000:1.0:1787119528.401659:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2376:x1873929633749376:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.414170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.414382:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2376:x1873929633749376:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 12721us (15637us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119528.414395:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10738 00002000:00100000:3.0:1787119528.414408:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (86016->122879) req@ffff92a512846a00 x1873929633749376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/440 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.414420:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846a00 with x1873929633749376 ext(86016->122879) 00002000:00010000:3.0:1787119528.414426:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846a00 00000100:00100000:3.0:1787119528.414499:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633749504 00000100:00100000:3.0:1787119528.414507:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633749504 00002000:00100000:3.0:1787119528.414542:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (401408->405503) req@ffff92a508ffd880 x1873929633749504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.414550:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd880 with x1873929633749504 ext(401408->405503) 00002000:00010000:3.0:1787119528.414564:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd880 00000100:00100000:3.0:1787119528.414588:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10739 00000100:00100000:3.0:1787119528.414598:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633749504:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.414753:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633749504:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 155us (593us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119528.414760:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10739 00002000:00100000:3.0:1787119528.414780:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (401408->405503) req@ffff92a508ffd880 x1873929633749504/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.414789:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffd880 with x1873929633749504 ext(401408->405503) 00002000:00010000:3.0:1787119528.414793:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffd880 00000100:00100000:2.0:1787119528.421923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.421971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.422004:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633749632 00000100:00100000:3.0:1787119528.422014:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633749632 00000100:00100000:0.0:1787119528.422060:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633749760 00000100:00100000:0.0:1787119528.422065:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633749760 00000100:00100000:3.0:1787119528.422073:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5690 00000100:00100000:3.0:1787119528.422082:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+25:33957:x1873929633749632:12345-192.168.201.59@tcp:101:mmap_sanity.0 00002000:00100000:0.0:1787119528.422100:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (405504->409599) req@ffff92a508ffe300 x1873929633749760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787119528.422105:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1787119528.422109:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633749760 ext(405504->409599) 00002000:00010000:0.0:1787119528.422114:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffe300 00010000:00010000:3.0:1787119528.422123:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f3c expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.422140:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10740 00000100:00100000:0.0:1787119528.422146:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633749760:12345-192.168.201.59@tcp:3:kworker.0 00010000:00010000:3.0:1787119528.422155:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.422164:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 262) 00010000:00010000:3.0:1787119528.422168:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 262) 00010000:00010000:3.0:1787119528.422172:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.422202:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 41 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.422227:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 41 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.422241:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653712128:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.422319:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.422429:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633749760:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 282us (457us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119528.422472:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10740 00002000:00100000:0.0:1787119528.422480:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (405504->409599) req@ffff92a508ffe300 x1873929633749760/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.422489:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffe300 with x1873929633749760 ext(405504->409599) 00002000:00010000:0.0:1787119528.422492:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffe300 00000100:00100000:3.0:1787119528.424637:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653712128:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.425369:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 26 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.425409:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430800, rc 0) 00000100:00100000:3.0:1787119528.425529:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633749632:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3446us (3636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.425541:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5690 00000100:00100000:2.0:1787119528.425658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.425889:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633749888 00000100:00100000:0.0:1787119528.425896:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633749888 00010000:00010000:0.0:1787119528.425940:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 41 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.425974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5726 00000100:00100000:0.0:1787119528.425983:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633749888:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.425999:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.426022:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 41 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.426048:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 41 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.426073:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000648d1e51/0xcaba3de8463e3b6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716207 expref: 41 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.426088:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 262) 00010000:00010000:0.0:1787119528.426092:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 262) 00010000:00010000:0.0:1787119528.426100:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.426111:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.426148:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.426163:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512845c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653712256:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.426232:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.429199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.429304:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512845c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653712256:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.429326:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.429380:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2376:x1873929633749888:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3398us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.429392:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5726 00000100:00100000:1.0:1787119528.430000:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633750016 00000100:00100000:1.0:1787119528.430009:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633750016 00002000:00100000:1.0:1787119528.430052:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (122880->159743) req@ffff92a508ffed80 x1873929633750016/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.430062:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffed80 with x1873929633750016 ext(122880->159743) 00002000:00010000:1.0:1787119528.430067:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffed80 00000100:00100000:1.0:1787119528.430095:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10741 00000100:00100000:1.0:1787119528.430104:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633750016:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.433391:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2376:x1873929633750016:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3276us (4189us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119528.433409:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10741 00002000:00100000:1.0:1787119528.433422:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (122880->159743) req@ffff92a508ffed80 x1873929633750016/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/440 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.433434:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffed80 with x1873929633750016 ext(122880->159743) 00002000:00010000:1.0:1787119528.433473:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffed80 00000100:00100000:3.0:1787119528.438871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.438938:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633750144 00000100:00100000:1.0:1787119528.438948:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633750144 00002000:00100000:1.0:1787119528.438999:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (159744->163839) req@ffff92a509232a00 x1873929633750144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.439011:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633750144 ext(159744->163839) 00002000:00010000:1.0:1787119528.439017:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509232a00 00000100:00100000:1.0:1787119528.439084:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10742 00000100:00100000:1.0:1787119528.439104:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633750144:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.439309:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633750144:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 206us (445us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119528.439315:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10742 00002000:00100000:1.0:1787119528.439322:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (159744->163839) req@ffff92a509232a00 x1873929633750144/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.439329:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509232a00 with x1873929633750144 ext(159744->163839) 00002000:00010000:1.0:1787119528.439333:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509232a00 00000100:00100000:0.0:1787119528.442390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.442558:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633750272 00000100:00100000:2.0:1787119528.442568:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633750272 00000100:00100000:2.0:1787119528.442657:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5691 00000100:00100000:2.0:1787119528.442668:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:33957:x1873929633750272:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.442685:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.442705:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f43 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.442739:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.442748:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 262) 00010000:00010000:2.0:1787119528.442753:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 262) 00010000:00010000:2.0:1787119528.442758:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.442792:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 39 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.442819:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 39 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.442834:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508ffdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653712384:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.442931:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.444888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.444947:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633750400 00000100:00100000:3.0:1787119528.444956:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633750400 00010000:00010000:3.0:1787119528.444990:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.444990:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508ffdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653712384:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.445016:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.445031:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5727 00010000:00010000:0.0:1787119528.445034:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894000, rc 0) 00000100:00100000:3.0:1787119528.445039:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:2375:x1873929633750400:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.445051:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.445073:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.445095:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.445118:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac5755c/0xcaba3de8463e3b7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716215 expref: 40 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.445124:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633750272:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2458us (2745us total) trans 0 rc 0/0 00010000:00010000:3.0:1787119528.445134:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 262) 00010000:00010000:3.0:1787119528.445138:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 262) 00000100:00100000:0.0:1787119528.445139:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5691 00010000:00010000:3.0:1787119528.445147:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.445157:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 26 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.445188:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 26 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.445201:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653712512:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.445246:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.449476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.449570:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633750528 00000100:00100000:1.0:1787119528.449578:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633750528 00000100:00100000:3.0:1787119528.449579:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653712512:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119528.449605:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1787119528.449623:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (163840->176127) req@ffff92a508fff100 x1873929633750528/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.449634:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff100 with x1873929633750528 ext(163840->176127) 00002000:00010000:1.0:1787119528.449638:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508fff100 00000100:00100000:3.0:1787119528.449699:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2375:x1873929633750400:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4659us (4817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.449709:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5727 00000100:00100000:1.0:1787119528.449740:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10743 00000100:00100000:1.0:1787119528.449751:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633750528:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.449961:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2376:x1873929633750528:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 211us (495us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119528.453366:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10743 00002000:00100000:1.0:1787119528.453398:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (163840->176127) req@ffff92a508fff100 x1873929633750528/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/12728 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.453410:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508fff100 with x1873929633750528 ext(163840->176127) 00002000:00010000:1.0:1787119528.453417:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508fff100 00000100:00100000:2.0:1787119528.454045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.454123:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633750656 00000100:00100000:3.0:1787119528.454132:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633750656 00000100:00100000:3.0:1787119528.454189:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5692 00000100:00100000:3.0:1787119528.454201:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+27:33957:x1873929633750656:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.454222:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.454245:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f4a expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.454283:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716231 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.454292:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 262) 00010000:00010000:3.0:1787119528.454297:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 262) 00010000:00010000:3.0:1787119528.454303:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.454338:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716231 expref: 38 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.454367:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716231 expref: 38 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.454385:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653712640:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.454507:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.458671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.458795:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653712640:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.458837:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 28 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.458861:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430600, rc 0) 00000100:00100000:3.0:1787119528.458935:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633750656:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4735us (4891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.458944:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5692 00000100:00100000:0.0:1787119528.459435:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633750784 00000100:00100000:0.0:1787119528.459484:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633750784 00010000:00010000:0.0:1787119528.459519:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716231 expref: 39 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.459561:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5728 00000100:00100000:0.0:1787119528.459570:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+39:2376:x1873929633750784:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.459585:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.459607:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716231 expref: 39 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.459632:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716231 expref: 39 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.459657:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0c6bd7/0xcaba3de8463e3b98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716231 expref: 39 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.459672:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 262) 00010000:00010000:0.0:1787119528.459677:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 262) 00010000:00010000:0.0:1787119528.459685:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.459696:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.459728:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 27 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.459741:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512845180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653712768:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.459814:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.464104:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512845180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653712768:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.464132:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.464200:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2376:x1873929633750784:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4630us (5538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.464212:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5728 00000100:00100000:2.0:1787119528.464225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.464828:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633750912 00000100:00100000:1.0:1787119528.464836:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633750912 00002000:00100000:1.0:1787119528.464878:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a519cd6a00 x1873929633750912/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.464885:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633750912 ext(176128->180223) 00002000:00010000:1.0:1787119528.464889:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6a00 00000100:00100000:1.0:1787119528.464927:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10744 00000100:00100000:1.0:1787119528.464936:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633750912:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.465137:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633750912:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 201us (915us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119528.465148:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10744 00002000:00100000:1.0:1787119528.465155:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (176128->180223) req@ffff92a519cd6a00 x1873929633750912/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.465163:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519cd6a00 with x1873929633750912 ext(176128->180223) 00002000:00010000:1.0:1787119528.465167:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519cd6a00 00000100:00100000:2.0:1787119528.468644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.469005:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633751040 00000100:00100000:1.0:1787119528.469014:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633751040 00000100:00100000:1.0:1787119528.469118:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5693 00000100:00100000:1.0:1787119528.469128:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+28:33957:x1873929633751040:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119528.469147:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119528.469170:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f51 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.469205:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716246 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.469216:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 262) 00010000:00010000:1.0:1787119528.469221:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 262) 00010000:00010000:1.0:1787119528.469226:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 29 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.469259:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204716246 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.469284:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716246 expref: 37 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.469305:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653712896:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119528.469394:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.475313:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653712896:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119528.475352:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 29 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.475374:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf1200, rc 0) 00000100:00100000:1.0:1787119528.475463:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+29:33957:x1873929633751040:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6335us (6828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.475473:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5693 00000100:00100000:2.0:1787119528.476137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.476431:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633751168 00000100:00100000:1.0:1787119528.476466:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633751168 00010000:00010000:1.0:1787119528.476502:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716246 expref: 38 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.476533:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5729 00000100:00100000:1.0:1787119528.476543:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+38:2375:x1873929633751168:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.476569:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.476591:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716246 expref: 38 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.476613:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716246 expref: 38 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.476636:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e3bad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204716246 expref: 38 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.476649:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 262) 00010000:00010000:1.0:1787119528.476653:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 262) 00010000:00010000:1.0:1787119528.476659:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.476665:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.476691:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 28 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.476702:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653713024:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.476749:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.478791:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653713024:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.478817:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.478868:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2375:x1873929633751168:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2326us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.478876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5729 00000100:00100000:0.0:1787119528.481750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.481857:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633751296 00000100:00100000:3.0:1787119528.481867:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633751296 00002000:00100000:3.0:1787119528.481926:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a512845180 x1873929633751296/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.481938:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845180 with x1873929633751296 ext(180224->184319) 00002000:00010000:3.0:1787119528.481944:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845180 00000100:00100000:3.0:1787119528.481978:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10745 00000100:00100000:3.0:1787119528.481987:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633751296:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.482174:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633751296:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 187us (432us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119528.482181:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10745 00002000:00100000:3.0:1787119528.482188:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (180224->184319) req@ffff92a512845180 x1873929633751296/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.482196:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845180 with x1873929633751296 ext(180224->184319) 00002000:00010000:3.0:1787119528.482200:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845180 00000100:00100000:2.0:1787119528.487964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.488066:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633751424 00000100:00100000:3.0:1787119528.488076:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633751424 00000100:00100000:3.0:1787119528.488148:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5694 00000100:00100000:3.0:1787119528.488158:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+29:33957:x1873929633751424:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.488180:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.488201:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f58 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.488231:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.488242:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 262) 00010000:00010000:3.0:1787119528.488246:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 262) 00010000:00010000:3.0:1787119528.488252:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 30 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.488287:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 36 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.488314:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 36 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.488329:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653713152:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.488421:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.492595:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653713152:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.492641:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 30 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.492664:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513431600, rc 0) 00000100:00100000:3.0:1787119528.492736:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+30:33957:x1873929633751424:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4579us (4781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.492746:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5694 00000100:00100000:2.0:1787119528.493269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.493406:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633751552 00000100:00100000:3.0:1787119528.493414:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633751552 00010000:00010000:3.0:1787119528.493572:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 37 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.493615:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5730 00000100:00100000:3.0:1787119528.493625:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+37:2376:x1873929633751552:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.493640:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.493664:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 37 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.493831:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 37 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.493858:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e3bb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471624d expref: 37 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.493874:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 262) 00010000:00010000:3.0:1787119528.493878:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 262) 00010000:00010000:3.0:1787119528.493886:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 29 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.493912:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 29 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.493949:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 29 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.493965:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653713280:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.494031:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.497998:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653713280:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119528.498029:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119528.498102:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2376:x1873929633751552:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4477us (4833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.498114:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5730 00000100:00100000:0.0:1787119528.499352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.499484:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633751680 00000100:00100000:3.0:1787119528.499491:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633751680 00002000:00100000:3.0:1787119528.499536:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (184320->192511) req@ffff92a512846300 x1873929633751680/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.499547:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846300 with x1873929633751680 ext(184320->192511) 00002000:00010000:3.0:1787119528.499552:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846300 00000100:00100000:3.0:1787119528.499582:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10746 00000100:00100000:3.0:1787119528.499591:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633751680:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.499832:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633751680:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 241us (484us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1787119528.499839:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10746 00002000:00100000:3.0:1787119528.499846:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (184320->192511) req@ffff92a512846300 x1873929633751680/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/8632 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.499855:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846300 with x1873929633751680 ext(184320->192511) 00002000:00010000:3.0:1787119528.499858:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846300 00000100:00100000:2.0:1787119528.504400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.504533:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633751808 00000100:00100000:0.0:1787119528.504544:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633751808 00000100:00100000:0.0:1787119528.504607:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5695 00000100:00100000:0.0:1787119528.504618:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+30:33957:x1873929633751808:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119528.504637:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119528.504659:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f5f expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.504700:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.504710:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 262) 00010000:00010000:0.0:1787119528.504715:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 262) 00010000:00010000:0.0:1787119528.504720:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 31 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.504753:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 35 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.504796:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 35 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.504811:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653713408:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119528.504894:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.511004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.511095:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633751936 00000100:00100000:3.0:1787119528.511143:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633751936 00010000:00010000:3.0:1787119528.511185:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 36 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.511233:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5731 00000100:00100000:3.0:1787119528.511243:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+36:2375:x1873929633751936:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.511259:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.511284:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 36 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.511316:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 36 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.511346:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 262) 00010000:00010000:3.0:1787119528.511351:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 262) 00010000:00010000:3.0:1787119528.511360:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 31 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.511372:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 31 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.511549:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 31 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.511566:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653713536:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.511641:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787119528.511854:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005411ac99/0xcaba3de8463e3ccc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716365 expref: 36 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.511871:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653713408:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.511896:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 31 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.511919:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39000, rc 0) 00000100:00100000:0.0:1787119528.511957:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+31:33957:x1873929633751808:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7341us (7567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.511965:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5695 00000100:00100000:1.0:1787119528.517793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.518629:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653713536:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.518655:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.518721:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633751936:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7479us (7728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.518733:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5731 00000100:00100000:2.0:1787119528.518830:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633752064 00000100:00100000:2.0:1787119528.518839:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633752064 00002000:00100000:2.0:1787119528.518889:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->204799) req@ffff92a6072f8a80 x1873929633752064/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.518912:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8a80 with x1873929633752064 ext(192512->204799) 00002000:00010000:2.0:1787119528.518918:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8a80 00000100:00100000:2.0:1787119528.518951:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10747 00000100:00100000:2.0:1787119528.518962:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+31:2375:x1873929633752064:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.519191:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+31:2375:x1873929633752064:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 230us (1408us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1787119528.519199:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10747 00002000:00100000:2.0:1787119528.519205:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (192512->204799) req@ffff92a6072f8a80 x1873929633752064/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/12728 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.519214:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072f8a80 with x1873929633752064 ext(192512->204799) 00002000:00010000:2.0:1787119528.519217:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072f8a80 00000100:00100000:1.0:1787119528.525344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.525489:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633752192 00000100:00100000:3.0:1787119528.525499:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633752192 00000100:00100000:3.0:1787119528.525597:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5696 00000100:00100000:3.0:1787119528.525608:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+31:33957:x1873929633752192:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.525628:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.525647:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f66 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.525693:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 34 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.525703:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 262) 00010000:00010000:3.0:1787119528.525708:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 262) 00010000:00010000:3.0:1787119528.525713:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 32 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.525760:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 34 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.525785:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 34 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.525800:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653713664:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.525887:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.528300:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653713664:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.528335:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 32 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.528354:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a513430400, rc 0) 00000100:00100000:3.0:1787119528.528405:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+32:33957:x1873929633752192:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2798us (3069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.528413:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5696 00000100:00100000:2.0:1787119528.529968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.530072:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633752320 00000100:00100000:1.0:1787119528.530083:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633752320 00010000:00010000:1.0:1787119528.530121:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 35 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.530201:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5732 00000100:00100000:1.0:1787119528.530212:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+35:2375:x1873929633752320:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.530999:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.531030:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 35 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.531061:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 35 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.531293:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afa3a26a/0xcaba3de8463e3dac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716445 expref: 35 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.531313:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 262) 00010000:00010000:1.0:1787119528.531318:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 262) 00010000:00010000:1.0:1787119528.531328:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.531340:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.531387:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 31 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.531406:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653713792:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.531592:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd240 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.536740:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653713792:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.536783:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.536857:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633752320:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6645us (6895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.536878:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5732 00000100:00100000:3.0:1787119528.539782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.540020:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633752448 00000100:00100000:0.0:1787119528.540032:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633752448 00002000:00100000:0.0:1787119528.540083:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a509231180 x1873929633752448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.540106:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633752448 ext(204800->208895) 00002000:00010000:0.0:1787119528.540113:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231180 00000100:00100000:0.0:1787119528.540143:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10748 00000100:00100000:0.0:1787119528.540152:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2376:x1873929633752448:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119528.540354:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2376:x1873929633752448:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 202us (598us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119528.540362:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10748 00002000:00100000:0.0:1787119528.540369:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff92a509231180 x1873929633752448/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.540378:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231180 with x1873929633752448 ext(204800->208895) 00002000:00010000:0.0:1787119528.540381:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231180 00000100:00100000:1.0:1787119528.545478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.545607:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633752576 00000100:00100000:2.0:1787119528.545619:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633752576 00000100:00100000:2.0:1787119528.545694:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5697 00000100:00100000:2.0:1787119528.545705:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+32:33957:x1873929633752576:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.545725:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.545748:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.545793:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.545809:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 262) 00010000:00010000:2.0:1787119528.545813:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 262) 00010000:00010000:2.0:1787119528.545819:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.545854:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.545880:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 33 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.545906:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653713920:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.546004:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.550192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.550312:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653713920:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.550347:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 33 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.550369:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895e00, rc 0) 00000100:00100000:2.0:1787119528.550430:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633752576:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4726us (5007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.550478:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5697 00000100:00100000:3.0:1787119528.551136:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633752704 00000100:00100000:3.0:1787119528.551144:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633752704 00010000:00010000:3.0:1787119528.551180:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 34 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.551217:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5733 00000100:00100000:3.0:1787119528.551226:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+34:2375:x1873929633752704:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.551240:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.551263:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 34 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.551289:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 34 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.551316:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b8ba606/0xcaba3de8463e3dba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716453 expref: 34 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.551332:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 262) 00010000:00010000:3.0:1787119528.551336:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 262) 00010000:00010000:3.0:1787119528.551346:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 32 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.551359:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 32 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.551401:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 32 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.551423:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653714048:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.551550:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.559629:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653714048:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119528.559668:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119528.559733:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2375:x1873929633752704:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8507us (9550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.559744:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5733 00000100:00100000:1.0:1787119528.562344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.562893:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633752832 00000100:00100000:3.0:1787119528.562915:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633752832 00002000:00100000:3.0:1787119528.562969:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a6072fb100 x1873929633752832/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.562980:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb100 with x1873929633752832 ext(208896->212991) 00002000:00010000:3.0:1787119528.562986:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb100 00000100:00100000:3.0:1787119528.563022:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10749 00000100:00100000:3.0:1787119528.563032:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2375:x1873929633752832:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.563252:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2375:x1873929633752832:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 220us (917us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119528.563259:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10749 00002000:00100000:3.0:1787119528.563266:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff92a6072fb100 x1873929633752832/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.563274:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb100 with x1873929633752832 ext(208896->212991) 00002000:00010000:3.0:1787119528.563278:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb100 00000100:00100000:1.0:1787119528.567072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.567259:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633752960 00000100:00100000:3.0:1787119528.567269:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633752960 00000100:00100000:3.0:1787119528.567374:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5698 00000100:00100000:3.0:1787119528.567395:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+33:33957:x1873929633752960:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.567414:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.567435:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f74 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.567494:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 32 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.567504:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 262) 00010000:00010000:3.0:1787119528.567509:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 262) 00010000:00010000:3.0:1787119528.567514:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.567563:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 32 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.567592:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 32 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.567608:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653714176:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.567809:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.571075:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653714176:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.571115:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 34 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.571138:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85800, rc 0) 00000100:00100000:1.0:1787119528.571169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.571203:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633752960:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3820us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.571211:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5698 00000100:00100000:0.0:1787119528.572346:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633753088 00000100:00100000:0.0:1787119528.572356:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633753088 00010000:00010000:0.0:1787119528.572494:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 33 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.572637:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5734 00000100:00100000:0.0:1787119528.572648:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+33:2376:x1873929633753088:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.572663:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.572767:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 33 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.572802:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 33 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.572830:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002eb956db/0xcaba3de8463e3dc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716461 expref: 33 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.572847:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 262) 00010000:00010000:0.0:1787119528.572852:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 262) 00010000:00010000:0.0:1787119528.572859:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.572870:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.572925:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 33 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.572941:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653714304:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.573068:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.575847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.575944:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633753216 00000100:00100000:3.0:1787119528.575952:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633753216 00000100:00100000:0.0:1787119528.575961:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653714304:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.575984:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1787119528.576010:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a508ffc000 x1873929633753216/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.576021:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc000 with x1873929633753216 ext(212992->217087) 00002000:00010000:3.0:1787119528.576026:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffc000 00000100:00100000:0.0:1787119528.576041:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2376:x1873929633753088:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3395us (4873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.576051:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5734 00000100:00100000:3.0:1787119528.576055:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10750 00000100:00100000:3.0:1787119528.576063:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633753216:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.576538:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633753216:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 474us (700us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119528.576545:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10750 00002000:00100000:3.0:1787119528.576552:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff92a508ffc000 x1873929633753216/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.576561:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc000 with x1873929633753216 ext(212992->217087) 00002000:00010000:3.0:1787119528.576564:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffc000 00000100:00100000:1.0:1787119528.581945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.582200:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633753344 00000100:00100000:0.0:1787119528.582213:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633753344 00000100:00100000:0.0:1787119528.582275:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5699 00000100:00100000:0.0:1787119528.582285:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:33957:x1873929633753344:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119528.582305:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119528.582324:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f7b expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.582356:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.582365:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 262) 00010000:00010000:0.0:1787119528.582369:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 262) 00010000:00010000:0.0:1787119528.582374:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 35 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.582422:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 31 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.582495:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 31 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.582511:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653714432:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119528.582602:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63ffa8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.585634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.585673:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653714432:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.585704:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 35 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.585727:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39800, rc 0) 00000100:00100000:1.0:1787119528.585782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633753472 00000100:00100000:0.0:1787119528.585787:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633753344:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3503us (3849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.585790:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633753472 00000100:00100000:0.0:1787119528.585795:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5699 00010000:00010000:1.0:1787119528.585824:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 32 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.585865:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5735 00000100:00100000:1.0:1787119528.585874:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+32:2376:x1873929633753472:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.585887:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.585921:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 32 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.585944:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 32 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.585969:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009eebdc73/0xcaba3de8463e3f96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471662f expref: 32 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.586002:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 262) 00010000:00010000:1.0:1787119528.586007:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 262) 00010000:00010000:1.0:1787119528.586016:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.586028:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.586064:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 34 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.586078:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653714560:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.586618:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.588727:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653714560:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.588754:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.588820:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2376:x1873929633753472:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2946us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.588831:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5735 00000100:00100000:2.0:1787119528.593096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.595066:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633753600 00000100:00100000:1.0:1787119528.595080:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633753600 00002000:00100000:1.0:1787119528.595147:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a5066df480 x1873929633753600/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.595160:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633753600 ext(217088->221183) 00002000:00010000:1.0:1787119528.595166:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:1.0:1787119528.595204:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10751 00000100:00100000:1.0:1787119528.595214:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2375:x1873929633753600:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.595611:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2375:x1873929633753600:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 397us (2524us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119528.595619:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10751 00002000:00100000:1.0:1787119528.595627:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff92a5066df480 x1873929633753600/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.595635:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066df480 with x1873929633753600 ext(217088->221183) 00002000:00010000:1.0:1787119528.595638:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066df480 00000100:00100000:2.0:1787119528.599021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.600983:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633753728 00000100:00100000:3.0:1787119528.600997:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633753728 00000100:00100000:2.0:1787119528.601150:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5700 00000100:00100000:2.0:1787119528.601160:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+35:33957:x1873929633753728:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.601177:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.601199:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f82 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.601235:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471664b expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.601244:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 262) 00010000:00010000:2.0:1787119528.601249:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 262) 00010000:00010000:2.0:1787119528.601254:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 36 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.601289:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471664b expref: 30 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.601315:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471664b expref: 30 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.601329:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653714688:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.601422:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.605296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.606395:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633753856 00000100:00100000:3.0:1787119528.606406:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633753856 00010000:00010000:3.0:1787119528.606485:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471664b expref: 31 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.606528:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5736 00000100:00100000:3.0:1787119528.606539:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+31:2376:x1873929633753856:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.606554:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.606576:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471664b expref: 31 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.606601:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471664b expref: 31 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.606631:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 262) 00010000:00010000:3.0:1787119528.606636:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 262) 00010000:00010000:3.0:1787119528.606645:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 36 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.606658:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 36 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.606773:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 36 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.606796:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653714816:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119528.606881:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3540 going to sleep for 11 seconds 00010000:00010000:0.0:1787119528.607038:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e3fb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471664b expref: 31 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.607055:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653714688:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.607079:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 36 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.607158:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895600, rc 0) 00000100:00100000:0.0:1787119528.607229:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+36:33957:x1873929633753728:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6069us (8217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.607237:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5700 00000100:00100000:2.0:1787119528.612037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.612079:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653714816:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.612115:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.612124:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633753984 00000100:00100000:1.0:1787119528.612130:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633753984 00002000:00100000:1.0:1787119528.612175:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a5066dc700 x1873929633753984/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787119528.612175:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2376:x1873929633753856:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5639us (6891us total) trans 0 rc 0/0 00002000:00100000:1.0:1787119528.612185:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc700 with x1873929633753984 ext(221184->225279) 00000100:00100000:0.0:1787119528.612186:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5736 00002000:00010000:1.0:1787119528.612189:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dc700 00000100:00100000:1.0:1787119528.612220:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10752 00000100:00100000:1.0:1787119528.612228:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633753984:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.612424:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633753984:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 195us (396us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119528.612431:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10752 00002000:00100000:1.0:1787119528.612464:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff92a5066dc700 x1873929633753984/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.612473:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc700 with x1873929633753984 ext(221184->225279) 00002000:00010000:1.0:1787119528.612477:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dc700 00000100:00100000:2.0:1787119528.616532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.616588:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633754112 00000100:00100000:1.0:1787119528.616598:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633754112 00000100:00100000:1.0:1787119528.616660:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5701 00000100:00100000:1.0:1787119528.616670:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+36:33957:x1873929633754112:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119528.616852:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119528.616873:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f89 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.616923:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 29 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.616932:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 262) 00010000:00010000:1.0:1787119528.616937:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 262) 00010000:00010000:1.0:1787119528.616943:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.616976:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 29 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.617000:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 29 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.617014:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653714944:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119528.617155:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.623306:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653714944:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119528.623347:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 37 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.623370:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e69600, rc 0) 00000100:00100000:1.0:1787119528.623525:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+37:33957:x1873929633754112:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 6855us (7000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.623534:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5701 00000100:00100000:2.0:1787119528.634306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.634489:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633754240 00000100:00100000:0.0:1787119528.634499:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633754240 00010000:00010000:0.0:1787119528.634541:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 30 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.634613:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5737 00000100:00100000:0.0:1787119528.634624:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+30:2375:x1873929633754240:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.634638:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.634662:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 30 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.634692:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 30 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.634720:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aa5be7c/0xcaba3de8463e3fb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716652 expref: 30 pid: 6693 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.634738:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 262) 00010000:00010000:0.0:1787119528.634743:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 262) 00010000:00010000:0.0:1787119528.634752:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.634762:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.634803:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 36 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.634817:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653715072:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.639022:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a601377300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.642110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.642162:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633754368 00000100:00100000:3.0:1787119528.642172:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633754368 00002000:00100000:3.0:1787119528.642220:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (225280->233471) req@ffff92a512847800 x1873929633754368/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787119528.642220:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653715072:192.168.201.59@tcp:105: 00002000:00100000:3.0:1787119528.642230:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847800 with x1873929633754368 ext(225280->233471) 00002000:00010000:3.0:1787119528.642234:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847800 00010000:00010000:1.0:1787119528.642243:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119528.642314:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10753 00000100:00100000:3.0:1787119528.642325:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2376:x1873929633754368:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.642348:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633754240:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7726us (8052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.642358:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5737 00000100:00100000:3.0:1787119528.642776:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2376:x1873929633754368:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 453us (674us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1787119528.642784:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10753 00002000:00100000:3.0:1787119528.642791:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (225280->233471) req@ffff92a512847800 x1873929633754368/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/8632 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.642799:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847800 with x1873929633754368 ext(225280->233471) 00002000:00010000:3.0:1787119528.642803:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847800 00000100:00100000:0.0:1787119528.646064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.646113:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633754496 00000100:00100000:3.0:1787119528.646124:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633754496 00000100:00100000:3.0:1787119528.646175:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5702 00000100:00100000:3.0:1787119528.646183:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+37:33957:x1873929633754496:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.646197:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.646211:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f90 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.646236:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.646243:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 262) 00010000:00010000:3.0:1787119528.646246:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 262) 00010000:00010000:3.0:1787119528.646250:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.646280:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 28 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.646300:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 28 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.646309:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653715200:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.646381:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.648783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.648851:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633754624 00000100:00100000:1.0:1787119528.648858:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633754624 00010000:00010000:1.0:1787119528.648887:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 29 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.648959:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653715200:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119528.648969:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5738 00010000:00010000:3.0:1787119528.648988:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 38 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.649005:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84e00, rc 0) 00000100:00100000:1.0:1787119528.649031:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+29:2375:x1873929633754624:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.649045:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.649067:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 29 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.649092:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 29 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.649097:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633754496:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2914us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.649105:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5702 00010000:00010000:1.0:1787119528.649117:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030327814/0xcaba3de8463e3fc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716660 expref: 29 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.649132:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 262) 00010000:00010000:1.0:1787119528.649136:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 262) 00010000:00010000:1.0:1787119528.649145:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.649156:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.649187:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 37 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.649199:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653715328:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.649332:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.651820:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653715328:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.651849:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.651927:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633754624:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2896us (3152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.651938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5738 00000100:00100000:2.0:1787119528.652192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.652307:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633754752 00000100:00100000:1.0:1787119528.652315:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633754752 00002000:00100000:1.0:1787119528.652356:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (233472->245759) req@ffff92a5066ddf80 x1873929633754752/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.652373:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddf80 with x1873929633754752 ext(233472->245759) 00002000:00010000:1.0:1787119528.652378:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ddf80 00000100:00100000:1.0:1787119528.652406:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10754 00000100:00100000:1.0:1787119528.652415:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633754752:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.652762:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2375:x1873929633754752:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 346us (569us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119528.652769:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10754 00002000:00100000:1.0:1787119528.652777:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (233472->245759) req@ffff92a5066ddf80 x1873929633754752/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/12728 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.652785:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066ddf80 with x1873929633754752 ext(233472->245759) 00002000:00010000:1.0:1787119528.652788:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066ddf80 00000100:00100000:2.0:1787119528.655571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.655662:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633754880 00000100:00100000:0.0:1787119528.655670:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633754880 00000100:00100000:0.0:1787119528.655723:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5703 00000100:00100000:0.0:1787119528.655730:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+38:33957:x1873929633754880:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119528.655744:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119528.655763:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f97 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.655794:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471667c expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.655805:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 262) 00010000:00010000:0.0:1787119528.655809:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 262) 00010000:00010000:0.0:1787119528.655814:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.655844:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471667c expref: 27 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.655865:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471667c expref: 27 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.655875:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653715456:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119528.656003:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6013770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.657315:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653715456:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.657337:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 39 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.657351:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39a00, rc 0) 00000100:00100000:0.0:1787119528.657393:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+39:33957:x1873929633754880:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1663us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.657403:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5703 00000100:00100000:2.0:1787119528.658163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.658518:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633755008 00000100:00100000:0.0:1787119528.658524:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633755008 00010000:00010000:0.0:1787119528.658551:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471667c expref: 28 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.658623:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5739 00000100:00100000:0.0:1787119528.658631:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+28:2375:x1873929633755008:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.658641:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.658660:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471667c expref: 28 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.658682:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471667c expref: 28 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.658706:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e3fe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471667c expref: 28 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.658724:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 262) 00010000:00010000:0.0:1787119528.658730:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 262) 00010000:00010000:0.0:1787119528.658737:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 38 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.658745:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 38 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.658776:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 38 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.658790:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653715584:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.658855:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6013770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.660855:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653715584:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.660875:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.660937:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633755008:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2305us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.660947:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5739 00000100:00100000:3.0:1787119528.662149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.662271:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633755136 00000100:00100000:2.0:1787119528.662278:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633755136 00002000:00100000:2.0:1787119528.662315:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a509233100 x1873929633755136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.662323:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233100 with x1873929633755136 ext(245760->249855) 00002000:00010000:2.0:1787119528.662327:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233100 00000100:00100000:2.0:1787119528.662377:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10755 00000100:00100000:2.0:1787119528.662386:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2375:x1873929633755136:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.662599:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2375:x1873929633755136:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 214us (456us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119528.662607:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10755 00002000:00100000:2.0:1787119528.662613:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff92a509233100 x1873929633755136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.662620:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509233100 with x1873929633755136 ext(245760->249855) 00002000:00010000:2.0:1787119528.662623:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509233100 00000100:00100000:2.0:1787119528.664922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.665192:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633755264 00000100:00100000:0.0:1787119528.665201:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633755264 00000100:00100000:0.0:1787119528.665274:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5704 00000100:00100000:0.0:1787119528.665282:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+39:33957:x1873929633755264:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119528.665296:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119528.665311:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716f9e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.665335:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.665342:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 262) 00010000:00010000:0.0:1787119528.665345:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 262) 00010000:00010000:0.0:1787119528.665349:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.665374:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 26 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.665397:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 26 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.665412:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653715712:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119528.665510:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6013770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.667388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.667484:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633755392 00000100:00100000:3.0:1787119528.667495:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633755392 00010000:00010000:3.0:1787119528.667535:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 27 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.667577:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5740 00000100:00100000:3.0:1787119528.667587:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+27:2375:x1873929633755392:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.667602:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.667626:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 27 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.667654:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 27 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.667733:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 262) 00010000:00010000:3.0:1787119528.667737:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 262) 00010000:00010000:3.0:1787119528.667745:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.667754:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.667789:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.667804:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653715840:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.667876:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787119528.668553:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566083b6/0xcaba3de8463e3ff8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716691 expref: 27 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.668571:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653715712:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.668595:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 40 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.668607:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38800, rc 0) 00000100:00100000:1.0:1787119528.668863:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+40:33957:x1873929633755264:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3578us (3948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.668873:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5704 00000100:00100000:3.0:1787119528.670091:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653715840:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119528.670112:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.670238:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633755392:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2650us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.670252:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5740 00000100:00100000:1.0:1787119528.672431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.672576:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633755520 00000100:00100000:2.0:1787119528.672586:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633755520 00002000:00100000:2.0:1787119528.672632:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (249856->258047) req@ffff92a62a127480 x1873929633755520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.672640:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127480 with x1873929633755520 ext(249856->258047) 00002000:00010000:2.0:1787119528.672644:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127480 00000100:00100000:2.0:1787119528.672742:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10756 00000100:00100000:2.0:1787119528.672755:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633755520:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.673018:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2375:x1873929633755520:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 264us (592us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119528.673026:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10756 00002000:00100000:2.0:1787119528.673032:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (249856->258047) req@ffff92a62a127480 x1873929633755520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/8632 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.673037:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127480 with x1873929633755520 ext(249856->258047) 00002000:00010000:2.0:1787119528.673040:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127480 00000100:00100000:1.0:1787119528.675577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.675660:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633755648 00000100:00100000:2.0:1787119528.675669:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633755648 00000100:00100000:2.0:1787119528.675744:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5705 00000100:00100000:2.0:1787119528.675751:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+40:33957:x1873929633755648:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.675765:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.675781:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fa5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.675811:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.675818:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 262) 00010000:00010000:2.0:1787119528.675821:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 262) 00010000:00010000:2.0:1787119528.675824:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.675851:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 25 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.675872:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 25 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.675883:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653715968:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.675990:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.677835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.677892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633755776 00000100:00100000:1.0:1787119528.677909:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633755776 00010000:00010000:1.0:1787119528.678241:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 26 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.678277:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5741 00000100:00100000:1.0:1787119528.678284:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633755776:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.678298:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.678317:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 26 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.678341:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 26 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.678369:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 262) 00010000:00010000:1.0:1787119528.678373:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 262) 00010000:00010000:1.0:1787119528.678381:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.678392:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.678426:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.678471:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a125c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653716096:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.678549:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdf00 going to sleep for 11 seconds 00010000:00010000:2.0:1787119528.678927:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027991476/0xcaba3de8463e400d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166a6 expref: 26 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.678943:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653715968:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.678968:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.679097:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894400, rc 0) 00000100:00100000:2.0:1787119528.679324:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633755648:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3571us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.679332:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5705 00000100:00100000:0.0:1787119528.682679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.682996:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633755904 00000100:00100000:2.0:1787119528.683007:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633755904 00002000:00100000:2.0:1787119528.683058:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (258048->266239) req@ffff92a512847100 x1873929633755904/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.683069:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847100 with x1873929633755904 ext(258048->266239) 00002000:00010000:2.0:1787119528.683075:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847100 00000100:00100000:2.0:1787119528.683113:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10757 00000100:00100000:2.0:1787119528.683123:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2375:x1873929633755904:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.683347:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2375:x1873929633755904:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 225us (679us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787119528.683355:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10757 00002000:00100000:2.0:1787119528.683361:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (258048->266239) req@ffff92a512847100 x1873929633755904/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/8632 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.683369:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847100 with x1873929633755904 ext(258048->266239) 00002000:00010000:2.0:1787119528.683373:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512847100 00000100:00100000:3.0:1787119528.687023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.687240:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633756032 00000100:00100000:0.0:1787119528.687250:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633756032 00000100:00100000:0.0:1787119528.687313:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5706 00000100:00100000:0.0:1787119528.687323:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+41:33957:x1873929633756032:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119528.687341:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119528.687360:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fac expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.687391:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.687402:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 262) 00010000:00010000:0.0:1787119528.687408:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 262) 00010000:00010000:0.0:1787119528.687414:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 42 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.687489:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.687516:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 25 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.687534:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653716224:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119528.687611:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6013770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.688741:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a125c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653716096:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.690122:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653716224:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.690153:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 42 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.690174:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39e00, rc 0) 00000100:00100000:0.0:1787119528.690227:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633756032:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2905us (3214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.690235:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5706 00000100:00100000:3.0:1787119528.691581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.691776:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633756160 00000100:00100000:0.0:1787119528.691784:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633756160 00010000:00010000:0.0:1787119528.691822:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 26 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.691910:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5742 00000100:00100000:0.0:1787119528.691921:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+26:2375:x1873929633756160:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.691937:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.691960:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 26 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.691991:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 26 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.692018:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a56ac/0xcaba3de8463e4014 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047166ad expref: 26 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.692040:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 262) 00010000:00010000:0.0:1787119528.692044:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 262) 00010000:00010000:0.0:1787119528.692052:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.692063:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.692109:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 41 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.692124:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653716352:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.692201:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6013770c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787119528.693463:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.693526:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+25:2375:x1873929633755776:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 15238us (15693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.693537:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5741 00000100:00100000:3.0:1787119528.697615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.697666:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633756288 00000100:00100000:3.0:1787119528.697676:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633756288 00002000:00100000:3.0:1787119528.697731:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a509231880 x1873929633756288/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.697743:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633756288 ext(266240->270335) 00002000:00010000:3.0:1787119528.697749:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231880 00000100:00100000:3.0:1787119528.697781:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10758 00000100:00100000:3.0:1787119528.697789:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633756288:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119528.698352:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653716352:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.698376:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.698433:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633756160:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6512us (6858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.698458:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5742 00000100:00100000:3.0:1787119528.698740:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633756288:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 951us (1136us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119528.698748:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10758 00002000:00100000:3.0:1787119528.698756:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff92a509231880 x1873929633756288/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.698776:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231880 with x1873929633756288 ext(266240->270335) 00002000:00010000:3.0:1787119528.698780:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231880 00000100:00100000:3.0:1787119528.701860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.701958:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633756416 00000100:00100000:2.0:1787119528.701971:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633756416 00000100:00100000:2.0:1787119528.702027:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5707 00000100:00100000:2.0:1787119528.702036:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:33957:x1873929633756416:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.702052:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.702074:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fb3 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.702103:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 23 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.702113:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 262) 00010000:00010000:2.0:1787119528.702117:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 262) 00010000:00010000:2.0:1787119528.702122:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 43 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.702154:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 23 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.702233:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 23 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.702310:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653716480:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.702387:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.705587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.705630:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653716480:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.705667:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 43 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.705699:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894800, rc 0) 00000100:00100000:0.0:1787119528.705699:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633756544 00000100:00100000:0.0:1787119528.705706:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633756544 00010000:00010000:0.0:1787119528.705742:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 24 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.705765:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633756416:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3730us (3914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.705773:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5707 00000100:00100000:0.0:1787119528.705782:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5743 00000100:00100000:0.0:1787119528.705791:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+24:2375:x1873929633756544:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.705815:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.705841:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 24 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.705869:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 24 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.705906:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdd4aca/0xcaba3de8463e4076 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471670f expref: 24 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.705920:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 262) 00010000:00010000:0.0:1787119528.705925:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 262) 00010000:00010000:0.0:1787119528.705932:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.705944:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.705980:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 42 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.705995:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653716608:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.706050:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a6013770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.709499:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653716608:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119528.709529:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119528.709591:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2375:x1873929633756544:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3798us (4012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.709603:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5743 00000100:00100000:0.0:1787119528.714122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.714421:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633756672 00000100:00100000:1.0:1787119528.714432:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633756672 00002000:00100000:1.0:1787119528.714516:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a6072fb480 x1873929633756672/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.714525:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb480 with x1873929633756672 ext(270336->274431) 00002000:00010000:1.0:1787119528.714531:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb480 00000100:00100000:1.0:1787119528.714570:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10759 00000100:00100000:1.0:1787119528.714580:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633756672:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.714793:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2375:x1873929633756672:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 212us (678us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119528.714801:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10759 00002000:00100000:1.0:1787119528.714807:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff92a6072fb480 x1873929633756672/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.714816:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a6072fb480 with x1873929633756672 ext(270336->274431) 00002000:00010000:1.0:1787119528.714820:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a6072fb480 00000100:00100000:3.0:1787119528.718669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.718940:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633756800 00000100:00100000:1.0:1787119528.718951:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633756800 00000100:00100000:1.0:1787119528.719009:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5708 00000100:00100000:1.0:1787119528.719018:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+43:33957:x1873929633756800:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119528.719039:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119528.719060:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fba expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.719090:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 22 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.719105:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 262) 00010000:00010000:1.0:1787119528.719109:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 262) 00010000:00010000:1.0:1787119528.719114:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 44 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.719150:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 22 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.719177:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 22 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.719192:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653716736:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119528.719282:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.723155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.723288:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653716736:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119528.723326:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 44 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.723346:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e69c00, rc 0) 00000100:00100000:1.0:1787119528.723408:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+44:33957:x1873929633756800:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4391us (4753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.723417:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5708 00000100:00100000:2.0:1787119528.723476:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633756928 00000100:00100000:2.0:1787119528.723485:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633756928 00010000:00010000:2.0:1787119528.723522:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 23 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.723566:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5744 00000100:00100000:2.0:1787119528.723576:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+23:2376:x1873929633756928:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119528.723591:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119528.723614:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 23 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.723641:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 23 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.723666:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d49f40f3/0xcaba3de8463e40a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716739 expref: 23 pid: 20843 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.723819:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 262) 00010000:00010000:2.0:1787119528.723824:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 262) 00010000:00010000:2.0:1787119528.723832:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.723861:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.723907:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 43 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.723927:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653716864:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119528.724095:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.728945:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653716864:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.728972:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.729040:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2376:x1873929633756928:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5464us (5893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.729052:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5744 00000100:00100000:3.0:1787119528.729298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.730478:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633757056 00000100:00100000:1.0:1787119528.730490:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633757056 00002000:00100000:1.0:1787119528.730545:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a509231500 x1873929633757056/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.730557:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633757056 ext(274432->278527) 00002000:00010000:1.0:1787119528.730563:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231500 00000100:00100000:1.0:1787119528.730589:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10760 00000100:00100000:1.0:1787119528.730599:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2375:x1873929633757056:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.730979:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2375:x1873929633757056:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 380us (1680us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119528.730986:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10760 00002000:00100000:1.0:1787119528.730993:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff92a509231500 x1873929633757056/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.731001:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a509231500 with x1873929633757056 ext(274432->278527) 00002000:00010000:1.0:1787119528.731004:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a509231500 00000100:00100000:3.0:1787119528.734611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.734708:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633757184 00000100:00100000:2.0:1787119528.734720:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633757184 00000100:00100000:2.0:1787119528.734794:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5709 00000100:00100000:2.0:1787119528.734804:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+44:33957:x1873929633757184:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.734972:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.734997:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fc1 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.735034:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.735047:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 262) 00010000:00010000:2.0:1787119528.735052:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 262) 00010000:00010000:2.0:1787119528.735058:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.735113:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 21 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.735146:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 21 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.735166:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653716992:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.735320:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.738395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.738490:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633757312 00000100:00100000:0.0:1787119528.738500:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633757312 00010000:00010000:0.0:1787119528.738539:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 22 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.738586:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5745 00000100:00100000:0.0:1787119528.738597:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+22:2375:x1873929633757312:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.738613:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.738638:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 22 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.738666:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 22 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.738693:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 262) 00010000:00010000:0.0:1787119528.738698:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 262) 00010000:00010000:0.0:1787119528.738708:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.738720:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.738777:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.738793:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653717120:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.739061:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a601377300 going to sleep for 11 seconds 00010000:00010000:2.0:1787119528.739269:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f18ee4/0xcaba3de8463e413a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167d3 expref: 22 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.739285:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653716992:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.739309:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 45 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.739320:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894a00, rc 0) 00000100:00100000:2.0:1787119528.739350:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+45:33957:x1873929633757184:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4548us (4755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.739358:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5709 00000100:00100000:2.0:1787119528.743381:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653717120:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.743410:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.743505:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633757312:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4909us (5119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.743518:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5745 00000100:00100000:3.0:1787119528.745363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.745474:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633757440 00000100:00100000:0.0:1787119528.745484:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633757440 00002000:00100000:0.0:1787119528.745533:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a63dc05f80 x1873929633757440/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.745545:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633757440 ext(278528->282623) 00002000:00010000:0.0:1787119528.745550:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05f80 00000100:00100000:0.0:1787119528.745583:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10761 00000100:00100000:0.0:1787119528.745593:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2375:x1873929633757440:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119528.745812:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2375:x1873929633757440:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 212us (449us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119528.745821:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10761 00002000:00100000:0.0:1787119528.745828:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (278528->282623) req@ffff92a63dc05f80 x1873929633757440/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.745837:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc05f80 with x1873929633757440 ext(278528->282623) 00002000:00010000:0.0:1787119528.745840:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc05f80 00000100:00100000:3.0:1787119528.749618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.750250:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633757568 00000100:00100000:0.0:1787119528.750261:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633757568 00000100:00100000:0.0:1787119528.750324:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5710 00000100:00100000:0.0:1787119528.750334:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+45:33957:x1873929633757568:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119528.750353:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119528.750373:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fc8 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.750404:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047167ef expref: 20 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.750415:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 262) 00010000:00010000:0.0:1787119528.750419:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 262) 00010000:00010000:0.0:1787119528.750424:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 46 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.750497:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa8892732047167ef expref: 20 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.750524:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047167ef expref: 20 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.750540:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653717248:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119528.750623:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a601377300 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.753620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.753818:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633757696 00000100:00100000:1.0:1787119528.753827:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633757696 00010000:00010000:1.0:1787119528.753866:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047167ef expref: 21 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.753919:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5746 00000100:00100000:1.0:1787119528.753930:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+21:2375:x1873929633757696:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.753945:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.753969:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047167ef expref: 21 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.753995:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047167ef expref: 21 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.754023:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 262) 00010000:00010000:1.0:1787119528.754028:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 262) 00010000:00010000:1.0:1787119528.754037:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 46 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.754048:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 46 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.754096:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 46 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.754110:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a125c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653717376:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.754191:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd240 going to sleep for 11 seconds 00010000:00010000:0.0:1787119528.755370:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b2393c/0xcaba3de8463e4156 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047167ef expref: 21 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.755388:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653717248:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.755415:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 46 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.755427:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38400, rc 0) 00000100:00100000:0.0:1787119528.755516:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633757568:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5183us (5906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.755525:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5710 00000100:00100000:1.0:1787119528.757341:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a125c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653717376:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.757365:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.757412:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633757696:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3485us (3802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.757422:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5746 00000100:00100000:1.0:1787119528.760229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.760295:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633757824 00000100:00100000:2.0:1787119528.760304:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633757824 00002000:00100000:2.0:1787119528.760346:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a62a125c00 x1873929633757824/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.760358:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125c00 with x1873929633757824 ext(282624->286719) 00002000:00010000:2.0:1787119528.760364:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a125c00 00000100:00100000:2.0:1787119528.760392:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10762 00000100:00100000:2.0:1787119528.760401:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633757824:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.760620:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2375:x1873929633757824:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 219us (398us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119528.760627:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10762 00002000:00100000:2.0:1787119528.760633:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (282624->286719) req@ffff92a62a125c00 x1873929633757824/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.760642:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a125c00 with x1873929633757824 ext(282624->286719) 00002000:00010000:2.0:1787119528.760645:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a125c00 00000100:00100000:3.0:1787119528.764078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.765042:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633757952 00000100:00100000:2.0:1787119528.765057:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633757952 00000100:00100000:2.0:1787119528.765227:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5711 00000100:00100000:2.0:1787119528.765239:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+46:33957:x1873929633757952:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.765258:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.765277:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fcf expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.765310:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 19 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.765327:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 262) 00010000:00010000:2.0:1787119528.765332:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 262) 00010000:00010000:2.0:1787119528.765337:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 47 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.765368:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 19 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.765396:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 19 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.765413:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653717504:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.765522:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.769165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.769324:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653717504:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.769359:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 47 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.769380:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506894200, rc 0) 00000100:00100000:2.0:1787119528.769476:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+47:33957:x1873929633757952:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4239us (5409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.769486:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5711 00000100:00100000:3.0:1787119528.769682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633758080 00000100:00100000:3.0:1787119528.769691:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633758080 00010000:00010000:3.0:1787119528.769723:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 20 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.769758:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5747 00000100:00100000:3.0:1787119528.769778:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+20:2375:x1873929633758080:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.769791:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.769925:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 20 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.769949:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 20 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.769972:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef8e04b/0xcaba3de8463e415d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047167f6 expref: 20 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.769997:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 262) 00010000:00010000:3.0:1787119528.770002:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 262) 00010000:00010000:3.0:1787119528.770010:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 46 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.770021:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 46 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.770053:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 46 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.770069:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653717632:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.770187:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.776668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.776745:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633758208 00000100:00100000:2.0:1787119528.776759:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633758208 00002000:00100000:2.0:1787119528.776817:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff92a62a126300 x1873929633758208/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.776829:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126300 with x1873929633758208 ext(286720->290815) 00002000:00010000:2.0:1787119528.776835:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126300 00000100:00100000:2.0:1787119528.776865:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10763 00000100:00100000:2.0:1787119528.776874:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+47:2376:x1873929633758208:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.777250:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+47:2376:x1873929633758208:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 375us (588us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119528.777257:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10763 00002000:00100000:2.0:1787119528.777265:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff92a62a126300 x1873929633758208/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.777273:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a126300 with x1873929633758208 ext(286720->290815) 00002000:00010000:2.0:1787119528.777276:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a126300 00000100:00100000:3.0:1787119528.777966:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653717632:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119528.777989:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.779644:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633758080:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 9860us (10483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.779659:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5747 00000100:00100000:1.0:1787119528.783327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.783425:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633758336 00000100:00100000:2.0:1787119528.783434:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633758336 00000100:00100000:2.0:1787119528.783522:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5712 00000100:00100000:2.0:1787119528.783531:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+47:33957:x1873929633758336:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.783549:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.783568:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fd6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.783598:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.783607:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 262) 00010000:00010000:2.0:1787119528.783612:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 262) 00010000:00010000:2.0:1787119528.783617:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 48 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.783651:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.783676:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 18 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.783691:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653717760:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.783777:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.786562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.786656:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633758464 00000100:00100000:0.0:1787119528.786667:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633758464 00010000:00010000:0.0:1787119528.786704:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 19 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.786750:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5748 00000100:00100000:0.0:1787119528.786769:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+19:2375:x1873929633758464:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.786784:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.786932:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 19 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.786959:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 19 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.786997:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 262) 00010000:00010000:0.0:1787119528.787003:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 262) 00010000:00010000:0.0:1787119528.787012:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 48 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.787029:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 48 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.787069:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 48 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.787149:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653717888:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.787304:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b174518e/0xcaba3de8463e4187 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716820 expref: 19 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.787322:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653717760:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.787347:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 48 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.787358:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895000, rc 0) 00000100:00100000:0.0:1787119528.787419:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a601377300 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.787933:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+48:33957:x1873929633758336:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4401us (4615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.787940:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5712 00000100:00100000:0.0:1787119528.792627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.792745:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a512844e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653717888:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.792780:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.792848:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2375:x1873929633758464:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6080us (6296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.792859:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5748 00000100:00100000:3.0:1787119528.794184:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633758592 00000100:00100000:3.0:1787119528.794196:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633758592 00002000:00100000:3.0:1787119528.794246:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a508ffc380 x1873929633758592/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.794259:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc380 with x1873929633758592 ext(290816->294911) 00002000:00010000:3.0:1787119528.794264:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffc380 00000100:00100000:3.0:1787119528.794338:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10764 00000100:00100000:3.0:1787119528.794349:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+48:2375:x1873929633758592:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.794568:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+48:2375:x1873929633758592:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 220us (1949us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119528.794575:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10764 00002000:00100000:3.0:1787119528.794581:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff92a508ffc380 x1873929633758592/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.794590:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508ffc380 with x1873929633758592 ext(290816->294911) 00002000:00010000:3.0:1787119528.794593:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a508ffc380 00000100:00100000:0.0:1787119528.797920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.798006:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633758720 00000100:00100000:2.0:1787119528.798017:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633758720 00000100:00100000:2.0:1787119528.798117:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5713 00000100:00100000:2.0:1787119528.798129:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+48:33957:x1873929633758720:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.798147:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.798168:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fdd expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.798199:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471683c expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.798209:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 262) 00010000:00010000:2.0:1787119528.798213:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 262) 00010000:00010000:2.0:1787119528.798218:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.798252:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471683c expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.798279:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471683c expref: 17 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.798294:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653718016:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.798381:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.802626:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653718016:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.802667:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.802690:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895400, rc 0) 00000100:00100000:2.0:1787119528.802753:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633758720:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4626us (4842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.802771:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5713 00000100:00100000:1.0:1787119528.802942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.803048:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633758848 00000100:00100000:2.0:1787119528.803056:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633758848 00010000:00010000:2.0:1787119528.803102:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471683c expref: 18 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.803133:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5749 00000100:00100000:2.0:1787119528.803143:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+18:2376:x1873929633758848:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119528.803162:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119528.803186:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471683c expref: 18 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.803213:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471683c expref: 18 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.803241:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e41a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471683c expref: 18 pid: 6696 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.803265:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 262) 00010000:00010000:2.0:1787119528.803270:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 262) 00010000:00010000:2.0:1787119528.803277:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 48 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.803289:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 48 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.803323:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 48 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.803338:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653718144:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119528.803395:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.813680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.813777:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633758976 00000100:00100000:1.0:1787119528.813787:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633758976 00002000:00100000:1.0:1787119528.813841:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (294912->303103) req@ffff92a5098a6300 x1873929633758976/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.813853:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6300 with x1873929633758976 ext(294912->303103) 00002000:00010000:1.0:1787119528.813859:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6300 00000100:00100000:1.0:1787119528.813899:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10765 00000100:00100000:1.0:1787119528.813910:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2376:x1873929633758976:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.814126:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2376:x1873929633758976:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 217us (455us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1787119528.814134:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10765 00002000:00100000:1.0:1787119528.814140:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (294912->303103) req@ffff92a5098a6300 x1873929633758976/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/8632 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.814149:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6300 with x1873929633758976 ext(294912->303103) 00002000:00010000:1.0:1787119528.814153:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6300 00000100:00100000:2.0:1787119528.816792:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1873929653718144:192.168.201.59@tcp:105: 00010000:00010000:2.0:1787119528.816826:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.816903:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2376:x1873929633758848:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13751us (13952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.816916:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5749 00000100:00100000:0.0:1787119528.818859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.819004:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633759104 00000100:00100000:3.0:1787119528.819015:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633759104 00000100:00100000:3.0:1787119528.819076:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5714 00000100:00100000:3.0:1787119528.819096:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+49:33957:x1873929633759104:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.819116:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.819136:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716fe4 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.819169:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.819179:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 262) 00010000:00010000:3.0:1787119528.819183:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 262) 00010000:00010000:3.0:1787119528.819188:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.819222:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 16 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.819249:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 16 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.819264:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653718272:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.819356:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.822217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.822278:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633759232 00000100:00100000:1.0:1787119528.822285:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633759232 00010000:00010000:1.0:1787119528.822317:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 17 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.822350:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5750 00000100:00100000:1.0:1787119528.822357:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+17:2375:x1873929633759232:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.822370:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.822391:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 17 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.822418:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 17 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.822477:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 262) 00010000:00010000:1.0:1787119528.822482:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 262) 00010000:00010000:1.0:1787119528.822490:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.822501:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50080000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.822551:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.822565:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653718400:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.822631:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd240 going to sleep for 11 seconds 00010000:00010000:3.0:1787119528.823368:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df0a0d4/0xcaba3de8463e41aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716843 expref: 17 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.823384:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653718272:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119528.823412:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 50 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.823423:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d85400, rc 0) 00000100:00100000:3.0:1787119528.823502:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633759104:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4418us (4651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.823510:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5714 00000100:00100000:0.0:1787119528.827192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.827292:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633759360 00000100:00100000:2.0:1787119528.827300:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633759360 00002000:00100000:2.0:1787119528.827342:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a5098a4a80 x1873929633759360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.827351:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633759360 ext(303104->307199) 00002000:00010000:2.0:1787119528.827355:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4a80 00000100:00100000:2.0:1787119528.827381:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10766 00000100:00100000:2.0:1787119528.827387:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633759360:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.827600:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2375:x1873929633759360:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 212us (415us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119528.827606:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10766 00002000:00100000:2.0:1787119528.827611:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff92a5098a4a80 x1873929633759360/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.827617:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4a80 with x1873929633759360 ext(303104->307199) 00002000:00010000:2.0:1787119528.827619:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4a80 00000100:00100000:1.0:1787119528.828942:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653718400:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.828969:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.829013:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2375:x1873929633759232:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6654us (6802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.829022:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5750 00000100:00100000:0.0:1787119528.830745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.830927:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633759488 00000100:00100000:2.0:1787119528.830935:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633759488 00000100:00100000:2.0:1787119528.831103:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5715 00000100:00100000:2.0:1787119528.831113:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+50:33957:x1873929633759488:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.831135:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.831159:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716feb expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.831195:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047168eb expref: 15 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.831205:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 262) 00010000:00010000:2.0:1787119528.831209:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 262) 00010000:00010000:2.0:1787119528.831215:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 51 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.831251:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa8892732047168eb expref: 15 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.831272:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047168eb expref: 15 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.831283:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653718528:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.831358:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.833603:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653718528:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119528.833635:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 51 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.833654:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506895c00, rc 0) 00000100:00100000:1.0:1787119528.833711:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633759488:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2597us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.833719:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5715 00000100:00100000:0.0:1787119528.834570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.834632:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633759616 00000100:00100000:1.0:1787119528.834639:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633759616 00010000:00010000:1.0:1787119528.834671:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047168eb expref: 16 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.834712:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5751 00000100:00100000:1.0:1787119528.834722:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+16:2376:x1873929633759616:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.834739:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.834768:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047168eb expref: 16 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.834789:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047168eb expref: 16 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.834814:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea5e051/0xcaba3de8463e4252 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa8892732047168eb expref: 16 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.834826:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 262) 00010000:00010000:1.0:1787119528.834829:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 262) 00010000:00010000:1.0:1787119528.834836:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 50 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.834846:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 50 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.834882:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 50 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.834924:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653718656:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.834983:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.839332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.839419:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653718656:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.839468:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.839519:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633759616:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4799us (4952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.839530:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5751 00000100:00100000:2.0:1787119528.839606:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633759744 00000100:00100000:2.0:1787119528.839613:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633759744 00002000:00100000:2.0:1787119528.839649:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a5098a4e00 x1873929633759744/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.839657:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633759744 ext(307200->311295) 00002000:00010000:2.0:1787119528.839661:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:2.0:1787119528.839691:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10767 00000100:00100000:2.0:1787119528.839700:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2375:x1873929633759744:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119528.839944:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2375:x1873929633759744:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 244us (621us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119528.839953:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10767 00002000:00100000:2.0:1787119528.839959:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff92a5098a4e00 x1873929633759744/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.839967:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4e00 with x1873929633759744 ext(307200->311295) 00002000:00010000:2.0:1787119528.839971:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4e00 00000100:00100000:0.0:1787119528.843432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.843577:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633759872 00000100:00100000:2.0:1787119528.843585:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633759872 00000100:00100000:2.0:1787119528.843638:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5716 00000100:00100000:2.0:1787119528.843649:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+51:33957:x1873929633759872:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.843667:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.843715:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ff2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.843750:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 14 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.843905:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 262) 00010000:00010000:2.0:1787119528.843910:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 262) 00010000:00010000:2.0:1787119528.843915:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 52 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.843945:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 14 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.843965:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 14 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.843976:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653718784:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.844049:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.846227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.846325:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653718784:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.846362:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 52 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.846384:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e7000, rc 0) 00000100:00100000:3.0:1787119528.846395:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633760000 00000100:00100000:3.0:1787119528.846402:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633760000 00010000:00010000:3.0:1787119528.846435:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 15 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.846470:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633759872:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2823us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.846478:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5716 00000100:00100000:3.0:1787119528.846508:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5752 00000100:00100000:3.0:1787119528.846518:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+15:2376:x1873929633760000:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.846532:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.846557:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 15 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.846581:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 15 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.846604:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005317f30d/0xcaba3de8463e4259 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047168f2 expref: 15 pid: 6695 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.846617:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 262) 00010000:00010000:3.0:1787119528.846622:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 262) 00010000:00010000:3.0:1787119528.846632:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.846644:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.846692:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 51 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.846706:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653718912:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.846762:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.849826:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653718912:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119528.849932:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119528.850071:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2376:x1873929633760000:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3552us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.850095:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5752 00000100:00100000:0.0:1787119528.852369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.852848:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633760128 00000100:00100000:1.0:1787119528.852859:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633760128 00002000:00100000:1.0:1787119528.852921:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a5098a5f80 x1873929633760128/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.852930:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5f80 with x1873929633760128 ext(311296->315391) 00002000:00010000:1.0:1787119528.852934:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5f80 00000100:00100000:1.0:1787119528.852962:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10768 00000100:00100000:1.0:1787119528.852972:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633760128:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.853159:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633760128:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 187us (798us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119528.853167:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10768 00002000:00100000:1.0:1787119528.853174:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff92a5098a5f80 x1873929633760128/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.853182:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5f80 with x1873929633760128 ext(311296->315391) 00002000:00010000:1.0:1787119528.853185:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5f80 00000100:00100000:1.0:1787119528.856554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.856966:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633760256 00000100:00100000:2.0:1787119528.856976:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633760256 00000100:00100000:2.0:1787119528.857070:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5717 00000100:00100000:2.0:1787119528.857078:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+52:33957:x1873929633760256:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.857102:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.857118:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204716ff9 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.857143:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.857149:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 262) 00010000:00010000:2.0:1787119528.857153:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 262) 00010000:00010000:2.0:1787119528.857156:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.857186:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 13 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.857208:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 13 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.857218:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653719040:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.857286:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.859384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.859414:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653719040:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.859472:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.859493:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e6200, rc 0) 00000100:00100000:2.0:1787119528.859555:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+53:33957:x1873929633760256:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2476us (3012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.859564:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5717 00000100:00100000:1.0:1787119528.859633:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633760384 00000100:00100000:1.0:1787119528.859638:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633760384 00010000:00010000:1.0:1787119528.859661:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 14 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.859691:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5753 00000100:00100000:1.0:1787119528.859699:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+14:2375:x1873929633760384:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.859714:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.859737:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 14 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.859984:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 14 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.860011:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024de64fb/0xcaba3de8463e43a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a42 expref: 14 pid: 12469 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.860028:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 262) 00010000:00010000:1.0:1787119528.860034:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 262) 00010000:00010000:1.0:1787119528.860042:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.860055:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.860097:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.860108:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653719168:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.860162:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.863052:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653719168:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.863092:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.863156:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2375:x1873929633760384:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3455us (3781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.863167:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5753 00000100:00100000:0.0:1787119528.866175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.866287:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633760512 00000100:00100000:1.0:1787119528.866297:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633760512 00002000:00100000:1.0:1787119528.866350:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff92a5098a5500 x1873929633760512/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.866361:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633760512 ext(315392->323583) 00002000:00010000:1.0:1787119528.866366:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5500 00000100:00100000:1.0:1787119528.866402:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10769 00000100:00100000:1.0:1787119528.866411:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2375:x1873929633760512:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119528.866854:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2375:x1873929633760512:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 433us (679us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1787119528.866863:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10769 00002000:00100000:0.0:1787119528.866871:0:6700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff92a5098a5500 x1873929633760512/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/8632 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.866880:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a5500 with x1873929633760512 ext(315392->323583) 00002000:00010000:0.0:1787119528.866883:0:6700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a5500 00000100:00100000:3.0:1787119528.869470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.869521:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633760640 00000100:00100000:0.0:1787119528.869531:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633760640 00000100:00100000:0.0:1787119528.869635:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5718 00000100:00100000:0.0:1787119528.869647:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+53:33957:x1873929633760640:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119528.869679:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119528.869700:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717000 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.869734:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 12 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.869744:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 262) 00010000:00010000:0.0:1787119528.869748:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 262) 00010000:00010000:0.0:1787119528.869752:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.869787:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 12 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.869813:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 12 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.869829:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653719296:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119528.869935:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a601377300 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.871814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.871818:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653719296:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119528.871859:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.871879:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38c00, rc 0) 00000100:00100000:0.0:1787119528.872003:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+54:33957:x1873929633760640:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2357us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119528.872012:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5718 00000100:00100000:1.0:1787119528.872164:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633760768 00000100:00100000:1.0:1787119528.872172:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633760768 00010000:00010000:1.0:1787119528.872202:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 13 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.872239:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5754 00000100:00100000:1.0:1787119528.872248:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+13:2376:x1873929633760768:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.872261:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.872284:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 13 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.872307:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 13 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.872332:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001873e9c9/0xcaba3de8463e43b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716a50 expref: 13 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.872346:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 262) 00010000:00010000:1.0:1787119528.872350:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 262) 00010000:00010000:1.0:1787119528.872358:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 53 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.872371:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 53 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.872400:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 53 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.872409:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653719424:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.872498:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.874695:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653719424:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.874722:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.874780:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633760768:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2532us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.874791:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5754 00000100:00100000:3.0:1787119528.876699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.877001:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633760896 00000100:00100000:0.0:1787119528.877011:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633760896 00002000:00100000:0.0:1787119528.877060:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a63dc07480 x1873929633760896/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.877069:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07480 with x1873929633760896 ext(323584->327679) 00002000:00010000:0.0:1787119528.877075:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07480 00000100:00100000:0.0:1787119528.877109:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10770 00000100:00100000:0.0:1787119528.877129:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+54:2376:x1873929633760896:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119528.877352:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+54:2376:x1873929633760896:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 235us (661us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787119528.877357:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10770 00002000:00100000:0.0:1787119528.877362:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff92a63dc07480 x1873929633760896/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119528.877367:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07480 with x1873929633760896 ext(323584->327679) 00002000:00010000:0.0:1787119528.877370:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63dc07480 00000100:00100000:2.0:1787119528.883695:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.883822:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633761024 00000100:00100000:1.0:1787119528.883834:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633761024 00000100:00100000:1.0:1787119528.883907:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5719 00000100:00100000:1.0:1787119528.883918:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+54:33957:x1873929633761024:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119528.883938:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119528.883959:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717007 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.883992:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 11 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.884002:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 262) 00010000:00010000:1.0:1787119528.884006:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 262) 00010000:00010000:1.0:1787119528.884011:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.884045:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 11 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.884071:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 11 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.884098:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653719552:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119528.884181:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.887604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.887604:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653719552:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119528.887640:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.887663:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e68a00, rc 0) 00000100:00100000:2.0:1787119528.887837:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633761152 00000100:00100000:2.0:1787119528.887844:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633761152 00010000:00010000:2.0:1787119528.887880:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 12 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.887926:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5755 00000100:00100000:2.0:1787119528.887938:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633761152:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119528.887954:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119528.887989:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 12 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.888015:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 12 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.888041:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b687e7e/0xcaba3de8463e4427 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ac0 expref: 12 pid: 20841 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.888057:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 262) 00010000:00010000:2.0:1787119528.888062:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 262) 00010000:00010000:2.0:1787119528.888071:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.888092:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.888126:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 55 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.888140:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653719680:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.888360:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633761024:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4443us (4676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.888368:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5719 00000100:00100000:2.0:1787119528.889263:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.898385:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653719680:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.898385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119528.898412:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119528.898478:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633761152:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 10542us (10881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.898502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5755 00000100:00100000:1.0:1787119528.899591:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633761280 00000100:00100000:1.0:1787119528.899603:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633761280 00002000:00100000:1.0:1787119528.899652:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a5098a6680 x1873929633761280/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.899662:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6680 with x1873929633761280 ext(327680->331775) 00002000:00010000:1.0:1787119528.899666:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6680 00000100:00100000:1.0:1787119528.899698:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10771 00000100:00100000:1.0:1787119528.899706:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2375:x1873929633761280:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.900240:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2375:x1873929633761280:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 533us (1855us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119528.900250:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10771 00002000:00100000:1.0:1787119528.900258:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff92a5098a6680 x1873929633761280/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.900268:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a6680 with x1873929633761280 ext(327680->331775) 00002000:00010000:1.0:1787119528.900272:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a6680 00000100:00100000:0.0:1787119528.904301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.904427:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633761408 00000100:00100000:2.0:1787119528.904506:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633761408 00000100:00100000:2.0:1787119528.904616:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5720 00000100:00100000:2.0:1787119528.904627:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+55:33957:x1873929633761408:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.904648:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.904671:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471700e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.904707:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.904719:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 262) 00010000:00010000:2.0:1787119528.904724:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 262) 00010000:00010000:2.0:1787119528.904730:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 56 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.904782:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.904875:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 10 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.904902:0:6696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653719808:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.904985:0:6696:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.908702:0:6696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1873929653719808:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.908739:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 56 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.908780:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e6800, rc 0) 00000100:00100000:2.0:1787119528.908968:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633761408:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4341us (4677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.908982:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5720 00000100:00100000:3.0:1787119528.910404:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119528.910535:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633761536 00000100:00100000:0.0:1787119528.910545:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633761536 00010000:00010000:0.0:1787119528.910587:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 11 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.910629:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5756 00000100:00100000:0.0:1787119528.910638:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633761536:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119528.910654:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119528.910682:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 11 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.910711:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 11 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.910740:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4435 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716ace expref: 11 pid: 8267 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.910771:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 262) 00010000:00010000:0.0:1787119528.910777:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 262) 00010000:00010000:0.0:1787119528.910787:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.910799:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119528.910850:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 55 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119528.910865:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653719936:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119528.910953:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a601377300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119528.918747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.919299:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1873929653719936:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.919324:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.919394:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2375:x1873929633761536:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8755us (8997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.919405:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5756 00000100:00100000:3.0:1787119528.919583:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633761664 00000100:00100000:3.0:1787119528.919591:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633761664 00002000:00100000:3.0:1787119528.919638:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff92a5098a4700 x1873929633761664/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.919657:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633761664 ext(331776->335871) 00002000:00010000:3.0:1787119528.919662:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4700 00000100:00100000:3.0:1787119528.919690:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10772 00000100:00100000:3.0:1787119528.919699:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633761664:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.920136:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2375:x1873929633761664:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 438us (1399us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119528.920144:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10772 00002000:00100000:3.0:1787119528.920151:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff92a5098a4700 x1873929633761664/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.920159:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4700 with x1873929633761664 ext(331776->335871) 00002000:00010000:3.0:1787119528.920163:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4700 00000100:00100000:0.0:1787119528.926068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.926274:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633761792 00000100:00100000:2.0:1787119528.926286:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633761792 00000100:00100000:2.0:1787119528.926400:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5721 00000100:00100000:2.0:1787119528.926412:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+56:33957:x1873929633761792:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119528.926432:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119528.926492:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717015 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.926528:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.926538:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(200 262) 00010000:00010000:2.0:1787119528.926543:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 262) 00010000:00010000:2.0:1787119528.926549:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.926586:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.926614:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 9 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119528.926631:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653720064:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119528.926722:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3600 going to sleep for 11 seconds 00010000:00010000:0.0:1787119528.929611:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119528.931005:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653720064:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119528.931044:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 57 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.931067:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e7e00, rc 0) 00000100:00100000:2.0:1787119528.931143:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633761792:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 4732us (5084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119528.931152:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5721 00000100:00100000:0.0:1787119528.932859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.933074:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633761920 00000100:00100000:1.0:1787119528.933094:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633761920 00010000:00010000:1.0:1787119528.933136:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 10 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.933186:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5757 00000100:00100000:1.0:1787119528.933197:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633761920:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119528.933212:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119528.933235:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 10 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.933262:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 10 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.933291:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567df3e5/0xcaba3de8463e4569 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716c02 expref: 10 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.933308:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 262) 00010000:00010000:1.0:1787119528.933313:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 262) 00010000:00010000:1.0:1787119528.933321:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.933332:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.933368:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 56 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119528.933383:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a125f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653720192:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119528.933516:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787119528.938505:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a125f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653720192:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119528.938539:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119528.938587:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633761920:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 5393us (5735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.938596:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5757 00000100:00100000:0.0:1787119528.939957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.940063:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633762048 00000100:00100000:3.0:1787119528.940071:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633762048 00002000:00100000:3.0:1787119528.940118:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a5098a4380 x1873929633762048/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.940126:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4380 with x1873929633762048 ext(335872->339967) 00002000:00010000:3.0:1787119528.940130:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4380 00000100:00100000:3.0:1787119528.940152:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10773 00000100:00100000:3.0:1787119528.940159:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2375:x1873929633762048:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119528.940325:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2375:x1873929633762048:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 166us (372us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119528.940330:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10773 00002000:00100000:3.0:1787119528.940335:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff92a5098a4380 x1873929633762048/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/4536 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119528.940341:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5098a4380 with x1873929633762048 ext(335872->339967) 00002000:00010000:3.0:1787119528.940343:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5098a4380 00000100:00100000:0.0:1787119528.949173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.949383:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633762176 00000100:00100000:3.0:1787119528.949395:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633762176 00000100:00100000:3.0:1787119528.949549:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5722 00000100:00100000:3.0:1787119528.949562:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+57:33957:x1873929633762176:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119528.949583:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119528.949604:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471701c expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.949638:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.949648:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 262) 00010000:00010000:3.0:1787119528.949653:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 262) 00010000:00010000:3.0:1787119528.949658:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.949691:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.949718:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 8 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.949739:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653720320:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119528.949886:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787119528.954390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119528.954670:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633762304 00000100:00100000:2.0:1787119528.954680:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633762304 00002000:00100000:2.0:1787119528.954733:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a63dc04700 x1873929633762304/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 12776/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.954745:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04700 with x1873929633762304 ext(397312->409599) 00010000:00010000:2.0:1787119528.954771:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 9 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.954810:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 9 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.954819:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc04700 00000100:00100000:2.0:1787119528.954848:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1459 00000100:00100000:2.0:1787119528.954858:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633762304:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1787119528.955321:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633762304:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 462us (939us total) trans 4294969275 rc 0/0 00000100:00100000:2.0:1787119528.955329:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1459 00002000:00100000:2.0:1787119528.955336:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a63dc04700 x1873929633762304/t4294969275(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:564/0 lens 12776/448 e 0 to 0 dl 1787119539 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119528.955343:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc04700 with x1873929633762304 ext(397312->409599) 00010000:00010000:2.0:1787119528.955349:0:18547:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 11 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119528.955364:0:18547:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 11 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119528.955372:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a63dc04700 00000100:00100000:1.0:1787119528.956639:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653720320:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119528.956673:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119528.956700:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84400, rc 0) 00000100:00100000:1.0:1787119528.956771:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33957:x1873929633762176:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7205us (7601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119528.956781:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5722 00000100:00100000:0.0:1787119528.962651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.962915:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633762432 00000100:00100000:3.0:1787119528.962926:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633762432 00010000:00010000:3.0:1787119528.962988:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 11 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.963038:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5758 00000100:00100000:3.0:1787119528.963049:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2374:x1873929633762432:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119528.963065:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119528.963099:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 11 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.963124:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 11 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.963152:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed70cbf5/0xcaba3de8463e4895 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204716f2e expref: 11 pid: 6696 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.963170:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 262) 00010000:00010000:3.0:1787119528.963175:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 262) 00010000:00010000:3.0:1787119528.963183:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.963198:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119528.963236:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 57 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119528.963251:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653720448:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119528.963382:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a607f56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119528.968737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119528.969110:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633762560 00000100:00100000:1.0:1787119528.969120:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633762560 00002000:00100000:1.0:1787119528.969168:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a5066dd180 x1873929633762560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/0 e 0 to 0 dl 1787119539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.969180:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633762560 ext(397312->409599) 00002000:00010000:1.0:1787119528.969185:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:1.0:1787119528.969219:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10774 00000100:00100000:1.0:1787119528.969227:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633762560:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119528.969427:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2375:x1873929633762560:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 199us (703us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119528.969435:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10774 00002000:00100000:1.0:1787119528.969473:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff92a5066dd180 x1873929633762560/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:564/0 lens 488/12728 e 0 to 0 dl 1787119539 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119528.969481:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd180 with x1873929633762560 ext(397312->409599) 00002000:00010000:1.0:1787119528.969485:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dd180 00000100:00100000:3.0:1787119528.969696:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653720448:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119528.969719:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119528.969749:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2374:x1873929633762432:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 6703us (7107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119528.970058:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5758 00000100:00100000:2.0:1787119528.986709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119528.987045:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633762816 00000100:00100000:3.0:1787119528.987056:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633762816 00000100:00100000:3.0:1787119528.987151:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 229 00000100:00100000:3.0:1787119528.987163:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+17:33957:x1873929633762816:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1787119528.987568:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33957:x1873929633762816:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 407us (870us total) trans 4294976609 rc 0/0 00000100:00100000:3.0:1787119528.987577:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 229 00000100:00080000:0.0:1787119528.987715:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119529.121744:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653720704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119529.121838:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119529.121876:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653720960:0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.121927:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119529.121934:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653721216:0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.121954:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787119529.121964:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653720576:0@lo:400:kworker.0 00000100:00100000:0.0:1787119529.121972:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119529.121996:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787119529.122008:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653720832:0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.122009:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119529.122043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119529.122120:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653721088:0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.122156:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119529.122181:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653721472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119529.122209:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119529.122218:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653721088 00000100:00100000:1.0:1787119529.122228:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653721088 00000100:00100000:3.0:1787119529.122246:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653720576 00000100:00100000:3.0:1787119529.122252:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653720576 00000100:00100000:3.0:1787119529.122295:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1787119529.122301:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1787119529.122306:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653720576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119529.122315:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653721088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.122365:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653720576:12345-0@lo:400:kworker.0 Request processed in 62us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119529.122373:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1787119529.122373:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653721088:12345-0@lo:400:kworker.0 Request processed in 61us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119529.122386:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1787119529.122409:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653720704 00000100:00100000:3.0:1787119529.122414:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653720704 00000100:00100000:1.0:1787119529.122433:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653720960 00000100:00100000:1.0:1787119529.122458:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653720960 00000100:00100000:3.0:1787119529.122462:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653721472 00000100:00100000:3.0:1787119529.122468:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653721472 00000100:00100000:3.0:1787119529.124850:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787119529.124868:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653720704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787119529.124923:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321847296 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1787119529.125001:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653720704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119529.125009:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787119529.125026:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787119529.125033:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653721472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119529.125160:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 78381056 granted 842727424 pending 23855104 free 3827302400 avail 3825205248 00000100:00100000:3.0:1787119529.125196:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653721472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (2987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119529.125202:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787119529.125275:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5066dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653721472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119529.125289:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653720576:0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.125301:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653721088:0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.125347:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653721344:0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.125386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119529.125429:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653720704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787119529.126498:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119529.126505:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787119529.126508:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119529.126543:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653721216 00000100:00100000:0.0:1787119529.126551:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653721216 00000100:00100000:2.0:1787119529.126839:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653720832 00000100:00100000:2.0:1787119529.126844:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653720832 00000100:00100000:1.0:1787119529.126939:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1787119529.126950:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653720960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119529.127028:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653720960:12345-0@lo:400:kworker.0 Request processed in 81us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119529.127035:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1787119529.127140:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653721344 00000100:00100000:3.0:1787119529.127147:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653721344 00000100:00100000:3.0:1787119529.127183:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1787119529.127191:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653721344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.127238:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653721344:12345-0@lo:400:kworker.0 Request processed in 48us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119529.127245:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1787119529.127282:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653721344:0@lo:400:kworker.0 00000100:00100000:3.0:1787119529.127329:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653720960:0@lo:400:kworker.0 00000100:00080000:3.0:1787119529.127357:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119529.132432:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1787119529.132473:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653721216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119529.132603:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653721216:12345-0@lo:400:kworker.0 Request processed in 144us (10633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119529.132623:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1787119529.133791:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653721216:0@lo:400:kworker.0 00000100:00100000:2.0:1787119529.134068:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1787119529.134096:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653720832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119529.134183:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653720832:12345-0@lo:400:kworker.0 Request processed in 107us (12141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119529.134190:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1787119529.134405:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653720832:0@lo:400:kworker.0 00010000:00010000:2.0:1787119529.953831:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119530.432295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119530.432377:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633763072 00000100:00100000:3.0:1787119530.432397:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633763072 00000100:00100000:3.0:1787119530.432499:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 230 00000100:00100000:3.0:1787119530.432510:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+40:33946:x1873929633763072:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1787119530.432897:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633763072:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 387us (610us total) trans 4294976610 rc 0/0 00000100:00100000:3.0:1787119530.434262:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 230 00000100:00100000:3.0:1787119530.436924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00080000:0.0:1787119530.437172:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119530.437242:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633763200 00000100:00100000:2.0:1787119530.437253:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633763200 00000100:00100000:2.0:1787119530.437313:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19786 00000100:00100000:2.0:1787119530.437322:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633763200:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119530.437345:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119530.437364:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e498a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717023 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.437465:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4991 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.437479:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4991 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.437490:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4991 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119530.437672:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1787119530.437676:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 47 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119530.437748:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4991 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.437773:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e498a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717023 expref: 43 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.437789:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4991 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717023 expref: 42 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.437798:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaff00) 00010000:00010000:2.0:1787119530.437801:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787119530.437804:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e7200, rc 0) 00000100:00100000:2.0:1787119530.437892:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633763200:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 570us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119530.437900:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19786 00000100:00100000:2.0:1787119530.442789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119530.445039:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633763328 00000100:00100000:3.0:1787119530.445171:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633763328 00000100:00100000:3.0:1787119530.445357:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19787 00000100:00100000:3.0:1787119530.445368:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633763328:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119530.445388:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119530.445410:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e4998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471702a expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.445492:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.445506:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.445516:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.445534:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.445540:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.445550:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.445963:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e49ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.445985:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e49ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.445993:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e49ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787119530.446029:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6c:0x0]: returning size 409600 00000004:00200000:3.0:1787119530.446033:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787119530.446247:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e49ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446262:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e49ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446272:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446279:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446286:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446293:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d84c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119530.446297:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446306:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446318:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaff00) 00010000:00010000:3.0:1787119530.446321:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119530.446326:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446332:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84c00/0xcaba3de8463e499f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446346:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446353:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446359:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446364:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119530.446367:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446372:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446378:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1b4ce6b (ffff92a60384c100) 00010000:00010000:3.0:1787119530.446381:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119530.446383:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446392:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446423:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e4998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471702a expref: 44 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.446929:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e49ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471702a expref: 43 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.447304:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:3.0:1787119530.447307:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787119530.447310:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a63ebf0800, rc 0) 00000100:00100000:3.0:1787119530.447437:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633763328:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2069us (4656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119530.447461:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19787 00000100:00100000:1.0:1787119530.459290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.459463:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633763584 00000100:00100000:0.0:1787119530.459473:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633763584 00000100:00100000:0.0:1787119530.459533:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19788 00000100:00100000:0.0:1787119530.459544:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633763584:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1787119530.459594:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787119530.459622:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf0800/0xcaba3de8463e49ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471702a expref: 43 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.459643:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1600/0xcaba3de8463e38ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fc9 expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.459653:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:0.0:1787119530.459662:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4991 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717023 expref: 41 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.459669:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaff00) 00010000:00010000:0.0:1787119530.459671:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119530.459691:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.459703:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fd7 expref: 17 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.459717:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.459760:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd7 expref: 17 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.459785:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd7 expref: 17 pid: 15690 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119530.459799:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a5098a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653721600:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119530.459908:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a601377300 going to sleep for 11 seconds 00000100:00100000:0.0:1787119530.464082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.464514:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633763712 00000100:00100000:1.0:1787119530.464524:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633763712 00010000:00010000:1.0:1787119530.464576:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd7 expref: 18 pid: 15690 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119530.464621:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5759 00000100:00100000:1.0:1787119530.464631:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633763712:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119530.464646:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119530.464653:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd7 expref: 18 pid: 15690 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.464680:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd7 expref: 18 pid: 15690 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.464703:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaff00) 00010000:00010000:1.0:1787119530.464709:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.464719:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.464727:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.464746:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119530.464796:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633763712:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 167us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119530.464804:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5759 00000100:00080000:0.0:1787119530.464962:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787119530.465107:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84600/0xcaba3de8463e3914 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fd7 expref: 17 pid: 15690 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119530.465127:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a5098a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653721600:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119530.465147:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465156:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465162:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465200:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465210:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465217:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465617:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465629:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715fde expref: 16 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465637:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465669:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fde expref: 16 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.465688:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fde expref: 16 pid: 12121 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119530.465702:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653721728:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119530.465774:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119530.475957:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc05880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1873929653721728:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119530.475991:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119530.480358:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.480613:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633763840 00000100:00100000:2.0:1787119530.480622:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633763840 00010000:00010000:2.0:1787119530.480664:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fde expref: 17 pid: 12121 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119530.480704:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5760 00000100:00100000:2.0:1787119530.480714:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+17:2376:x1873929633763840:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119530.480729:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119530.480736:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fde expref: 17 pid: 12121 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.480761:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fde expref: 17 pid: 12121 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.480786:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84a00/0xcaba3de8463e3930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204715fde expref: 17 pid: 12121 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.480807:0:20609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:2.0:1787119530.480813:0:20609:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.480822:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.480834:0:20609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.480878:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119530.480948:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2376:x1873929633763840:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 225us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119530.480956:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5760 00010000:00010000:0.0:1787119530.480973:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.480981:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787119530.482713:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9664 00000004:00080000:0.0:1787119530.482727:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1056560287012ns, next at 1057560284078ns, rc = 0 00010000:00010000:0.0:1787119530.482803:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.482819:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483180:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483191:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483197:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483203:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483229:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787119530.483253:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483259:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483266:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483273:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a519d84800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119530.483277:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483285:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483297:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:2.0:1787119530.483298:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787119530.483301:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787119530.483304:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483305:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.483312:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a510a38a00 already unused, calling callback (ffffffffc163d010) 00010000:00010000:2.0:1787119530.483315:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483316:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d84800/0xcaba3de8463e49c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.483322:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.483330:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff92a60384ce00) 00010000:00010000:2.0:1787119530.483333:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787119530.483335:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.483336:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483341:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.483342:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e49c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483347:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483351:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a510a38600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119530.483354:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483359:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.483365:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119530.483365:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaff00) 00010000:00010000:2.0:1787119530.483367:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119530.483367:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119530.483368:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119530.483370:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.483375:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38600/0xcaba3de8463e49b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787119530.483390:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9063460 reply state 00000000d4d2cff9 transno 4294976611 ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119530.483399:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787119530.484028:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633763584:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 24480us (24743us total) trans 4294976611 rc 0/0 00000100:00100000:0.0:1787119530.484039:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19788 00010000:00010000:0.0:1787119530.487813:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.487841:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.487848:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.487854:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a63ebf1e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119530.487859:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.487876:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.487894:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1b4ce6b (ffff92a60384c100) 00010000:00010000:0.0:1787119530.487897:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119530.487903:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.487909:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a63ebf1e00/0xcaba3de8463e49bb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119530.497215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.497325:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633763968 00000100:00100000:2.0:1787119530.497336:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633763968 00000100:00100000:2.0:1787119530.497398:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19789 00000100:00100000:2.0:1787119530.497408:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633763968:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119530.497433:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119530.497499:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e49d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717031 expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.497622:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68400/0xcaba3de8463e49d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.497637:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68400/0xcaba3de8463e49d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.497648:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68400/0xcaba3de8463e49d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119530.497722:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:1.0:1787119530.497726:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 46 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119530.497751:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68400/0xcaba3de8463e49d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.497778:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e49d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717031 expref: 43 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.497796:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68400/0xcaba3de8463e49d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717031 expref: 42 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.497806:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038300) 00010000:00010000:1.0:1787119530.497810:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787119530.498036:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e68400, rc 0) 00000100:00100000:1.0:1787119530.498117:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633763968:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 709us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119530.498125:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19789 00000100:00100000:1.0:1787119530.503568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.503885:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633764096 00000100:00100000:2.0:1787119530.503895:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633764096 00000100:00100000:2.0:1787119530.503962:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19790 00000100:00100000:2.0:1787119530.503972:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633764096:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119530.503991:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119530.504009:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e49de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717038 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504268:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504280:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504287:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504333:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504339:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504346:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504407:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504412:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504418:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504425:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119530.504429:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504436:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504651:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038300) 00010000:00010000:2.0:1787119530.504653:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119530.504658:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504664:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e49e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504677:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504682:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504689:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504693:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119530.504695:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504701:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504708:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff92a620038a00) 00010000:00010000:2.0:1787119530.504711:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119530.504713:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504717:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e49ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504760:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e49de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717038 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504770:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038300) 00010000:00010000:2.0:1787119530.504772:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119530.504775:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e49de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717038 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.504784:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e7c00, rc 0) 00000100:00100000:2.0:1787119530.504855:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633764096:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 882us (1293us total) trans 0 rc 301/301 00000100:00100000:2.0:1787119530.504875:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19790 00000100:00100000:3.0:1787119530.508823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.508935:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633764224 00000100:00100000:1.0:1787119530.508953:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633764224 00000100:00100000:1.0:1787119530.509016:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19791 00000100:00100000:1.0:1787119530.509025:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633764224:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119530.509058:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119530.509080:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68200/0xcaba3de8463e49f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471703f expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509139:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509153:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509164:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509223:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509231:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509239:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509302:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509309:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509316:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509322:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a506e69000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119530.509326:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509333:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509344:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038300) 00010000:00010000:1.0:1787119530.509347:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119530.509351:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509358:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69000/0xcaba3de8463e49fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509370:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509375:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509382:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509387:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a506e69a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119530.509390:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509395:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509401:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff92a61bc19600) 00010000:00010000:1.0:1787119530.509403:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119530.509406:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509412:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69a00/0xcaba3de8463e4a01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509483:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68200/0xcaba3de8463e49f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471703f expref: 43 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509493:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038300) 00010000:00010000:1.0:1787119530.509495:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119530.509498:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68200/0xcaba3de8463e49f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471703f expref: 43 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.509508:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e68200, rc 0) 00000100:00100000:1.0:1787119530.509565:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633764224:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 541us (754us total) trans 0 rc 301/301 00000100:00100000:1.0:1787119530.509576:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19791 00000100:00100000:0.0:1787119530.513423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.514631:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633764480 00000100:00100000:2.0:1787119530.514643:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633764480 00000100:00100000:2.0:1787119530.514697:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19792 00000100:00100000:2.0:1787119530.514707:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633764480:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119530.514730:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119530.514733:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787119530.514762:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68400/0xcaba3de8463e49d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717031 expref: 42 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.514780:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038300) 00010000:00010000:2.0:1787119530.514790:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119530.514804:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.514988:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.515001:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.515011:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.515024:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.515031:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.515038:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787119530.516039:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d:0x0], index 0: 0 00010000:00010000:2.0:1787119530.516216:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4a1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516230:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516239:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516272:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516280:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516287:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516292:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119530.516296:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516303:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516313:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038a00) 00010000:00010000:2.0:1787119530.516316:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119530.516321:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516327:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787119530.516340:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004640f064 reply state 00000000bacf10ef transno 4294976612 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119530.516348:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787119530.516375:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717046 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516392:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717046 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.516399:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a620038b00) 00010000:00010000:2.0:1787119530.516402:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119530.516404:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e6c00, rc 0) 00000100:00100000:2.0:1787119530.516944:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633764480:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 2236us (3541us total) trans 4294976612 rc 0/0 00000100:00100000:2.0:1787119530.516953:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19792 00010000:00010000:0.0:1787119530.522990:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.523011:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.523020:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.523027:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119530.523032:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.523039:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.523057:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff92a620038100) 00010000:00010000:0.0:1787119530.523060:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119530.523065:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.523071:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a16 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119530.524937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.525048:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633764736 00000100:00100000:2.0:1787119530.525060:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633764736 00000100:00100000:2.0:1787119530.525176:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19793 00000100:00100000:2.0:1787119530.525188:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633764736:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1787119530.525248:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119530.525275:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4a1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717046 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.525300:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a620038b00) 00010000:00010000:2.0:1787119530.525311:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119530.525644:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.525655:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.525662:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119530.525700:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976613 00000004:00010000:2.0:1787119530.525715:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1173727 reply state 000000001d2565ec transno 4294976614 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119530.525721:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119530.525819:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5098a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633764736:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 632us (890us total) trans 4294976614 rc 0/0 00000100:00100000:2.0:1787119530.525827:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19793 00000020:00080000:2.0:1787119530.525908:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787119530.528826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119530.529999:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.530015:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.530021:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.530027:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e7c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119530.530032:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.530039:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.530056:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a620038a00) 00010000:00010000:0.0:1787119530.530059:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119530.530063:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.530068:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7c00/0xcaba3de8463e4a2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119530.530314:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633764864 00000100:00100000:1.0:1787119530.530325:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633764864 00000100:00100000:1.0:1787119530.530386:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19794 00000100:00100000:1.0:1787119530.530395:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633764864:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119530.530417:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119530.530436:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68200/0xcaba3de8463e4a32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471704d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.530509:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68200/0xcaba3de8463e4a32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471704d expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.530523:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68200/0xcaba3de8463e4a32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471704d expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.530542:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a61bc19600) 00010000:00010000:1.0:1787119530.530544:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787119530.530547:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e68200, rc 0) 00000100:00100000:1.0:1787119530.530614:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633764864:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 219us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119530.530621:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19794 00000100:00100000:2.0:1787119530.533395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.533564:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633764992 00000100:00100000:1.0:1787119530.533574:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633764992 00000100:00100000:1.0:1787119530.533645:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5723 00000100:00100000:1.0:1787119530.533656:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:33946:x1873929633764992:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119530.533673:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119530.533694:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717054 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119530.533715:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787119530.533733:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=1056s v=(0 0) 00010000:00010000:1.0:1787119530.533737:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787119530.533742:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.533753:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.533763:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e69a00, rc 0) 00000100:00100000:1.0:1787119530.533813:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:33946:x1873929633764992:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 159us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119530.533820:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5723 00000100:00080000:0.0:1787119530.533896:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119530.536294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.536353:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633765120 00000100:00100000:1.0:1787119530.536363:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633765120 00002000:00010000:1.0:1787119530.536400:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/45 (409600->18446744073709551615) 00002000:00100000:1.0:1787119530.536405:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07800 with x1873929633765120 ext(409600->18446744073709551615) 00002000:00010000:1.0:1787119530.539510:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc07800. 00000100:00100000:1.0:1787119530.539709:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10775 00000100:00100000:1.0:1787119530.539743:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633765120:12345-192.168.201.59@tcp:10:mmap_sanity.0 00002000:00010000:1.0:1787119530.540131:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:1.0:1787119530.540135:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb mtime from disk: 0 -> 1787119529 00002000:00010000:1.0:1787119530.540138:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787119530.540140:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb ctime from disk: 0 -> 1787119529 00002000:00010000:1.0:1787119530.540142:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787119530.540230:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633765120:12345-192.168.201.59@tcp:10:mmap_sanity.0 Request processed in 510us (3941us total) trans 4294968932 rc 0/0 00000100:00100000:1.0:1787119530.540239:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10775 00002000:00010000:1.0:1787119530.540243:0:19255:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/45 (409600->18446744073709551615) 00002000:00100000:1.0:1787119530.540246:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63dc07800 with x1873929633765120 ext(409600->18446744073709551615) 00002000:00010000:1.0:1787119530.540251:0:19255:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63dc07800. 00000100:00100000:3.0:1787119530.543633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.543755:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633765248 00000100:00100000:0.0:1787119530.543766:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633765248 00000100:00100000:0.0:1787119530.543822:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19795 00000100:00100000:0.0:1787119530.543831:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633765248:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119530.543852:0:15690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119530.543887:0:15690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39600/0xcaba3de8463e4a40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471705b expref: -99 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.543956:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4a47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.543971:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.543982:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119530.544065:0:15690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119530.544070:0:15690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 47 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119530.544098:0:15690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.544127:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39600/0xcaba3de8463e4a40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471705b expref: 47 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.544151:0:15690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4a47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471705b expref: 46 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.544160:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaff00) 00010000:00010000:0.0:1787119530.544163:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119530.544178:0:15690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119530.544236:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:33946:x1873929633765248:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 406us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119530.544243:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19795 00000100:00100000:3.0:1787119530.548577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.548673:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633765504 00000100:00100000:2.0:1787119530.548685:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633765504 00000100:00100000:2.0:1787119530.548757:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19796 00000100:00100000:2.0:1787119530.548769:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+46:33946:x1873929633765504:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119530.548790:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119530.548794:0:12121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787119530.548825:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4a47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471705b expref: 46 pid: 15690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.548850:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aaff00) 00010000:00010000:2.0:1787119530.548869:0:12121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119530.548887:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4a4e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717062 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549040:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549062:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549072:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549085:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549093:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549100:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787119530.549633:0:12121:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c:0x0], index 1: 0 00010000:00010000:2.0:1787119530.549806:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549817:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549828:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549860:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549879:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549886:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549892:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119530.549898:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549905:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549916:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038b00) 00010000:00010000:2.0:1787119530.549919:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119530.549923:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549929:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6000/0xcaba3de8463e4a55 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787119530.549941:0:12121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cec1177 reply state 000000006af457e9 transno 4294976615 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119530.549950:0:12121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787119530.549981:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4a4e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717062 expref: 48 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.549998:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717062 expref: 47 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.550005:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a620038800) 00010000:00010000:2.0:1787119530.550007:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119530.550009:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e7800, rc 0) 00000100:00100000:2.0:1787119530.550080:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:33946:x1873929633765504:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1313us (1513us total) trans 4294976615 rc 0/0 00000100:00100000:2.0:1787119530.550089:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19796 00010000:00010000:0.0:1787119530.551891:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.551908:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.551915:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.551921:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119530.551926:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.551933:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.551948:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff92a620038300) 00010000:00010000:0.0:1787119530.551951:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119530.551955:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.551962:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6600/0xcaba3de8463e4a5c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119530.553930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.554706:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633765760 00000100:00100000:2.0:1787119530.554719:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633765760 00000100:00100000:2.0:1787119530.554824:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19797 00000100:00100000:2.0:1787119530.554833:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+47:33946:x1873929633765760:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1787119530.554903:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119530.554928:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717062 expref: 47 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.554954:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a620038800) 00010000:00010000:2.0:1787119530.554964:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119530.555213:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.555227:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.555236:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787119530.555283:0:15720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294976616 00000004:00010000:2.0:1787119530.555305:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f88790db reply state 00000000d61d8a29 transno 4294976617 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119530.555312:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119530.555396:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:33946:x1873929633765760:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 563us (1474us total) trans 4294976617 rc 0/0 00000100:00100000:2.0:1787119530.555403:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19797 00000020:00080000:2.0:1787119530.555408:0:15720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787119530.559421:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.559481:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.559490:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.559497:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e7400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119530.559502:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.559510:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.559528:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a620038a00) 00010000:00010000:1.0:1787119530.559531:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119530.559536:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119530.559542:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4a71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119530.561915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.562430:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633765888 00000100:00100000:0.0:1787119530.562467:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633765888 00000100:00100000:0.0:1787119530.562526:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19798 00000100:00100000:0.0:1787119530.562536:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+48:33946:x1873929633765888:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119530.562562:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119530.562586:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39600/0xcaba3de8463e4a78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717069 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.562649:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39600/0xcaba3de8463e4a78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717069 expref: 49 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.562664:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39600/0xcaba3de8463e4a78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717069 expref: 49 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.562685:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a609aafe00) 00010000:00010000:0.0:1787119530.562688:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787119530.562692:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39600, rc 0) 00000100:00100000:0.0:1787119530.562759:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:33946:x1873929633765888:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 225us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119530.562770:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19798 00000100:00100000:0.0:1787119530.565766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119530.566209:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633766016 00000100:00100000:3.0:1787119530.566219:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633766016 00000100:00100000:3.0:1787119530.566279:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5724 00000100:00100000:3.0:1787119530.566291:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:33946:x1873929633766016:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119530.566308:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119530.566331:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717070 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119530.566358:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787119530.566385:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=1056s v=(0 0) 00010000:00010000:3.0:1787119530.566391:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787119530.566400:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717070 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.566417:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717070 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.566462:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84c00, rc 0) 00000100:00100000:3.0:1787119530.566518:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:33946:x1873929633766016:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 230us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119530.566525:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5724 00000100:00080000:0.0:1787119530.567632:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119530.569718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.569802:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633766144 00000100:00100000:0.0:1787119530.569814:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633766144 00002000:00010000:0.0:1787119530.569879:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/44 (409600->18446744073709551615) 00002000:00100000:0.0:1787119530.569884:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25500 with x1873929633766144 ext(409600->18446744073709551615) 00002000:00010000:0.0:1787119530.569898:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25500. 00000100:00100000:0.0:1787119530.569935:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10776 00000100:00100000:0.0:1787119530.569956:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633766144:12345-192.168.201.59@tcp:10:mmap_sanity.0 00002000:00010000:0.0:1787119530.570276:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:0.0:1787119530.570280:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb mtime from disk: 0 -> 1787119529 00002000:00010000:0.0:1787119530.570283:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787119530.570285:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb ctime from disk: 0 -> 1787119529 00002000:00010000:0.0:1787119530.570287:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787119530.570356:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2375:x1873929633766144:12345-192.168.201.59@tcp:10:mmap_sanity.0 Request processed in 402us (648us total) trans 4294969276 rc 0/0 00000100:00100000:0.0:1787119530.570365:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10776 00002000:00010000:0.0:1787119530.570369:0:6700:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/44 (409600->18446744073709551615) 00002000:00100000:0.0:1787119530.570372:0:6700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25500 with x1873929633766144 ext(409600->18446744073709551615) 00002000:00010000:0.0:1787119530.570377:0:6700:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25500. 00000100:00100000:0.0:1787119530.578228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.578306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.578398:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633766272 00000100:00100000:1.0:1787119530.578407:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633766272 00002000:00100000:1.0:1787119530.578491:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (0->4095) req@ffff92a63414d880 x1873929633766272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.578502:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d880 with x1873929633766272 ext(0->4095) 00002000:00010000:1.0:1787119530.578508:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414d880 00000100:00100000:1.0:1787119530.578532:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10777 00000100:00100000:1.0:1787119530.578541:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633766272:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119530.579314:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633766272:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 769us (1091us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119530.579323:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10777 00002000:00100000:1.0:1787119530.579331:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (0->4095) req@ffff92a63414d880 x1873929633766272/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/4536 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.579342:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d880 with x1873929633766272 ext(0->4095) 00002000:00010000:1.0:1787119530.579345:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414d880 00000100:00100000:2.0:1787119530.583468:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633766400 00000100:00100000:2.0:1787119530.583483:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633766400 00000100:00100000:0.0:1787119530.583616:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19799 00000100:00100000:0.0:1787119530.583627:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+16:33961:x1873929633766400:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119530.583655:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119530.583679:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39200/0xcaba3de8463e4a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717077 expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.583766:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.583780:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.583791:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119530.584437:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787119530.584483:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 48 stripe count 1 MDT count 1 00000004:00010000:0.0:1787119530.584518:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.584549:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39200/0xcaba3de8463e4a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717077 expref: 18 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.584575:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717077 expref: 17 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.584584:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:0.0:1787119530.584588:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787119530.584591:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39400, rc 0) 00000100:00100000:0.0:1787119530.584668:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+17:33961:x1873929633766400:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1041us (6359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119530.584680:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19799 00000100:00100000:0.0:1787119530.587584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.587659:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633766528 00000100:00100000:1.0:1787119530.587669:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633766528 00002000:00100000:1.0:1787119530.587712:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2d:0x0] (4096->8191) req@ffff92a63414ca80 x1873929633766528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.587724:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ca80 with x1873929633766528 ext(4096->8191) 00002000:00010000:1.0:1787119530.587738:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414ca80 00000100:00100000:1.0:1787119530.587766:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10778 00000100:00100000:1.0:1787119530.587774:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633766528:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119530.588020:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633766528:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 246us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119530.588028:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10778 00002000:00100000:1.0:1787119530.588034:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2d:0x0] (4096->8191) req@ffff92a63414ca80 x1873929633766528/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/4536 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.588054:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414ca80 with x1873929633766528 ext(4096->8191) 00002000:00010000:1.0:1787119530.588058:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414ca80 00000100:00100000:2.0:1787119530.592975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.593075:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633766784 00000100:00100000:0.0:1787119530.593085:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633766784 00000100:00100000:0.0:1787119530.593146:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19800 00000100:00100000:0.0:1787119530.593154:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+17:33961:x1873929633766784:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119530.593174:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119530.593197:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39200/0xcaba3de8463e4a94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471707e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593266:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593280:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593292:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593306:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593313:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593319:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593436:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593483:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593490:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787119530.593500:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6e:0x0]: returning size 409600 00010000:00010000:0.0:1787119530.593593:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593601:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593608:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593614:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a510a38200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119530.593618:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593626:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593638:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:0.0:1787119530.593640:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119530.593644:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593650:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38200/0xcaba3de8463e4a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593668:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593674:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593680:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593684:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a510a38000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119530.593687:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593693:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593699:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff92a609aaf000) 00010000:00010000:0.0:1787119530.593701:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119530.593703:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593708:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38000/0xcaba3de8463e4aa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593982:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39200/0xcaba3de8463e4a94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471707e expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.593999:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471707e expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119530.594006:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a609aafe00) 00010000:00010000:0.0:1787119530.594009:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787119530.594012:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a38e00, rc 0) 00000100:00100000:0.0:1787119530.594157:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33961:x1873929633766784:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1002us (1190us total) trans 4294976618 rc 0/0 00000100:00100000:0.0:1787119530.594165:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19800 00000100:00100000:0.0:1787119530.599433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.599562:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633766912 00000100:00100000:1.0:1787119530.599574:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633766912 00002000:00100000:1.0:1787119530.599626:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2d:0x0] (8192->12287) req@ffff92a63414c700 x1873929633766912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.599637:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c700 with x1873929633766912 ext(8192->12287) 00002000:00010000:1.0:1787119530.599643:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414c700 00000100:00100000:1.0:1787119530.599677:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10779 00000100:00100000:1.0:1787119530.599687:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633766912:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119530.599948:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633766912:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 261us (525us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119530.599956:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10779 00002000:00100000:1.0:1787119530.599963:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2d:0x0] (8192->12287) req@ffff92a63414c700 x1873929633766912/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/4536 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.599970:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c700 with x1873929633766912 ext(8192->12287) 00002000:00010000:1.0:1787119530.599973:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414c700 00000100:00100000:3.0:1787119530.605490:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.605636:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633767168 00000100:00100000:2.0:1787119530.605648:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633767168 00000100:00100000:2.0:1787119530.605724:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19801 00000100:00100000:2.0:1787119530.605739:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33961:x1873929633767168:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119530.605764:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119530.605786:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4ab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717085 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.605884:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.605899:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.605909:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.605928:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.605936:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.605943:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606086:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606096:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606103:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119530.606113:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6d:0x0]: returning size 409600 00010000:00010000:2.0:1787119530.606214:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606222:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606229:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606236:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119530.606240:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606252:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606266:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:2.0:1787119530.606269:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119530.606274:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606280:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606293:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606299:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606305:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606310:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119530.606313:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606319:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606326:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff92a620038800) 00010000:00010000:2.0:1787119530.606329:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119530.606332:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606342:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4ac5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606382:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717085 expref: 22 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606396:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717085 expref: 21 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119530.606403:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a61bc19600) 00010000:00010000:2.0:1787119530.606406:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119530.606408:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e7600, rc 0) 00000100:00100000:2.0:1787119530.606810:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+21:33961:x1873929633767168:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1072us (1369us total) trans 4294976619 rc 0/0 00000100:00100000:2.0:1787119530.606818:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19801 00000100:00100000:2.0:1787119530.611123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.611167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.611337:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633767296 00000100:00100000:1.0:1787119530.611347:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633767296 00000100:00100000:1.0:1787119530.611417:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5725 00000100:00100000:1.0:1787119530.611427:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633767296:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119530.611473:0:12469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119530.611491:0:12469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ed8ff54/0xcaba3de8463e4ada lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471708c expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119530.611540:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653721856:192.168.201.59@tcp:106: 00000100:00100000:1.0:1787119530.611606:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a63e3cd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787119530.611658:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633767424 00000100:00100000:3.0:1787119530.611662:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633767424 00002000:00100000:3.0:1787119530.611691:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2d:0x0] (12288->69631) req@ffff92a5066dd880 x1873929633767424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119530.611697:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd880 with x1873929633767424 ext(12288->69631) 00002000:00010000:3.0:1787119530.611701:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dd880 00000100:00100000:3.0:1787119530.611720:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10780 00000100:00100000:3.0:1787119530.611731:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633767424:12345-192.168.201.59@tcp:3:kworker.0 00000100:00080000:0.0:1787119530.611966:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1787119530.616256:0:12469:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb atime: 0 -> 1787119529 00000100:00100000:3.0:1787119530.616287:0:12469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653721856:192.168.201.59@tcp:106: 00010000:00010000:3.0:1787119530.616328:0:12469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ed8ff54/0xcaba3de8463e4ada lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471708c expref: 59 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.616353:0:12469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ed8ff54/0xcaba3de8463e4ada lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471708c expref: 59 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.616366:0:12469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e69000, rc 0) 00000100:00100000:3.0:1787119530.616430:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633767296:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5002us (5314us total) trans 0 rc 301/301 00000100:00100000:3.0:1787119530.616471:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5725 00000100:00100000:3.0:1787119530.619605:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633767424:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7868us (8427us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1787119530.619620:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10780 00002000:00100000:3.0:1787119530.619633:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2d:0x0] (12288->69631) req@ffff92a5066dd880 x1873929633767424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119530.619645:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dd880 with x1873929633767424 ext(12288->69631) 00002000:00010000:3.0:1787119530.619651:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a5066dd880 00000100:00100000:0.0:1787119530.623132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119530.623276:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633767552 00000100:00100000:3.0:1787119530.623286:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633767552 00000100:00100000:3.0:1787119530.623348:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5726 00000100:00100000:3.0:1787119530.623359:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+58:33961:x1873929633767552:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119530.623375:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119530.623394:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa889273204717093 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.623426:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717070 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.623435:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787119530.623473:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787119530.623479:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 59 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.623517:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204717070 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.623542:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717070 expref: 11 pid: 6695 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119530.623557:0:8267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653721984:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119530.623641:0:8267:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119530.629036:0:8267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1873929653721984:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119530.629089:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 59 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.629111:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a642154600, rc 0) 00000100:00100000:3.0:1787119530.629180:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33961:x1873929633767552:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 5822us (6057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119530.629190:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5726 00000100:00100000:2.0:1787119530.630896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119530.631519:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633767680 00000100:00100000:3.0:1787119530.631529:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633767680 00010000:00010000:3.0:1787119530.631568:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717070 expref: 12 pid: 6695 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119530.631658:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5761 00000100:00100000:3.0:1787119530.631668:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+12:2376:x1873929633767680:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119530.631685:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119530.631708:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717070 expref: 12 pid: 6695 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.631747:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717070 expref: 12 pid: 6695 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.631770:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4c2f0a/0xcaba3de8463e4a7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717070 expref: 12 pid: 6695 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.631787:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787119530.631791:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787119530.631799:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.631809:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119530.632024:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119530.632041:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d25180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653722112:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119530.632165:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787119530.635235:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d25180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1873929653722112:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119530.635259:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119530.635321:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633767680:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3653us (4429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119530.635331:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5761 00000100:00100000:2.0:1787119530.636906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119530.637181:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633767808 00000100:00100000:3.0:1787119530.637190:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633767808 00002000:00100000:3.0:1787119530.637237:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2c:0x0] (0->4095) req@ffff92a5066dc000 x1873929633767808/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119530.637248:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633767808 ext(0->4095) 00002000:00010000:3.0:1787119530.637254:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dc000 00000100:00100000:3.0:1787119530.637294:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10781 00000100:00100000:3.0:1787119530.637304:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633767808:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119530.637569:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a5066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633767808:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 265us (670us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787119530.637577:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10781 00002000:00100000:3.0:1787119530.637585:0:19245:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2c:0x0] (0->4095) req@ffff92a5066dc000 x1873929633767808/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/4536 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119530.637593:0:19245:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a5066dc000 with x1873929633767808 ext(0->4095) 00002000:00010000:3.0:1787119530.637597:0:19245:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a5066dc000 00000100:00100000:2.0:1787119530.646696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.647686:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633767936 00000100:00100000:0.0:1787119530.647699:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633767936 00000100:00100000:2.0:1787119530.648028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00002000:00100000:0.0:1787119530.648239:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2d:0x0] (69632->106495) req@ffff92a512847b80 x1873929633767936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119530.648252:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847b80 with x1873929633767936 ext(69632->106495) 00002000:00010000:0.0:1787119530.648259:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512847b80 00000100:00100000:1.0:1787119530.648299:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633768064 00000100:00100000:1.0:1787119530.648303:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633768064 00002000:00100000:1.0:1787119530.648328:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2c:0x0] (4096->8191) req@ffff92a512844380 x1873929633768064/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.648337:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844380 with x1873929633768064 ext(4096->8191) 00002000:00010000:1.0:1787119530.648340:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844380 00000100:00100000:1.0:1787119530.648371:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10782 00000100:00100000:1.0:1787119530.648380:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633767936:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119530.648745:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10783 00000100:00100000:2.0:1787119530.648754:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633768064:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119530.648904:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633768064:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 150us (877us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787119530.648913:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10783 00002000:00100000:2.0:1787119530.648919:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (4096->8191) req@ffff92a512844380 x1873929633768064/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/4536 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119530.648924:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844380 with x1873929633768064 ext(4096->8191) 00002000:00010000:2.0:1787119530.648927:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844380 00000100:00100000:1.0:1787119530.651397:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633767936:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3006us (4699us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119530.651411:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10782 00002000:00100000:1.0:1787119530.651425:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2d:0x0] (69632->106495) req@ffff92a512847b80 x1873929633767936/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.651435:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512847b80 with x1873929633767936 ext(69632->106495) 00002000:00010000:1.0:1787119530.651461:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512847b80 00000100:00100000:3.0:1787119530.656237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.656356:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633768192 00000100:00100000:1.0:1787119530.656367:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633768192 00002000:00100000:1.0:1787119530.656418:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (8192->12287) req@ffff92a519d25180 x1873929633768192/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.656430:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25180 with x1873929633768192 ext(8192->12287) 00002000:00010000:1.0:1787119530.656435:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25180 00000100:00100000:1.0:1787119530.656498:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10784 00000100:00100000:1.0:1787119530.656508:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633768192:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119530.656804:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633768192:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 297us (576us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787119530.656812:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10784 00002000:00100000:1.0:1787119530.656820:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (8192->12287) req@ffff92a519d25180 x1873929633768192/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/4536 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.656829:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d25180 with x1873929633768192 ext(8192->12287) 00002000:00010000:1.0:1787119530.656832:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a519d25180 00000100:00100000:2.0:1787119530.662407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.662599:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633768320 00000100:00100000:1.0:1787119530.662611:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633768320 00002000:00100000:1.0:1787119530.662663:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (12288->69631) req@ffff92a512844a80 x1873929633768320/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.662674:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633768320 ext(12288->69631) 00002000:00010000:1.0:1787119530.662680:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844a80 00000100:00100000:1.0:1787119530.662759:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10785 00000100:00100000:1.0:1787119530.662770:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2374:x1873929633768320:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119530.666033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.667684:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633768448 00000100:00100000:0.0:1787119530.667701:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633768448 00002000:00100000:0.0:1787119530.667760:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2d:0x0] (106496->143359) req@ffff92a512844000 x1873929633768448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119530.667772:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633768448 ext(106496->143359) 00002000:00010000:0.0:1787119530.667778:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844000 00000100:00100000:0.0:1787119530.667815:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10786 00000100:00100000:0.0:1787119530.667835:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633768448:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119530.668686:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2374:x1873929633768320:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5915us (6288us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1787119530.668695:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10785 00002000:00100000:0.0:1787119530.668704:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (12288->69631) req@ffff92a512844a80 x1873929633768320/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119530.668720:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844a80 with x1873929633768320 ext(12288->69631) 00002000:00010000:0.0:1787119530.668724:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844a80 00000100:00100000:2.0:1787119530.674264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.674636:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633768448:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6810us (8610us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119530.674648:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10786 00002000:00100000:0.0:1787119530.674661:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2d:0x0] (106496->143359) req@ffff92a512844000 x1873929633768448/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119530.674671:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844000 with x1873929633768448 ext(106496->143359) 00002000:00010000:0.0:1787119530.674678:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844000 00000100:00100000:0.0:1787119530.674702:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633768576 00000100:00100000:0.0:1787119530.674709:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633768576 00002000:00100000:0.0:1787119530.674742:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2c:0x0] (69632->106495) req@ffff92a512846680 x1873929633768576/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119530.674751:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846680 with x1873929633768576 ext(69632->106495) 00002000:00010000:0.0:1787119530.674755:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846680 00000100:00100000:3.0:1787119530.675265:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10787 00000100:00100000:1.0:1787119530.675378:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633768576:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119530.679303:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633768576:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4020us (5053us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119530.679314:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10787 00002000:00100000:1.0:1787119530.679325:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2c:0x0] (69632->106495) req@ffff92a512846680 x1873929633768576/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.679333:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512846680 with x1873929633768576 ext(69632->106495) 00002000:00010000:1.0:1787119530.679337:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512846680 00000100:00100000:3.0:1787119530.681927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.682233:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633768704 00000100:00100000:2.0:1787119530.682243:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633768704 00002000:00100000:2.0:1787119530.682296:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2d:0x0] (143360->180223) req@ffff92a519d27100 x1873929633768704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119530.682307:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27100 with x1873929633768704 ext(143360->180223) 00002000:00010000:2.0:1787119530.682312:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d27100 00000100:00100000:2.0:1787119530.682382:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10788 00000100:00100000:2.0:1787119530.682391:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633768704:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119530.688934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119530.689029:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633768832 00000100:00100000:0.0:1787119530.689050:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633768832 00002000:00100000:0.0:1787119530.689107:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2c:0x0] (106496->143359) req@ffff92a512845c00 x1873929633768832/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119530.689185:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845c00 with x1873929633768832 ext(106496->143359) 00002000:00010000:0.0:1787119530.689191:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845c00 00000100:00100000:0.0:1787119530.689219:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10789 00000100:00100000:0.0:1787119530.689227:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633768832:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119530.691985:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633768704:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 9581us (10054us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119530.692000:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10788 00002000:00100000:2.0:1787119530.692013:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2d:0x0] (143360->180223) req@ffff92a519d27100 x1873929633768704/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119530.692023:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d27100 with x1873929633768704 ext(143360->180223) 00002000:00010000:2.0:1787119530.692031:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d27100 00000100:00100000:0.0:1787119530.692568:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633768832:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3340us (3645us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119530.692576:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10789 00002000:00100000:0.0:1787119530.692582:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2c:0x0] (106496->143359) req@ffff92a512845c00 x1873929633768832/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119530.692591:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512845c00 with x1873929633768832 ext(106496->143359) 00002000:00010000:0.0:1787119530.692595:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512845c00 00000100:00100000:0.0:1787119530.700419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119530.700554:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633768960 00000100:00100000:2.0:1787119530.700563:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633768960 00002000:00100000:2.0:1787119530.700614:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2c:0x0] (143360->180223) req@ffff92a63414d500 x1873929633768960/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119530.700624:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d500 with x1873929633768960 ext(143360->180223) 00002000:00010000:2.0:1787119530.700630:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414d500 00000100:00100000:2.0:1787119530.700662:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10790 00000100:00100000:2.0:1787119530.700671:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633768960:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119530.703183:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633768960:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2499us (2760us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119530.703200:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10790 00002000:00100000:0.0:1787119530.703214:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2c:0x0] (143360->180223) req@ffff92a63414d500 x1873929633768960/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119530.703223:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414d500 with x1873929633768960 ext(143360->180223) 00002000:00010000:0.0:1787119530.703229:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414d500 00000100:00100000:2.0:1787119530.707423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.707560:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633769088 00000100:00100000:1.0:1787119530.707570:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633769088 00002000:00100000:1.0:1787119530.707632:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2d:0x0] (180224->217087) req@ffff92a512844700 x1873929633769088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.707644:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844700 with x1873929633769088 ext(180224->217087) 00002000:00010000:1.0:1787119530.707650:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844700 00000100:00100000:1.0:1787119530.707675:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10791 00000100:00100000:1.0:1787119530.707685:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633769088:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119530.709490:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633769088:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 1797us (2068us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119530.709502:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10791 00002000:00100000:1.0:1787119530.709513:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2d:0x0] (180224->217087) req@ffff92a512844700 x1873929633769088/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.709525:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844700 with x1873929633769088 ext(180224->217087) 00002000:00010000:1.0:1787119530.709531:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a512844700 00000100:00100000:2.0:1787119530.712161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119530.712286:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633769216 00000100:00100000:1.0:1787119530.712296:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633769216 00002000:00100000:1.0:1787119530.712336:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (180224->217087) req@ffff92a512844e00 x1873929633769216/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/0 e 0 to 0 dl 1787119541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.712344:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844e00 with x1873929633769216 ext(180224->217087) 00002000:00010000:1.0:1787119530.712348:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844e00 00000100:00100000:1.0:1787119530.712373:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10792 00000100:00100000:1.0:1787119530.712379:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633769216:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119530.714920:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633769216:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2528us (2754us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119530.714934:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10792 00002000:00100000:1.0:1787119530.714945:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (180224->217087) req@ffff92a512844e00 x1873929633769216/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:566/0 lens 488/440 e 0 to 0 dl 1787119541 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119530.714956:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a512844e00 with x1873929633769216 ext(180224->217087) 00002000:00010000:1.0:1787119530.714962:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a512844e00 00010000:00010000:2.0:1787119530.983110:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119531.925565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119531.926077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119531.926114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119531.926267:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633769856 00000100:00100000:2.0:1787119531.926276:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633769856 00000100:00100000:2.0:1787119531.926329:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 711 00000100:00100000:2.0:1787119531.926339:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2375:x1873929633769856:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119531.926425:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+21:2375:x1873929633769856:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 87us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119531.926461:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 711 00000100:00100000:0.0:1787119531.926729:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119531.926886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119531.926912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119531.926934:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633769600 00000100:00100000:0.0:1787119531.926938:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633769600 00000100:00100000:0.0:1787119531.926970:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633770112 00000100:00100000:0.0:1787119531.926973:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633770112 00000100:00100000:0.0:1787119531.926989:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633769728 00000100:00100000:0.0:1787119531.926991:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633769728 00000100:00100000:0.0:1787119531.927010:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 602 00000100:00100000:0.0:1787119531.927017:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633769600:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119531.927050:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633769600:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 33us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119531.927057:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 602 00000100:00100000:0.0:1787119531.927071:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 603 00000100:00100000:0.0:1787119531.927078:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633770112:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119531.927101:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633770112:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119531.927106:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 603 00000100:00100000:0.0:1787119531.927118:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 604 00000100:00100000:0.0:1787119531.927123:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633769728:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119531.927349:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633769344 00000100:00100000:3.0:1787119531.927354:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633769344 00000100:00100000:3.0:1787119531.927397:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 528 00000100:00100000:3.0:1787119531.927404:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633769344:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119531.927473:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2375:x1873929633769728:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 348us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119531.927480:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 604 00000100:00100000:1.0:1787119531.928111:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633769472 00000100:00100000:1.0:1787119531.928118:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633769472 00000100:00100000:1.0:1787119531.928167:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 712 00000100:00100000:1.0:1787119531.928175:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:2375:x1873929633769472:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119531.932610:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633769344:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 5183us (7033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119531.932626:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 528 00000100:00100000:0.0:1787119531.935954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119531.936402:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+49:2375:x1873929633769472:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 8223us (9645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119531.936418:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 712 00000100:00100000:3.0:1787119531.937936:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633769984 00000100:00100000:3.0:1787119531.937949:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633769984 00000100:00100000:3.0:1787119531.938387:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 605 00000100:00100000:3.0:1787119531.938400:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633769984:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119531.938534:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+7:2375:x1873929633769984:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 137us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119531.938542:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 605 00000100:00080000:0.0:1787119531.940610:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787119532.001782:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119532.717912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119532.717997:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633770240 00000100:00100000:1.0:1787119532.718007:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633770240 00002000:00100000:1.0:1787119532.718073:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (217088->253951) req@ffff92a63414fb80 x1873929633770240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.718090:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414fb80 with x1873929633770240 ext(217088->253951) 00002000:00010000:1.0:1787119532.718096:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414fb80 00000100:00100000:1.0:1787119532.718132:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10793 00000100:00100000:1.0:1787119532.718142:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633770240:12345-192.168.201.59@tcp:3:kworker.0 00000100:00080000:3.0:1787119532.718519:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119532.728490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119532.733423:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633770368 00000100:00100000:2.0:1787119532.733454:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633770368 00002000:00100000:2.0:1787119532.733534:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2c:0x0] (217088->253951) req@ffff92a62a127800 x1873929633770368/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119532.733546:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127800 with x1873929633770368 ext(217088->253951) 00002000:00010000:2.0:1787119532.733554:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127800 00000100:00100000:2.0:1787119532.733586:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10794 00000100:00100000:2.0:1787119532.733598:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633770368:12345-192.168.201.59@tcp:3:kworker.0 00000100:00080000:1.0:1787119532.734078:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119532.739599:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2374:x1873929633770240:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 21447us (21684us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119532.739612:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10793 00002000:00100000:3.0:1787119532.739624:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (217088->253951) req@ffff92a63414fb80 x1873929633770240/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119532.739635:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414fb80 with x1873929633770240 ext(217088->253951) 00002000:00010000:3.0:1787119532.739641:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414fb80 00000100:00100000:0.0:1787119532.743498:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633770368:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 9894us (15007us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119532.743512:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10794 00002000:00100000:0.0:1787119532.743525:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2c:0x0] (217088->253951) req@ffff92a62a127800 x1873929633770368/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119532.743543:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62a127800 with x1873929633770368 ext(217088->253951) 00002000:00010000:0.0:1787119532.743548:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62a127800 00000100:00100000:3.0:1787119532.746879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119532.759765:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633770496 00000100:00100000:1.0:1787119532.759779:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633770496 00002000:00100000:1.0:1787119532.759842:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2d:0x0] (253952->290815) req@ffff92a519d26680 x1873929633770496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.759854:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26680 with x1873929633770496 ext(253952->290815) 00002000:00010000:1.0:1787119532.759860:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d26680 00000100:00100000:1.0:1787119532.759889:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10795 00000100:00100000:1.0:1787119532.759899:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633770496:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119532.763637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119532.763857:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633770624 00000100:00100000:2.0:1787119532.763866:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633770624 00002000:00100000:2.0:1787119532.763914:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (253952->290815) req@ffff92a606159c00 x1873929633770624/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119532.763925:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159c00 with x1873929633770624 ext(253952->290815) 00002000:00010000:2.0:1787119532.763930:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606159c00 00000100:00100000:2.0:1787119532.763959:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10796 00000100:00100000:2.0:1787119532.763969:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633770624:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119532.765461:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633770496:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5542us (18571us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119532.765473:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10795 00002000:00100000:1.0:1787119532.765483:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2d:0x0] (253952->290815) req@ffff92a519d26680 x1873929633770496/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.765495:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a519d26680 with x1873929633770496 ext(253952->290815) 00002000:00010000:1.0:1787119532.765500:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a519d26680 00000100:00100000:1.0:1787119532.766178:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633770624:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 2206us (2546us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119532.766188:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10796 00002000:00100000:1.0:1787119532.766195:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2c:0x0] (253952->290815) req@ffff92a606159c00 x1873929633770624/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.766205:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a606159c00 with x1873929633770624 ext(253952->290815) 00002000:00010000:1.0:1787119532.766210:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a606159c00 00000100:00100000:0.0:1787119532.772099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119532.772273:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633770752 00000100:00100000:2.0:1787119532.772284:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633770752 00002000:00100000:2.0:1787119532.772331:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2d:0x0] (290816->327679) req@ffff92a63414e680 x1873929633770752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119532.772342:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414e680 with x1873929633770752 ext(290816->327679) 00002000:00010000:2.0:1787119532.772347:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414e680 00000100:00100000:2.0:1787119532.772374:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10797 00000100:00100000:2.0:1787119532.772382:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633770752:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119532.774329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119532.774467:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633770880 00000100:00100000:3.0:1787119532.774476:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633770880 00002000:00100000:3.0:1787119532.774519:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2c:0x0] (290816->327679) req@ffff92a511632a00 x1873929633770880/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119532.774530:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633770880 ext(290816->327679) 00002000:00010000:3.0:1787119532.774536:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511632a00 00000100:00100000:3.0:1787119532.774566:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10798 00000100:00100000:3.0:1787119532.774575:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2373:x1873929633770880:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119532.777104:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2373:x1873929633770752:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4714us (5007us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119532.777118:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10797 00002000:00100000:2.0:1787119532.777130:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2d:0x0] (290816->327679) req@ffff92a63414e680 x1873929633770752/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119532.777141:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414e680 with x1873929633770752 ext(290816->327679) 00002000:00010000:2.0:1787119532.777146:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414e680 00000001:00080000:2.0:1787119532.781376:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969276 is committed 00000001:00080000:2.0:1787119532.781406:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969274 is committed 00000100:00100000:1.0:1787119532.783041:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2373:x1873929633770880:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 8455us (8709us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119532.783057:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10798 00002000:00100000:1.0:1787119532.783070:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2c:0x0] (290816->327679) req@ffff92a511632a00 x1873929633770880/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.783081:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632a00 with x1873929633770880 ext(290816->327679) 00002000:00010000:1.0:1787119532.783088:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511632a00 00000100:00100000:3.0:1787119532.792262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119532.793718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119532.793793:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633771136 00000100:00100000:3.0:1787119532.793802:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633771136 00002000:00100000:3.0:1787119532.793861:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2c:0x0] (327680->364543) req@ffff92a60615ad80 x1873929633771136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119532.793872:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615ad80 with x1873929633771136 ext(327680->364543) 00002000:00010000:3.0:1787119532.793877:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615ad80 00000100:00100000:3.0:1787119532.793899:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633771008 00000100:00100000:3.0:1787119532.793901:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633771008 00002000:00100000:3.0:1787119532.793918:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2d:0x0] (327680->364543) req@ffff92a511633480 x1873929633771008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119532.793926:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633480 with x1873929633771008 ext(327680->364543) 00002000:00010000:3.0:1787119532.793929:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633480 00000100:00100000:3.0:1787119532.793955:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10799 00000100:00100000:3.0:1787119532.793964:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2376:x1873929633771136:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119532.794245:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10800 00000100:00100000:1.0:1787119532.794255:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633771008:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119532.800034:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2376:x1873929633771136:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6059us (7770us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119532.800047:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10799 00002000:00100000:3.0:1787119532.800061:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2c:0x0] (327680->364543) req@ffff92a60615ad80 x1873929633771136/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119532.800076:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a60615ad80 with x1873929633771136 ext(327680->364543) 00002000:00010000:3.0:1787119532.800082:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a60615ad80 00000100:00100000:1.0:1787119532.800674:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633771008:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6418us (6959us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119532.800683:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10800 00002000:00100000:1.0:1787119532.800699:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2d:0x0] (327680->364543) req@ffff92a511633480 x1873929633771008/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.800708:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511633480 with x1873929633771008 ext(327680->364543) 00002000:00010000:1.0:1787119532.800713:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511633480 00000100:00100000:0.0:1787119532.809115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119532.813084:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633771264 00000100:00100000:3.0:1787119532.813102:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633771264 00002000:00100000:3.0:1787119532.813170:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2c:0x0] (364544->401407) req@ffff92a63414c380 x1873929633771264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119532.813183:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c380 with x1873929633771264 ext(364544->401407) 00002000:00010000:3.0:1787119532.813189:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414c380 00000100:00100000:3.0:1787119532.813230:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10801 00000100:00100000:3.0:1787119532.813240:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2373:x1873929633771264:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119532.816752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119532.816851:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633771392 00000100:00100000:0.0:1787119532.816861:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633771392 00002000:00100000:0.0:1787119532.816910:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2d:0x0] (364544->401407) req@ffff92a511631500 x1873929633771392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119532.816921:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633771392 ext(364544->401407) 00002000:00010000:0.0:1787119532.816928:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511631500 00000100:00100000:0.0:1787119532.816964:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10802 00000100:00100000:0.0:1787119532.816975:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633771392:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119532.823727:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2375:x1873929633771392:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6743us (6975us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119532.823741:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10802 00002000:00100000:0.0:1787119532.823754:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2d:0x0] (364544->401407) req@ffff92a511631500 x1873929633771392/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119532.823765:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631500 with x1873929633771392 ext(364544->401407) 00002000:00010000:0.0:1787119532.823771:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511631500 00000100:00100000:3.0:1787119532.823960:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2373:x1873929633771264:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 10721us (14854us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1787119532.823969:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10801 00002000:00100000:3.0:1787119532.823974:0:19246:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2c:0x0] (364544->401407) req@ffff92a63414c380 x1873929633771264/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/440 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119532.823982:0:19246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414c380 with x1873929633771264 ext(364544->401407) 00002000:00010000:3.0:1787119532.823986:0:19246:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414c380 00000100:00100000:2.0:1787119532.836331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119532.836500:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633771520 00000100:00100000:1.0:1787119532.836510:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633771520 00002000:00100000:1.0:1787119532.836565:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (401408->409599) req@ffff92a511630000 x1873929633771520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.836576:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630000 with x1873929633771520 ext(401408->409599) 00002000:00010000:1.0:1787119532.836582:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511630000 00000100:00100000:1.0:1787119532.836619:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10803 00000100:00100000:1.0:1787119532.836629:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2374:x1873929633771520:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119532.836915:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2374:x1873929633771520:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 287us (593us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1787119532.836922:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10803 00002000:00100000:1.0:1787119532.836929:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (401408->409599) req@ffff92a511630000 x1873929633771520/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/8632 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.836937:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511630000 with x1873929633771520 ext(401408->409599) 00002000:00010000:1.0:1787119532.836940:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a511630000 00000100:00100000:2.0:1787119532.841235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119532.841499:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633771648 00000100:00100000:1.0:1787119532.841511:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633771648 00002000:00100000:1.0:1787119532.841564:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2d:0x0] (401408->409599) req@ffff92a511631880 x1873929633771648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.841575:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631880 with x1873929633771648 ext(401408->409599) 00002000:00010000:1.0:1787119532.841581:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511631880 00000100:00100000:1.0:1787119532.841615:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10804 00000100:00100000:1.0:1787119532.841625:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633771648:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119532.841923:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633771648:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 299us (702us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1787119532.841934:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10804 00002000:00100000:1.0:1787119532.841940:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2d:0x0] (401408->409599) req@ffff92a511631880 x1873929633771648/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/8632 e 0 to 0 dl 1787119543 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.841948:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511631880 with x1873929633771648 ext(401408->409599) 00002000:00010000:1.0:1787119532.841951:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511631880 00000100:00100000:3.0:1787119532.849909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119532.850152:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633771776 00000100:00100000:0.0:1787119532.850173:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633771776 00000100:00100000:0.0:1787119532.850249:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5727 00000100:00100000:0.0:1787119532.850259:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+7:33961:x1873929633771776:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119532.850277:0:20841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119532.850298:0:20841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa88927320471709a expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119532.850329:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119532.850337:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787119532.850341:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787119532.850346:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 8 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119532.850379:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119532.850407:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 8 pid: 6693 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119532.850423:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20841:1873929653722240:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119532.850539:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5071af180 going to sleep for 11 seconds 00000100:00100000:0.0:1787119532.863766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119532.864078:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20841:1873929653722240:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119532.864112:0:20841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 8 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119532.864134:0:20841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a510a39200, rc 0) 00000100:00100000:1.0:1787119532.864383:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633771904 00000100:00100000:1.0:1787119532.864390:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633771904 00000100:00100000:1.0:1787119532.864495:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5728 00000100:00100000:1.0:1787119532.864504:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:33946:x1873929633771904:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1787119532.864517:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787119532.864534:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047170a1 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.864556:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 56 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.864564:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2c:0x0].0x0 since=2s v=(1 0) 00010000:00010000:1.0:1787119532.864568:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787119532.864573:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.864600:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 56 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.864611:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 56 pid: 8267 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119532.864626:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653722368:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119532.864703:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+8:33961:x1873929633771776:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 14446us (14805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119532.864710:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5727 00000100:00080000:0.0:1787119532.864874:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119532.870719:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60133ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119532.873040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119532.873381:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633772032 00000100:00100000:0.0:1787119532.873393:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633772032 00002000:00100000:0.0:1787119532.873474:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x2d:0x0] (0->409599) req@ffff92a511632680 x1873929633772032/t0(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119532.873492:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632680 with x1873929633772032 ext(0->409599) 00010000:00010000:0.0:1787119532.873502:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 9 pid: 6693 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119532.873531:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 9 pid: 6693 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119532.873540:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92a511632680 00000100:00100000:0.0:1787119532.873581:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1460 00000100:00100000:0.0:1787119532.873591:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+9:2376:x1873929633772032:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1787119532.883506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119532.883646:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1873929653722368:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119532.883683:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.883714:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e69200, rc 0) 00000100:00100000:1.0:1787119532.883779:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:33946:x1873929633771904:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 19275us (20022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119532.883788:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5728 00000100:00100000:3.0:1787119532.885767:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633772160 00000100:00100000:3.0:1787119532.885787:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633772160 00002000:00100000:3.0:1787119532.885853:0:6701:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2c:0x0] (0->409599) req@ffff92a634966300 x1873929633772160/t0(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/0 e 0 to 0 dl 1787119543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1787119532.885864:0:6701:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966300 with x1873929633772160 ext(0->409599) 00010000:00010000:3.0:1787119532.885874:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 57 pid: 8267 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119532.885907:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 57 pid: 8267 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119532.885915:0:6701:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634966300 00000100:00100000:3.0:1787119532.890413:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 1461 00000100:00100000:3.0:1787119532.890434:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2376:x1873929633772160:12345-192.168.201.59@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1787119532.911942:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633772032:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 38336us (38898us total) trans 4294968933 rc 0/0 00000100:00100000:1.0:1787119532.911959:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1460 00002000:00100000:1.0:1787119532.911975:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x2d:0x0] (0->409599) req@ffff92a511632680 x1873929633772032/t4294968933(0) o4->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:568/0 lens 488/448 e 0 to 0 dl 1787119543 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119532.911988:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511632680 with x1873929633772032 ext(0->409599) 00010000:00010000:1.0:1787119532.912002:0:19242:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 11 pid: 6693 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.912045:0:19242:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 11 pid: 6693 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787119532.912055:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92a511632680 00000100:00100000:2.0:1787119532.925855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119532.925932:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633772288 00000100:00100000:1.0:1787119532.925942:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633772288 00010000:00010000:1.0:1787119532.925991:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 11 pid: 6693 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119532.926141:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5762 00000100:00100000:1.0:1787119532.926152:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:2376:x1873929633772288:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119532.926168:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787119532.926188:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb mtime from disk: 1787119529 -> 1787119531 00002000:00010000:1.0:1787119532.926192:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb ctime from disk: 1787119529 -> 1787119531 00010000:00010000:1.0:1787119532.926315:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 11 pid: 6693 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.926329:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 11 pid: 6693 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.926353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006422bec0/0xcaba3de8463e4a39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717054 expref: 11 pid: 6693 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.926370:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787119532.926375:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787119532.926383:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.926396:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.926479:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119532.926494:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5833:1873929653722496:192.168.201.59@tcp:105: 00000100:00100000:1.0:1787119532.926621:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60133ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119532.926937:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633772160:12345-192.168.201.59@tcp:4:ldlm_bl.0 Request processed in 36508us (43441us total) trans 4294969277 rc 0/0 00000100:00100000:0.0:1787119532.926947:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 1461 00002000:00100000:0.0:1787119532.926957:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2c:0x0] (0->409599) req@ffff92a634966300 x1873929633772160/t4294969277(0) o4->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:568/0 lens 488/448 e 0 to 0 dl 1787119543 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119532.926968:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634966300 with x1873929633772160 ext(0->409599) 00010000:00010000:0.0:1787119532.926986:0:18579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 59 pid: 8267 timeout: 1158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119532.927024:0:18579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 59 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787119532.927037:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92a634966300 00000100:00100000:3.0:1787119532.933632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119532.933745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119532.933917:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5833:1873929653722496:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119532.933946:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119532.934222:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633772416 00000100:00100000:1.0:1787119532.934230:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633772416 00010000:00010000:1.0:1787119532.934264:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 59 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119532.934299:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5763 00000100:00100000:1.0:1787119532.934308:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633772416:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119532.934323:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787119532.934344:0:20609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb mtime from disk: 1787119529 -> 1787119531 00002000:00010000:1.0:1787119532.934347:0:20609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb ctime from disk: 1787119529 -> 1787119531 00002000:00010000:1.0:1787119532.934350:0:20609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb blocks from disk: 1 -> 3 00010000:00010000:1.0:1787119532.934357:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 59 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.934383:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 59 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.934409:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ef39fda/0xcaba3de8463e4ae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa889273204717093 expref: 59 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.934432:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=1s v=(2 0) 00010000:00010000:1.0:1787119532.934435:0:20609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787119532.934479:0:20609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.934490:0:20609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119532.934527:0:20609:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119532.934541:0:20609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653722624:192.168.201.59@tcp:105: 00000100:00100000:0.0:1787119532.934926:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:2376:x1873929633772288:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8772us (9078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119532.934935:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5762 00000100:00100000:2.0:1787119532.935187:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633772544 00000100:00100000:2.0:1787119532.935201:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633772544 00000100:00100000:2.0:1787119532.935246:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5729 00000100:00100000:2.0:1787119532.935254:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+59:33961:x1873929633772544:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119532.935268:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119532.935282:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d244a24/0xcaba3de8463e4af6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047170a8 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119532.935308:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119532.935315:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2c:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1787119532.935319:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1787119532.935323:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d244a24/0xcaba3de8463e4af6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a8 expref: 60 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119532.935347:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119532.935366:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 6 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119532.935377:0:6695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653722752:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119532.935428:0:6695:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506ef3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787119532.941879:0:20609:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a60133ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787119532.942807:0:6695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1873929653722752:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119532.942854:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d244a24/0xcaba3de8463e4af6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a8 expref: 60 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119532.942875:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e6000, rc 0) 00000100:00100000:0.0:1787119532.942921:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+60:33961:x1873929633772544:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7667us (9174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119532.942930:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5729 00000100:00100000:2.0:1787119532.946890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119532.947056:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633772672 00000100:00100000:3.0:1787119532.947066:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633772672 00000100:00100000:3.0:1787119532.947123:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5730 00000100:00100000:3.0:1787119532.947132:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+10:33946:x1873929633772672:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1787119532.947150:0:20843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787119532.947171:0:20843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000567df3e5/0xcaba3de8463e4afd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047170af expref: -99 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119532.947215:0:20843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119532.947224:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787119532.947228:0:20843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787119532.947233:0:20843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000567df3e5/0xcaba3de8463e4afd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170af expref: 11 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119532.947269:0:20843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 7 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119532.947280:0:20843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 7 pid: 20841 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119532.947296:0:20843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606158000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20843:1873929653722880:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119532.947460:0:20609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:20609:1873929653722624:192.168.201.59@tcp:105: 00010000:00010000:1.0:1787119532.947480:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119532.947655:0:20843:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a5054e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787119532.947838:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2375:x1873929633772416:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 13528us (14213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119532.947848:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5763 00000100:00100000:3.0:1787119532.950592:0:20843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606158000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20843:1873929653722880:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119532.950626:0:20843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000567df3e5/0xcaba3de8463e4afd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170af expref: 11 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119532.950649:0:20843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a519d84800, rc 0) 00000100:00100000:2.0:1787119532.950864:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+11:33946:x1873929633772672:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3732us (3982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119532.950873:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5730 00010000:00010000:2.0:1787119533.027375:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787119533.304611:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976618 is committed 00000001:00080000:1.0:1787119533.304627:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976611 is committed 00000004:00080000:1.0:1787119533.304631:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 23 committed 00000100:00100000:3.0:1787119533.304803:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653723008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787119533.304893:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119533.304966:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653723008 00000100:00100000:0.0:1787119533.304975:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653723008 00000100:00100000:0.0:1787119533.305030:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5731 00000100:00100000:0.0:1787119533.305038:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653723008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787119533.305062:0:20841:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:43 count 1 00010000:00010000:0.0:1787119533.305083:0:20841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305109:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305135:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 58 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305144:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 58 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305151:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305159:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305167:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305175:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305183:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305192:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047161dd expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305206:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305215:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119533.305223:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976619 is committed 00010000:00010000:0.0:1787119533.305224:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787119533.305232:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976617 is committed 00010000:00010000:0.0:1787119533.305238:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305247:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305257:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305265:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305275:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305288:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305297:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305305:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305313:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305321:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305330:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305338:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305346:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305359:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305367:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305375:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305383:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305395:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305403:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305411:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305420:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305434:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305776:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305785:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305793:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305800:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305807:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305823:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305832:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305846:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305853:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305861:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305870:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305877:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305885:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305892:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305899:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305913:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 58 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305921:0:20841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305929:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 51 to [0x280000400:0x2b:0x0].0x0 since=4s v=(202 262) 00010000:00010000:0.0:1787119533.305933:0:20841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 202) 00010000:00010000:0.0:1787119533.305938:0:20841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 54/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305969:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.305981:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.305992:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634967b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723136:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.306079:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 58 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.306089:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 58 pid: 20841 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.306105:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634967100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723264:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.306849:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.306863:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.306874:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634965180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723392:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.306906:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.306916:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.306925:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723520:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.306952:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.306961:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.306970:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723648:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.306999:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.307008:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 58 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.307017:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634966a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723776:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.307043:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.307051:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.307060:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723904:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.307086:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.307095:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 58 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.307104:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724032:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.310783:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.310811:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.310837:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634149180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724160:192.168.201.59@tcp:104: 00000100:00080000:2.0:1787119533.310975:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787119533.313977:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.314000:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.314018:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724288:192.168.201.59@tcp:104: 00000001:00080000:1.0:1787119533.314805:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968933 is committed 00000100:00100000:2.0:1787119533.319521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119533.319569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119533.319599:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633772800 00000100:00100000:2.0:1787119533.319608:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633772800 00010000:00010000:2.0:1787119533.319646:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 59 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.319699:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633772928 00000100:00100000:2.0:1787119533.319703:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633772928 00010000:00010000:2.0:1787119533.319717:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 60 pid: 20841 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119533.319727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5764 00000100:00100000:1.0:1787119533.319742:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+60:2375:x1873929633772800:12345-192.168.201.59@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787119533.319750:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5765 00000100:00100000:2.0:1787119533.319760:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+60:2375:x1873929633772928:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.319760:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.319771:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 60 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.319772:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119533.319782:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 60 pid: 20841 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.319792:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 60 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.324097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.324473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.324502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.324562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119533.324573:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 60 pid: 20841 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.324610:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119533.326685:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119533.326807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119533.326853:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+60:2375:x1873929633772928:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 7092us (7280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119533.326866:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5765 00010000:00010000:0.0:1787119533.326886:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 59 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.326899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633773184 00010000:00010000:0.0:1787119533.326904:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 59 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.326908:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633773184 00000100:00100000:0.0:1787119533.326924:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724416:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.326937:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 60 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.326956:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633773056 00000100:00100000:2.0:1787119533.326960:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633773056 00000100:00100000:3.0:1787119533.327090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.327124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.327164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:2.0:1787119533.327172:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 61 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.327195:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633773312 00000100:00100000:2.0:1787119533.327196:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633773568 00000100:00100000:3.0:1787119533.327201:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633773312 00000100:00100000:2.0:1787119533.327202:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633773568 00010000:00010000:3.0:1787119533.327224:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 63 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.327226:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 63 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.327258:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633773440 00000100:00100000:2.0:1787119533.327258:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633773696 00000100:00100000:3.0:1787119533.327264:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633773440 00000100:00100000:2.0:1787119533.327264:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633773696 00010000:00010000:3.0:1787119533.327287:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 65 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.327288:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 65 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.327317:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633773824 00000100:00100000:2.0:1787119533.327320:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633773952 00000100:00100000:3.0:1787119533.327322:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633773824 00000100:00100000:2.0:1787119533.327325:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633773952 00010000:00010000:3.0:1787119533.327340:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 67 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.327346:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 67 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.327365:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5766 00000100:00100000:2.0:1787119533.327379:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5767 00000100:00100000:3.0:1787119533.327385:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+67:2376:x1873929633773184:12345-192.168.201.59@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787119533.327393:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+67:2376:x1873929633773056:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119533.327399:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119533.327403:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119533.327407:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 67 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.327413:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 67 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.327428:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 67 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.327538:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 55 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 67 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119533.327888:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+67:2375:x1873929633772800:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 8148us (8373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.327897:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5764 00000100:00100000:1.0:1787119533.327944:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5768 00000100:00100000:1.0:1787119533.327951:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+66:2376:x1873929633773312:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.327958:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.327963:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 66 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328046:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119533.328066:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+66:2376:x1873929633773184:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 693us (3979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119533.328073:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5766 00000100:00100000:3.0:1787119533.328085:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5769 00000100:00100000:3.0:1787119533.328091:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+65:2375:x1873929633773568:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119533.328098:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119533.328103:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 65 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328112:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 65 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328136:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119533.328151:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+65:2375:x1873929633773568:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 60us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119533.328157:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5769 00000100:00100000:3.0:1787119533.328169:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5770 00000100:00100000:3.0:1787119533.328174:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+64:2375:x1873929633773440:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119533.328180:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119533.328185:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 64 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328195:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 64 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328205:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119533.328217:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+64:2375:x1873929633773440:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 44us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119533.328223:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5770 00000100:00100000:3.0:1787119533.328235:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5771 00000100:00100000:3.0:1787119533.328241:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+63:2375:x1873929633773696:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119533.328247:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119533.328250:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 63 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328260:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 63 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328269:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119533.328280:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+63:2375:x1873929633773696:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 40us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119533.328285:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5771 00000100:00100000:3.0:1787119533.328294:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5772 00000100:00100000:3.0:1787119533.328299:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+62:2375:x1873929633773824:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119533.328305:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119533.328309:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 62 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328318:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 62 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328328:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119533.328339:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+62:2375:x1873929633773824:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 41us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119533.328345:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5772 00000100:00100000:3.0:1787119533.328354:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5773 00000100:00100000:3.0:1787119533.328360:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+61:2375:x1873929633773952:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119533.328366:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119533.328370:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 61 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328379:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 56 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 61 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.328389:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119533.328400:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+61:2375:x1873929633773952:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 40us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119533.328405:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5773 00010000:00010000:2.0:1787119533.328536:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119533.328562:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+60:2376:x1873929633773056:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 1173us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119533.328569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5767 00010000:00010000:0.0:1787119533.328811:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 59 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.328840:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 59 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.328859:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724544:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119533.329921:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 54 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 59 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.329947:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.329992:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633773312:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2042us (5489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.330000:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5768 00010000:00010000:0.0:1787119533.330484:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.330497:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.330510:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724672:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.330556:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.330565:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.330830:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724800:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.330865:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.330875:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.330884:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724928:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.330916:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.330924:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.330933:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725056:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.330957:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.330965:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.330974:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725184:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331025:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331034:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331043:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725312:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331067:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331082:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331090:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725440:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331113:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331179:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331189:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634149500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725568:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331211:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331220:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331227:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725696:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331242:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331250:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331264:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725824:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331281:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331289:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331297:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725952:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331315:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331323:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331331:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506156a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726080:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331346:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331355:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331363:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506156680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726208:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331380:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331389:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331397:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506155880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726336:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331433:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331672:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331682:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506154700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726464:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331715:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331725:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331733:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506157480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726592:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331762:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331778:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331786:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506155180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726720:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331804:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331812:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331831:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506155c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726848:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331853:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331862:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331871:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506155500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726976:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331887:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331895:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331910:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727104:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331941:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331949:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331957:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506157800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727232:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.331973:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.331981:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.331989:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506154380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727360:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332003:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332011:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332019:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727488:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332037:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332045:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332053:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727616:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332069:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332077:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332085:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506156300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727744:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332102:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332111:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332171:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727872:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332195:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332210:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332218:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728000:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332233:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332241:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332250:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728128:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332267:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332275:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332283:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728256:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332299:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332307:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332322:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728384:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332354:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000000010020 nid: 192.168.201.59@tcp remote: 0xa8892732047161dd expref: 58 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332362:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x70000400010020 nid: 192.168.201.59@tcp remote: 0xa8892732047161dd expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332371:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728512:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332389:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332397:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.332406:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728640:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.332421:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.332429:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.334504:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728768:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.334710:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 58 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.334728:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 58 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.334741:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728896:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.334760:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 58 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.334769:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.334778:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729024:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.334827:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 58 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.334837:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.334845:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729152:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.334873:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 58 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.334881:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 58 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.334894:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729280:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.334914:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 58 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.334922:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 58 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.334931:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729408:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.334952:0:20841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 58 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.334961:0:20841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 58 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.334970:0:20841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729536:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.334994:0:20841:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61819da80 going to sleep for 11 seconds 00010000:00010000:0.0:1787119533.335027:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f8bf5c/0xcaba3de8463e4983 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 53 type: EXT [397312->33951743] (req 397312->401407) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471701c expref: 58 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335044:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634967b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723136:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.335056:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee553e76/0xcaba3de8463e4856 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 52 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716eef expref: 57 pid: 20841 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335069:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634967100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723264:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.335078:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002051885/0xcaba3de8463e46b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 51 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d4b expref: 56 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335089:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634965180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723392:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.335099:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0402def/0xcaba3de8463e46a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 50 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716d3d expref: 55 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335108:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723520:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.335119:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000131e930a/0xcaba3de8463e4650 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 49 type: EXT [376832->385023] (req 376832->380927) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ce9 expref: 54 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335127:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723648:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.335137:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a542e7f/0xcaba3de8463e460a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 48 type: EXT [368640->376831] (req 368640->372735) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ca3 expref: 53 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335145:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634966a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723776:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.335155:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a047055a/0xcaba3de8463e45fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 47 type: EXT [360448->368639] (req 360448->364543) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c95 expref: 52 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335163:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653723904:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.335175:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a562fb3d/0xcaba3de8463e45ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [339968->360447] (req 339968->344063) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716c87 expref: 51 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335184:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724032:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.335194:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002945c6cb/0xcaba3de8463e497c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717015 expref: 50 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335203:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634149180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724160:192.168.201.59@tcp:104: 00010000:00010000:0.0:1787119533.335212:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce2d1752/0xcaba3de8463e4975 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471700e expref: 49 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.335220:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724288:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119533.336870:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724416:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119533.336941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119533.337337:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633774080 00000100:00100000:1.0:1787119533.337345:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633774080 00010000:00010000:1.0:1787119533.337381:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 49 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119533.337422:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5774 00000100:00100000:1.0:1787119533.337429:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2375:x1873929633774080:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.337473:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.337479:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 49 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.337490:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 49 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.337515:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b719e3e/0xcaba3de8463e496e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717007 expref: 49 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.337532:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.337759:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+48:2375:x1873929633774080:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 328us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.337767:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5774 00000100:00100000:1.0:1787119533.348698:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724544:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119533.350974:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724672:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351051:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724800:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351062:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653724928:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351071:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725056:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351081:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725184:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351089:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725312:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351109:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725440:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351118:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634149500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725568:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351126:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725696:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351135:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725824:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351144:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653725952:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351163:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506156a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726080:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351170:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506156680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726208:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351179:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506155880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726336:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351187:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506154700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726464:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351194:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506157480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726592:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351201:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506155180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726720:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351208:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506155c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726848:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351216:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506155500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653726976:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119533.351223:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727104:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119533.359307:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.359667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119533.359708:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633774208 00000100:00100000:0.0:1787119533.359728:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633774208 00010000:00010000:0.0:1787119533.359770:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 48 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.359797:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633774464 00000100:00100000:0.0:1787119533.359800:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633774464 00010000:00010000:0.0:1787119533.359823:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 49 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.359836:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633774720 00000100:00100000:0.0:1787119533.359838:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633774720 00010000:00010000:0.0:1787119533.359850:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 50 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.359861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633774976 00000100:00100000:0.0:1787119533.359863:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633774976 00010000:00010000:0.0:1787119533.359873:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 51 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.359883:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633775232 00000100:00100000:0.0:1787119533.359885:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633775232 00010000:00010000:0.0:1787119533.359894:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 52 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.359904:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633775488 00000100:00100000:0.0:1787119533.359906:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633775488 00010000:00010000:0.0:1787119533.359940:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 53 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.359952:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633775744 00000100:00100000:0.0:1787119533.359955:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633775744 00010000:00010000:0.0:1787119533.359965:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 54 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.359974:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633776000 00000100:00100000:0.0:1787119533.359976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633776000 00010000:00010000:0.0:1787119533.359984:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 55 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.359993:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633776256 00000100:00100000:0.0:1787119533.359996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633776256 00010000:00010000:0.0:1787119533.360004:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 56 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.360013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633776512 00000100:00100000:0.0:1787119533.360015:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633776512 00010000:00010000:0.0:1787119533.360023:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 57 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.360031:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633776768 00000100:00100000:0.0:1787119533.360033:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633776768 00010000:00010000:0.0:1787119533.360042:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 58 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.360051:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633774336 00000100:00100000:0.0:1787119533.360053:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633774336 00010000:00010000:0.0:1787119533.360062:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 59 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.360070:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633774592 00000100:00100000:0.0:1787119533.360073:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633774592 00010000:00010000:0.0:1787119533.360082:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 60 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.360092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633774848 00000100:00100000:0.0:1787119533.360095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633774848 00000100:00100000:3.0:1787119533.360096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:0.0:1787119533.360108:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 61 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.360122:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633775104 00000100:00100000:0.0:1787119533.360125:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633775104 00010000:00010000:0.0:1787119533.360137:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 62 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.360145:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633775360 00000100:00100000:3.0:1787119533.360151:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633775360 00000100:00100000:0.0:1787119533.360151:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633775616 00000100:00100000:0.0:1787119533.360156:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633775616 00010000:00010000:0.0:1787119533.360175:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 64 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.360176:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 64 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.360200:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633775872 00000100:00100000:0.0:1787119533.360205:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633775872 00000100:00100000:3.0:1787119533.360209:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633776128 00000100:00100000:3.0:1787119533.360214:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633776128 00010000:00010000:0.0:1787119533.360219:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 66 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.360231:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 66 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.360233:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633776384 00000100:00100000:0.0:1787119533.360238:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633776384 00000100:00100000:3.0:1787119533.360253:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633776640 00010000:00010000:0.0:1787119533.360255:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 67 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.360258:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633776640 00010000:00010000:3.0:1787119533.360276:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 42 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 68 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.360281:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5775 00000100:00100000:0.0:1787119533.360295:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+68:2376:x1873929633774208:12345-192.168.201.59@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787119533.360302:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5776 00010000:00010000:0.0:1787119533.360311:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787119533.360312:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+68:2376:x1873929633774464:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119533.360322:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 68 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.360324:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119533.360334:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 68 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.360339:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 68 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119533.360424:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5777 00000100:00100000:1.0:1787119533.360434:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+68:2376:x1873929633774720:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.360476:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.360481:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 45 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 68 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.360542:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:2.0:1787119533.360552:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00000100:00100000:2.0:1787119533.361022:0:8451:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:2.0:1787119533.361034:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5778 00000100:00100000:2.0:1787119533.361042:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+68:2376:x1873929633774976:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119533.361051:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119533.361057:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 68 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.361873:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 68 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.362083:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057a85b7/0xcaba3de8463e4967 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 46 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204717000 expref: 68 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.362107:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119533.362262:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 67 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.362280:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e5d4da/0xcaba3de8463e494b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 44 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fe4 expref: 67 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.362291:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119533.362341:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+66:2376:x1873929633774208:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2048us (3041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119533.362350:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5775 00000100:00100000:0.0:1787119533.362379:0:5835:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:0.0:1787119533.362389:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5779 00000100:00100000:0.0:1787119533.362400:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+65:2376:x1873929633775232:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119533.362412:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119533.362419:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 65 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.362429:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 65 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.362754:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b3dc02/0xcaba3de8463e492f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 43 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc8 expref: 65 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.362769:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119533.362834:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 64 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.362849:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db665bf/0xcaba3de8463e493d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 41 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fd6 expref: 64 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.362861:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.362959:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+63:2376:x1873929633774720:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2527us (3575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.362967:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5777 00000100:00100000:0.0:1787119533.363032:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+63:2376:x1873929633775232:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 635us (3556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119533.363039:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5779 00000100:00100000:1.0:1787119533.363078:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5780 00000100:00100000:1.0:1787119533.363087:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+62:2376:x1873929633775488:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.363097:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.363101:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 62 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363111:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 62 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363124:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077aab101/0xcaba3de8463e491a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 40 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fb3 expref: 62 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363144:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.363162:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+61:2376:x1873929633775488:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 77us (3667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.363168:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5780 00000100:00100000:1.0:1787119533.363181:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5781 00000100:00100000:1.0:1787119533.363187:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+60:2376:x1873929633775744:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.363195:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.363200:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 60 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363209:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 60 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363220:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd137a3e/0xcaba3de8463e490c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 39 type: EXT [258048->266239] (req 258048->262143) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fa5 expref: 60 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363230:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.363247:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+59:2376:x1873929633775744:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 61us (3740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.363253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5781 00000100:00100000:1.0:1787119533.363267:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5782 00000100:00100000:1.0:1787119533.363273:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+58:2376:x1873929633776000:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.363280:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.363285:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363293:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363304:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef09bb4f/0xcaba3de8463e48fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 38 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f97 expref: 58 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363315:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.363330:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+57:2376:x1873929633776000:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 58us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.363336:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5782 00000100:00100000:1.0:1787119533.363347:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5783 00000100:00100000:1.0:1787119533.363354:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+56:2376:x1873929633776256:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.363361:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.363365:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 56 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363375:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 56 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363389:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3b005fd/0xcaba3de8463e48f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 37 type: EXT [225280->233471] (req 225280->229375) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f89 expref: 56 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363399:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787119533.363416:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bffdaae/0xcaba3de8463e4959 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 35 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff2 expref: 55 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119533.363421:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+55:2376:x1873929633776256:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 65us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.363436:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5783 00010000:00010000:3.0:1787119533.363452:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119533.363475:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+54:2376:x1873929633774464:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3164us (4119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.363482:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5784 00000100:00100000:3.0:1787119533.363493:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5776 00000100:00100000:1.0:1787119533.363498:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+53:2376:x1873929633776512:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.363506:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.363511:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 53 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363525:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 53 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363540:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1401ae3/0xcaba3de8463e48e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 34 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f7b expref: 53 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363551:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.363708:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+52:2376:x1873929633776512:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 78us (4029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.363726:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5784 00000100:00100000:1.0:1787119533.363741:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5785 00000100:00100000:1.0:1787119533.363754:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+51:2376:x1873929633776768:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.363766:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.363770:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 51 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363784:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 51 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363801:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006735c94/0xcaba3de8463e4928 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fc1 expref: 51 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363812:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.363837:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+50:2376:x1873929633776768:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 89us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.363844:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5785 00000100:00100000:1.0:1787119533.363857:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5786 00000100:00100000:1.0:1787119533.363863:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+49:2376:x1873929633774336:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.363872:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.363944:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 49 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363956:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 49 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363970:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4fc04b8/0xcaba3de8463e4960 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716ff9 expref: 49 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.363991:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.364007:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+48:2376:x1873929633774336:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 144us (4433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.364014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5786 00000100:00100000:1.0:1787119533.364028:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5787 00000100:00100000:1.0:1787119533.364034:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+47:2376:x1873929633774592:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.364042:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.364047:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 47 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364056:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 47 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364067:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d4ca473/0xcaba3de8463e4952 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716feb expref: 47 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364076:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.364087:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+46:2376:x1873929633774592:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 55us (4502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.364093:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5787 00000100:00100000:1.0:1787119533.364106:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5788 00000100:00100000:1.0:1787119533.364112:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2376:x1873929633774848:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.364120:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.364124:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 45 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364134:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 45 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364144:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005175452b/0xcaba3de8463e4944 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [294912->303103] (req 294912->299007) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fdd expref: 45 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364152:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.364163:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2376:x1873929633774848:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 53us (4566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.364174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5788 00000100:00100000:1.0:1787119533.364186:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5789 00000100:00100000:1.0:1787119533.364195:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2376:x1873929633775104:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.364202:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.364207:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 43 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364215:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 43 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364225:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ced97601/0xcaba3de8463e4936 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fcf expref: 43 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364238:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.364249:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2376:x1873929633775104:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 54us (4638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.364254:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5789 00000100:00100000:1.0:1787119533.364264:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5790 00000100:00100000:1.0:1787119533.364270:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2376:x1873929633775616:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.364276:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787119533.364367:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2376:x1873929633774976:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3324us (4949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119533.364374:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5778 00010000:00010000:1.0:1787119533.364392:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 41 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364403:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 41 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364415:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab6b3e5/0xcaba3de8463e4913 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fac expref: 41 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364425:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.364556:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2376:x1873929633775616:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 169us (4805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.364563:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5790 00000100:00100000:1.0:1787119533.364648:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5791 00000100:00100000:1.0:1787119533.364657:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2376:x1873929633775360:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.364665:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.364669:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 39 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364678:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 39 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364690:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009db08c28/0xcaba3de8463e4921 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716fba expref: 39 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364700:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.364713:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2376:x1873929633775360:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 59us (5091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.364782:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5791 00000100:00100000:1.0:1787119533.364799:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5792 00000100:00100000:1.0:1787119533.364805:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2376:x1873929633775872:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.364813:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.364828:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 37 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364837:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 37 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364849:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64947f2/0xcaba3de8463e4905 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [249856->258047] (req 249856->253951) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f9e expref: 37 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364861:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.364874:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2376:x1873929633775872:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 70us (5228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.364880:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5792 00000100:00100000:1.0:1787119533.364911:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5793 00000100:00100000:1.0:1787119533.364918:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2376:x1873929633776128:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.364925:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.364930:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 35 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364938:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 35 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364949:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9e1151/0xcaba3de8463e48f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [233472->245759] (req 233472->237567) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f90 expref: 35 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.364959:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.364970:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2376:x1873929633776128:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 54us (5313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.365028:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5793 00000100:00100000:1.0:1787119533.365042:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5794 00000100:00100000:1.0:1787119533.365048:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2376:x1873929633776384:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.365057:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.365061:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 33 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.365070:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 33 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.365081:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5701b0b/0xcaba3de8463e48e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f82 expref: 33 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.365090:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.365103:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2376:x1873929633776384:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 56us (5435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.365109:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5794 00000100:00100000:1.0:1787119533.365120:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5795 00000100:00100000:1.0:1787119533.365126:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+31:2376:x1873929633776640:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.365133:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.365138:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 31 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.365147:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 31 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.365158:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f95bc3/0xcaba3de8463e48db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f74 expref: 31 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.365167:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.365179:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2376:x1873929633776640:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 53us (5501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.365184:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5795 00000100:00100000:0.0:1787119533.366931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119533.366970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119533.367553:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506157800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727232:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119533.367565:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506154380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727360:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119533.367646:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727488:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119533.367660:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727616:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119533.367668:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506156300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727744:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119533.367675:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653727872:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119533.367682:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728000:192.168.201.59@tcp:104: 00000100:00100000:3.0:1787119533.367933:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633776896 00000100:00100000:3.0:1787119533.367941:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633776896 00000100:00100000:0.0:1787119533.368043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119533.368115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119533.368137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119533.368156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119533.368179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119533.368194:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119533.368199:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 27 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.368211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119533.368228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.368237:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633777024 00000100:00100000:3.0:1787119533.368243:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633777024 00000100:00100000:0.0:1787119533.368248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119533.368263:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 28 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.368271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.368286:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633777152 00000100:00100000:0.0:1787119533.368291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.368292:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633777152 00010000:00010000:3.0:1787119533.368311:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 29 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.368311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.368331:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633778176 00000100:00100000:0.0:1787119533.368331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.368336:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633778176 00010000:00010000:3.0:1787119533.368355:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 30 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.368356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.368374:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633778560 00000100:00100000:3.0:1787119533.368380:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633778560 00000100:00100000:0.0:1787119533.368380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00010000:00010000:3.0:1787119533.368399:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 31 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.368407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.368422:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633778944 00000100:00100000:3.0:1787119533.368425:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633778944 00010000:00010000:3.0:1787119533.368470:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 32 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.368481:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119533.368489:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633778048 00000100:00100000:3.0:1787119533.368494:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633778048 00010000:00010000:3.0:1787119533.368508:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x60000400010020 nid: 192.168.201.59@tcp remote: 0xa8892732047161dd expref: 33 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.368521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633778432 00000100:00100000:3.0:1787119533.368524:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633778432 00010000:00010000:3.0:1787119533.368536:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 34 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.368547:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633778688 00000100:00100000:3.0:1787119533.368550:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633778688 00010000:00010000:3.0:1787119533.368560:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 35 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.368570:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633779072 00000100:00100000:3.0:1787119533.368573:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633779072 00010000:00010000:3.0:1787119533.368582:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 36 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.368593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633777280 00000100:00100000:3.0:1787119533.368595:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633777280 00010000:00010000:3.0:1787119533.368606:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 37 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.368618:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633777536 00000100:00100000:3.0:1787119533.368620:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633777536 00010000:00010000:3.0:1787119533.368632:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 38 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.368643:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633777792 00000100:00100000:3.0:1787119533.368645:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633777792 00010000:00010000:3.0:1787119533.368658:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 39 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.368670:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633778304 00000100:00100000:3.0:1787119533.368672:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633778304 00010000:00010000:3.0:1787119533.368753:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 40 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.368766:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633779200 00000100:00100000:3.0:1787119533.368769:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633779200 00010000:00010000:3.0:1787119533.368781:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 41 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119533.368785:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633777408 00000100:00100000:1.0:1787119533.368792:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633777408 00000100:00100000:3.0:1787119533.368803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633777664 00000100:00100000:3.0:1787119533.368808:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633777664 00010000:00010000:1.0:1787119533.368827:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 43 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119533.368846:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633777920 00000100:00100000:1.0:1787119533.368849:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633777920 00010000:00010000:1.0:1787119533.368863:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 44 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.368877:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 44 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119533.368877:0:20609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633778816 00000100:00100000:1.0:1787119533.368882:0:20609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633778816 00010000:00010000:1.0:1787119533.368897:0:20609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 45 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119533.368904:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5796 00000100:00100000:3.0:1787119533.368919:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2374:x1873929633776896:12345-192.168.201.59@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787119533.368923:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5797 00000100:00100000:1.0:1787119533.368934:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2373:x1873929633777024:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787119533.368939:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.368944:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787119533.368948:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 45 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.368953:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 45 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.368969:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 45 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.369097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5798 00000100:00100000:2.0:1787119533.369107:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2374:x1873929633777152:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119533.369115:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119533.369121:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 45 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119533.369187:0:21335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5799 00000100:00100000:0.0:1787119533.369202:0:21335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+45:2374:x1873929633778176:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119533.369536:0:21335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119533.369544:0:21335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 45 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370070:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 45 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370096:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acfadcd9/0xcaba3de8463e48cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f66 expref: 45 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370114:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.370186:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+44:2373:x1873929633777024:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 1252us (3214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.370194:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5797 00000100:00100000:1.0:1787119533.370229:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5800 00000100:00100000:1.0:1787119533.370238:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2374:x1873929633778560:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.370247:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.370257:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 43 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370267:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 43 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370280:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.370298:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+43:2374:x1873929633778560:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 62us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.370303:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5800 00000100:00100000:1.0:1787119533.370319:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5801 00000100:00100000:1.0:1787119533.370325:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2374:x1873929633778944:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.370333:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.370338:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 42 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370348:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 42 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370359:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.370375:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+42:2374:x1873929633778944:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 51us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.370381:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5801 00000100:00100000:1.0:1787119533.370393:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5802 00000100:00100000:1.0:1787119533.370399:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2374:x1873929633778048:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.370408:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.370413:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x60000400010020 nid: 192.168.201.59@tcp remote: 0xa8892732047161dd expref: 41 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370422:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50000400010020 nid: 192.168.201.59@tcp remote: 0xa8892732047161dd expref: 41 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370434:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.370484:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+41:2374:x1873929633778048:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 84us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.370495:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5802 00000100:00100000:1.0:1787119533.370511:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5803 00000100:00100000:1.0:1787119533.370518:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2374:x1873929633778432:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.370526:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.370531:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 40 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370545:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 40 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370557:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.370584:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+40:2374:x1873929633778432:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 56us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.370591:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5803 00000100:00100000:1.0:1787119533.370606:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5804 00000100:00100000:1.0:1787119533.370613:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2374:x1873929633778688:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.370621:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.370626:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 39 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370641:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 39 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370652:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.370669:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+39:2374:x1873929633778688:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 57us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.370675:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5804 00000100:00100000:1.0:1787119533.370687:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5805 00000100:00100000:1.0:1787119533.370693:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2374:x1873929633779072:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.370700:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.370705:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 38 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370715:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 38 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370798:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.370832:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+38:2374:x1873929633779072:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 138us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.370838:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5805 00000100:00100000:1.0:1787119533.370854:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5806 00000100:00100000:1.0:1787119533.370861:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a620709450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+37:2375:x1873929633777280:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.370869:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.370874:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 37 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370971:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 37 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.370996:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009581187/0xcaba3de8463e48bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [184320->192511] (req 184320->188415) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f58 expref: 37 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371006:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.371026:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a620709450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+36:2375:x1873929633777280:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 165us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.371032:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5806 00000100:00100000:1.0:1787119533.371062:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5807 00000100:00100000:1.0:1787119533.371068:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+35:2375:x1873929633777536:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.371075:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.371080:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 35 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371090:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 35 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371102:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2b3c79/0xcaba3de8463e48b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f4a expref: 35 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371111:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.371125:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+34:2375:x1873929633777536:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 57us (2858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.371130:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5807 00000100:00100000:1.0:1787119533.371144:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5808 00000100:00100000:1.0:1787119533.371150:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2375:x1873929633777792:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.371166:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.371175:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 33 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371185:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 33 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371199:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.371212:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+33:2375:x1873929633777792:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 62us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.371217:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5808 00000100:00100000:1.0:1787119533.371229:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5809 00000100:00100000:1.0:1787119533.371234:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2375:x1873929633778304:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.371241:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.371244:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 32 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371259:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 32 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371270:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.371281:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+32:2375:x1873929633778304:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 47us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.371286:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5809 00000100:00100000:1.0:1787119533.371299:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5810 00000100:00100000:1.0:1787119533.371305:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+31:2375:x1873929633779200:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.371311:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.371316:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 31 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371324:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 31 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371335:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.371347:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+31:2375:x1873929633779200:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 42us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.371352:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5810 00000100:00100000:1.0:1787119533.371364:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5811 00000100:00100000:1.0:1787119533.371369:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+30:2375:x1873929633777408:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.371376:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.371381:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 30 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371390:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 30 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371401:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b7258d/0xcaba3de8463e48b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f51 expref: 30 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371410:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.371422:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+29:2375:x1873929633777408:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 53us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.371428:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5811 00000100:00100000:1.0:1787119533.371462:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5812 00000100:00100000:1.0:1787119533.371470:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62070ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633777920:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.371478:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.371570:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 28 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371869:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 28 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371881:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.371904:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+28:2375:x1873929633777920:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 436us (3501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.371911:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5812 00000100:00100000:1.0:1787119533.371926:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5813 00000100:00100000:1.0:1787119533.371933:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+27:2375:x1873929633777664:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.371940:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.371945:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 27 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371953:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 27 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371966:0:20609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ff8632f/0xcaba3de8463e48aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [163840->176127] (req 163840->167935) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f43 expref: 27 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.371979:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.371992:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+26:2375:x1873929633777664:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 61us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.371999:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5813 00000100:00100000:1.0:1787119533.372032:0:20609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5814 00000100:00100000:1.0:1787119533.372039:0:20609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2375:x1873929633778816:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119533.372047:0:20609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119533.372052:0:20609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x60000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 25 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.372061:0:20609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 25 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119533.372072:0:20609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119533.372084:0:20609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+25:2375:x1873929633778816:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 46us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119533.372090:0:20609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5814 00010000:00010000:2.0:1787119533.372402:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 24 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.372802:0:21335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 24 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.372835:0:21335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119533.372862:0:21335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62070b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+24:2374:x1873929633778176:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3668us (4747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119533.372869:0:21335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5799 00010000:00010000:2.0:1787119533.372929:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed8f352/0xcaba3de8463e48c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [192512->204799] (req 192512->196607) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f5f expref: 23 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.372944:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 202) 00010000:00010000:2.0:1787119533.372948:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 202) 00010000:00010000:2.0:1787119533.372953:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.372963:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.372984:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787119533.373000:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+22:2374:x1873929633777152:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 3895us (4958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119533.373007:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5798 00010000:00010000:2.0:1787119533.373070:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff77d98a/0xcaba3de8463e48a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [122880->163839] (req 122880->126975) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f3c expref: 21 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373083:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728128:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373095:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9df060/0xcaba3de8463e489c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [86016->122879] (req 86016->90111) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f35 expref: 20 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373103:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728256:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373114:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7815d7f/0xcaba3de8463e3b4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [73728->86015] (req 73728->77823) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa8892732047161e4 expref: 19 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373124:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728384:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373135:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000574fc608/0xcaba3de8463e3b44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x44801400010020 nid: 192.168.201.59@tcp remote: 0xa8892732047161dd expref: 18 pid: 12469 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373144:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728512:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373153:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000218aeb85/0xcaba3de8463e3af0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [61440->69631] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716189 expref: 17 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373167:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728640:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373179:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000363af705/0xcaba3de8463e3ae9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716182 expref: 16 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373187:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728768:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373197:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a463a82c/0xcaba3de8463e3a95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471612e expref: 15 pid: 8267 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373205:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653728896:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373215:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d58de/0xcaba3de8463e3a8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716127 expref: 14 pid: 6695 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373222:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729024:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373232:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317e8386/0xcaba3de8463e39e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa88927320471608d expref: 13 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373239:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729152:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373249:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eebf0d5/0xcaba3de8463e39df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716086 expref: 12 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373258:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729280:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373267:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081703269/0xcaba3de8463e3953 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [32768->40959] (req 32768->36863) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715ffa expref: 11 pid: 20843 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373276:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729408:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119533.373285:0:20841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030ed7360/0xcaba3de8463e3945 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->32767] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204715fec expref: 10 pid: 6696 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119533.373293:0:20841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20841:1873929653729536:192.168.201.59@tcp:104: 00010000:00010000:3.0:1787119533.373861:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8722499/0xcaba3de8463e48d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44801400030020 nid: 192.168.201.59@tcp remote: 0xa889273204716f6d expref: 9 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119533.373878:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787119533.373905:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633776896:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 4990us (6981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119533.373912:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5796 00010000:00010000:2.0:1787119533.374333:0:20841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.374420:0:20841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.374429:0:20841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.375292:0:20841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.375305:0:20841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.375370:0:20841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787119533.376384:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a60615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653723008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 71343us (71488us total) trans 4294969278 rc 0/0 00000100:00100000:0.0:1787119533.376394:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5731 00000004:00080000:3.0:1787119533.376839:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92a606158000/2, rc 0, transno 4294969278 00000100:00100000:3.0:1787119533.376851:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653723008:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787119533.377377:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787119533.377387:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.377399:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a510a38600 already unused, calling callback (ffffffffc163d010) 00010000:00010000:2.0:1787119533.377403:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.377414:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.377434:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119533.377836:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c99bce86/0xcaba3de8463e4b04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119533.377929:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119533.377932:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119533.377933:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119534.049785:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119534.241720:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653729792:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.241794:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119534.241862:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653730304:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.241892:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119534.241921:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787119534.241926:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653729664:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.241953:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119534.241974:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653730176:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.241993:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119534.242017:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653729920:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.242042:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119534.242057:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787119534.242062:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653730048:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.242081:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119534.242109:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653729664 00000100:00100000:3.0:1787119534.242116:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653729664 00000100:00100000:3.0:1787119534.242159:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1787119534.242168:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653729664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.242217:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653729664:12345-0@lo:400:kworker.0 Request processed in 50us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119534.242223:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1787119534.242252:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653730304 00000100:00100000:3.0:1787119534.242256:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653730304 00000100:00100000:3.0:1787119534.242280:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653730048 00000100:00100000:3.0:1787119534.242283:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653730048 00000100:00100000:3.0:1787119534.242311:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1787119534.242318:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1873929653730304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.242345:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1873929653730304:12345-0@lo:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119534.242355:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1787119534.242365:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1787119534.242370:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653730048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.242395:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653730048:12345-0@lo:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119534.242400:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00080000:3.0:1787119534.242416:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119534.242467:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653730048:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.242494:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653729664:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.242503:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653730304:0@lo:400:kworker.0 00000100:00100000:2.0:1787119534.242626:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653729792 00000100:00100000:2.0:1787119534.242630:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653729792 00000100:00100000:2.0:1787119534.242656:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653730176 00000100:00100000:2.0:1787119534.242658:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653730176 00000100:00100000:2.0:1787119534.242677:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653729920 00000100:00100000:2.0:1787119534.242680:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653729920 00000100:00100000:2.0:1787119534.242696:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1787119534.242702:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653729792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119534.242736:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653729792:12345-0@lo:400:kworker.0 Request processed in 34us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119534.242742:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1787119534.242754:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1787119534.242759:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653730176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119534.242784:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653730176:12345-0@lo:400:kworker.0 Request processed in 25us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119534.242790:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1787119534.242811:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1787119534.242818:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653729920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119534.242842:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653729920:12345-0@lo:400:kworker.0 Request processed in 25us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119534.242847:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1787119534.242921:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787119534.242930:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653730432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119534.242959:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787119534.242993:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119534.243007:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653729920:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.243026:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653730176:0@lo:400:kworker.0 00000100:00100000:3.0:1787119534.243034:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653729792:0@lo:400:kworker.0 00000100:00100000:2.0:1787119534.243140:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653730432 00000100:00100000:2.0:1787119534.243144:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653730432 00000100:00100000:2.0:1787119534.243173:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787119534.243180:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653730432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787119534.243208:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 822280192 pending 1703936 free 3827302400 avail 3825205248 00000100:00100000:2.0:1787119534.243253:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653730432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119534.243261:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787119534.243328:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653730432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119534.243559:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653730560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119534.243588:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119534.243663:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653730560 00000100:00100000:1.0:1787119534.243667:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653730560 00000100:00100000:1.0:1787119534.243698:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787119534.243704:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653730560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787119534.243726:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:1.0:1787119534.243770:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653730560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119534.243775:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787119534.243843:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653730560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787119535.073897:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119536.099271:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119537.040035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119537.040075:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119537.040166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119537.040199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119537.040251:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633779840 00000100:00100000:1.0:1787119537.040261:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633779840 00000100:00100000:1.0:1787119537.040322:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 716 00000100:00100000:1.0:1787119537.040332:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633779840:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119537.040419:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633779840:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119537.040426:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 716 00000100:00100000:3.0:1787119537.040657:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633779328 00000100:00100000:3.0:1787119537.040662:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633779328 00000100:00100000:3.0:1787119537.040702:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 530 00000100:00100000:3.0:1787119537.040709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633779328:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119537.040744:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633779328:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 36us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119537.040765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 530 00000100:00080000:3.0:1787119537.040792:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119537.044814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119537.044844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119537.044894:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633779456 00000100:00100000:1.0:1787119537.044904:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633779456 00000100:00100000:1.0:1787119537.044983:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 717 00000100:00100000:1.0:1787119537.044993:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633779456:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119537.045062:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633779456:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119537.045069:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 717 00000100:00080000:1.0:1787119537.045197:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119537.049608:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633779584 00000100:00100000:0.0:1787119537.049631:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633779584 00000100:00100000:0.0:1787119537.049708:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633780096 00000100:00100000:0.0:1787119537.049712:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633780096 00000100:00100000:0.0:1787119537.049749:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 608 00000100:00100000:0.0:1787119537.049774:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633779584:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119537.049870:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633779584:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 98us (9793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119537.049878:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 608 00000100:00100000:0.0:1787119537.049895:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 609 00000100:00100000:0.0:1787119537.049903:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633780096:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119537.049927:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633780096:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (9728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119537.049933:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 609 00000100:00080000:1.0:1787119537.050722:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787119537.050730:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119537.053120:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633779712 00000100:00100000:0.0:1787119537.053136:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633779712 00000100:00100000:0.0:1787119537.053211:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 610 00000100:00100000:0.0:1787119537.053220:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2376:x1873929633779712:12345-192.168.201.59@tcp:400:kworker.0 00000100:00080000:1.0:1787119537.053296:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119537.054115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119537.054244:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2376:x1873929633779712:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 1022us (9397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119537.054254:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 610 00000100:00100000:1.0:1787119537.054276:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633779968 00000100:00100000:1.0:1787119537.054281:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633779968 00000100:00080000:3.0:1787119537.058778:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119537.059393:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 611 00000100:00100000:0.0:1787119537.059523:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633779968:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119537.059838:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633779968:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 326us (5725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119537.059848:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 611 00010000:00010000:0.0:1787119537.123267:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787119537.921136:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969278 is committed 00000001:00080000:1.0:1787119537.921154:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969277 is committed 00010000:00010000:2.0:1787119538.145717:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119539.169999:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119539.361933:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653730688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119539.362012:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119539.362204:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653731072:0@lo:400:kworker.0 00000100:00100000:0.0:1787119539.362257:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119539.362280:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787119539.362286:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873929653730944:0@lo:400:kworker.0 00000100:00100000:0.0:1787119539.362309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119539.362336:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653731072 00000100:00100000:0.0:1787119539.362344:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653731072 00000100:00100000:0.0:1787119539.362405:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653730944 00000100:00100000:0.0:1787119539.362409:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653730944 00000100:00100000:0.0:1787119539.362429:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1787119539.362458:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653731072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119539.362510:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653731072:12345-0@lo:400:kworker.0 Request processed in 73us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119539.362518:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1787119539.362534:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1787119539.362541:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873929653730944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119539.362569:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873929653730944:12345-0@lo:400:kworker.0 Request processed in 28us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119539.362575:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1787119539.362617:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873929653730944:0@lo:400:kworker.0 00000100:00100000:0.0:1787119539.362630:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653731072:0@lo:400:kworker.0 00000100:00100000:0.0:1787119539.362659:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653731200:0@lo:400:kworker.0 00000100:00100000:0.0:1787119539.362682:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119539.362701:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787119539.362706:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653730816:0@lo:400:kworker.0 00000100:00100000:1.0:1787119539.362816:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653730688 00000100:00100000:1.0:1787119539.362821:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653730688 00000100:00100000:1.0:1787119539.362853:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787119539.362860:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653730688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787119539.362888:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:1.0:1787119539.362922:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653730688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119539.362928:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787119539.362959:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653731200 00000100:00100000:1.0:1787119539.362962:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653731200 00000100:00100000:1.0:1787119539.362985:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1787119539.362991:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653731200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119539.363020:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653731200:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119539.363026:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00080000:3.0:1787119539.363106:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787119539.363110:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119539.363527:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119539.363606:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6068bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653731328:0@lo:400:kworker.0 00000100:00100000:0.0:1787119539.363633:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119539.363668:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653731200:0@lo:400:kworker.0 00000100:00100000:0.0:1787119539.363686:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653730688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787119539.363934:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653731328 00000100:00100000:1.0:1787119539.363939:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653731328 00000100:00100000:1.0:1787119539.363987:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1787119539.363995:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653731328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119539.364034:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653731328:12345-0@lo:400:kworker.0 Request processed in 41us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119539.364040:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00080000:0.0:1787119539.364098:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119539.364116:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969278 gen 2 00000004:00080000:0.0:1787119539.364132:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92a606158000, transno 4294969278 00000100:00100000:0.0:1787119539.364148:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653731328:0@lo:400:kworker.0 00000100:00100000:1.0:1787119539.364905:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787119539.364917:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6072f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653731456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119539.364956:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119539.365034:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653731456 00000100:00100000:2.0:1787119539.365039:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653731456 00000100:00100000:2.0:1787119539.365076:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787119539.365083:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653731456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787119539.365108:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1787119539.365161:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653731456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119539.365169:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787119539.365199:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6072f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653731456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119539.365461:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653730816 00000100:00100000:3.0:1787119539.365467:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653730816 00000100:00100000:3.0:1787119539.365534:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1787119539.365542:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653730816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119539.365588:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653730816:12345-0@lo:400:kworker.0 Request processed in 47us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119539.365594:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1787119539.365661:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6068be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653730816:0@lo:400:kworker.0 00010000:00010000:2.0:1787119540.194102:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119541.217961:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119542.161074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119542.161104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119542.161142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119542.161164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119542.161177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633780224 00000100:00100000:3.0:1787119542.161189:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633780224 00000100:00100000:2.0:1787119542.161190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119542.161211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119542.161235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119542.161251:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 532 00000100:00100000:3.0:1787119542.161262:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633780224:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119542.161278:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633780480 00000100:00100000:2.0:1787119542.161284:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633780480 00000100:00100000:1.0:1787119542.161321:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633780992 00000100:00100000:2.0:1787119542.161327:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633780608 00000100:00100000:1.0:1787119542.161328:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633780992 00000100:00100000:2.0:1787119542.161334:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633780608 00000100:00100000:3.0:1787119542.161342:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633780224:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119542.161352:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 532 00000100:00100000:1.0:1787119542.161368:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633780864 00000100:00100000:1.0:1787119542.161373:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633780864 00000100:00100000:2.0:1787119542.161386:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 613 00000100:00100000:2.0:1787119542.161398:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633780480:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119542.161404:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 614 00000100:00100000:1.0:1787119542.161417:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633780992:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119542.161428:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 615 00000100:00100000:0.0:1787119542.161474:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633780608:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119542.161476:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633780480:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 80us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119542.161487:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 613 00000100:00100000:2.0:1787119542.161501:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 616 00000100:00100000:2.0:1787119542.161508:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633780864:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119542.165568:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633780992:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 4146us (4394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119542.165568:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633780608:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 4118us (4342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119542.165569:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633780864:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 4048us (4320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119542.165592:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 614 00000100:00100000:2.0:1787119542.165600:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 616 00000100:00080000:2.0:1787119542.165690:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787119542.165697:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119542.165707:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633780736 00000100:00100000:2.0:1787119542.165712:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633780352 00000100:00100000:1.0:1787119542.165715:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633780736 00000100:00100000:2.0:1787119542.165719:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633780352 00000100:00100000:2.0:1787119542.165774:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 721 00000100:00100000:2.0:1787119542.165784:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633780352:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119542.165831:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633780352:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 49us (4641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119542.165838:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 721 00000100:00100000:2.0:1787119542.165851:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 722 00000100:00100000:2.0:1787119542.165858:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633780736:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119542.165882:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633780736:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (4740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119542.165888:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 722 00000100:00080000:1.0:1787119542.165935:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119542.171353:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 615 00010000:00010000:2.0:1787119542.243906:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119543.265761:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119544.291914:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119544.481737:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653731712:0@lo:400:kworker.0 00000100:00100000:0.0:1787119544.481820:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119544.481875:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653731584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119544.481903:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653732224:0@lo:400:kworker.0 00000100:00100000:1.0:1787119544.481913:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119544.481924:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119544.481982:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653731712 00000100:00100000:2.0:1787119544.481992:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653731712 00000100:00100000:2.0:1787119544.482041:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1787119544.482051:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653731712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119544.482110:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787119544.482117:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653731840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119544.482130:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653731968:0@lo:400:kworker.0 00000100:00100000:0.0:1787119544.482140:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119544.482159:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119544.482171:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653732352:0@lo:400:kworker.0 00000100:00100000:3.0:1787119544.482181:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653732480:0@lo:400:kworker.0 00000100:00100000:0.0:1787119544.482193:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119544.482198:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119544.482222:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653731584 00000100:00100000:0.0:1787119544.482225:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653731584 00000100:00100000:3.0:1787119544.482229:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653731968 00000100:00100000:3.0:1787119544.482232:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653731968 00000100:00100000:3.0:1787119544.482257:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653732352 00000100:00100000:0.0:1787119544.482257:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653731840 00000100:00100000:3.0:1787119544.482260:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653732352 00000100:00100000:0.0:1787119544.482260:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653731840 00000100:00100000:0.0:1787119544.482275:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787119544.482279:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1787119544.482281:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653731584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119544.482284:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653731968:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787119544.482313:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1787119544.482321:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653731968:12345-0@lo:400:kworker.0 Request processed in 36us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119544.482328:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1787119544.482341:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653731584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119544.482345:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1787119544.482348:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787119544.482350:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653732352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119544.482358:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787119544.482363:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653731840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787119544.482380:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1787119544.482396:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653732352:12345-0@lo:400:kworker.0 Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119544.482401:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653731840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119544.482402:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1787119544.482407:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:0.0:1787119544.482420:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119544.482424:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119544.482425:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653732224 00000100:00080000:0.0:1787119544.482427:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119544.482428:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653732224 00000100:00100000:3.0:1787119544.482478:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653732480 00000100:00100000:3.0:1787119544.482481:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653732480 00000100:00100000:3.0:1787119544.482499:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1787119544.482506:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653732224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119544.482550:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653732224:12345-0@lo:400:kworker.0 Request processed in 44us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119544.482556:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1787119544.482566:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1787119544.482572:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653732480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119544.482598:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653732480:12345-0@lo:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119544.482604:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1787119544.482667:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653731968:0@lo:400:kworker.0 00000100:00100000:3.0:1787119544.482680:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653732480:0@lo:400:kworker.0 00000100:00100000:3.0:1787119544.482719:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653731840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119544.482728:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653732352:0@lo:400:kworker.0 00000100:00100000:3.0:1787119544.482735:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653732224:0@lo:400:kworker.0 00000100:00100000:1.0:1787119544.485795:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653731584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119544.485808:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653732096:0@lo:400:kworker.0 00000100:00100000:1.0:1787119544.486431:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119544.486500:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653732096 00000100:00100000:0.0:1787119544.486509:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653732096 00000100:00080000:3.0:1787119544.486605:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119544.486749:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1787119544.486762:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653732096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119544.486822:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653732096:12345-0@lo:400:kworker.0 Request processed in 64us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119544.486829:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1787119544.486995:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653732096:0@lo:400:kworker.0 00000100:00100000:2.0:1787119544.487150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653731712:12345-0@lo:400:kworker.0 Request processed in 5100us (5330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119544.487158:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1787119544.490753:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653731712:0@lo:400:kworker.0 00010000:00010000:0.0:1787119545.313719:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119546.343339:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119547.280319:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119547.280366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119547.280388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119547.280407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119547.280424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119547.280463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119547.280483:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633781120 00000100:00100000:3.0:1787119547.280485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119547.280500:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633781120 00000100:00100000:3.0:1787119547.280510:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633781632 00000100:00100000:3.0:1787119547.280515:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633781632 00000100:00100000:3.0:1787119547.280564:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633781248 00000100:00100000:3.0:1787119547.280566:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633781248 00000100:00100000:3.0:1787119547.280602:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 726 00000100:00100000:3.0:1787119547.280614:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633781632:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119547.280713:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633781632:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119547.280721:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 726 00000100:00100000:3.0:1787119547.280739:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 727 00000100:00100000:3.0:1787119547.280746:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633781248:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119547.280779:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633781248:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 34us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119547.280786:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 727 00000100:00100000:0.0:1787119547.280875:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633781376 00000100:00100000:0.0:1787119547.280879:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633781376 00000100:00100000:0.0:1787119547.280909:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633781888 00000100:00100000:0.0:1787119547.280911:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633781888 00000100:00100000:0.0:1787119547.280930:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633781504 00000100:00100000:0.0:1787119547.280932:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633781504 00000100:00100000:0.0:1787119547.280949:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633781760 00000100:00100000:0.0:1787119547.280952:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633781760 00000100:00100000:0.0:1787119547.280968:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 619 00000100:00100000:0.0:1787119547.280973:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633781376:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119547.280992:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 620 00000100:00100000:0.0:1787119547.281000:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633781376:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119547.281007:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633781888:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119547.281008:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 619 00000100:00100000:0.0:1787119547.281021:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 621 00000100:00100000:0.0:1787119547.281028:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2376:x1873929633781504:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119547.281049:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633781888:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 47us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119547.281054:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2376:x1873929633781504:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119547.281062:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 620 00000100:00100000:0.0:1787119547.281291:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 621 00000100:00100000:0.0:1787119547.281306:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 622 00000100:00100000:0.0:1787119547.281313:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633781760:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119547.281344:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633781760:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119547.281350:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 622 00000100:00080000:0.0:1787119547.281410:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119547.281418:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119547.281420:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119547.281853:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 534 00000100:00100000:2.0:1787119547.281871:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633781120:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119547.281921:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633781120:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 55us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119547.281928:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 534 00010000:00010000:0.0:1787119547.361702:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119548.386134:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119549.409765:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119549.601855:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653732608:0@lo:400:kworker.0 00000100:00100000:1.0:1787119549.601951:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119549.602109:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653732864:0@lo:400:kworker.0 00000100:00100000:3.0:1787119549.602144:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119549.602167:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653733376:0@lo:400:kworker.0 00000100:00100000:3.0:1787119549.602188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119549.602210:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787119549.602216:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653732736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119549.602248:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119549.602263:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653732608 00000100:00100000:3.0:1787119549.602266:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653733248:0@lo:400:kworker.0 00000100:00100000:2.0:1787119549.602271:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653732608 00000100:00100000:3.0:1787119549.602290:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119549.602325:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653732864 00000100:00100000:2.0:1787119549.602328:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1787119549.602331:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653732864 00000100:00100000:2.0:1787119549.602341:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653732608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119549.602366:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653733248 00000100:00100000:3.0:1787119549.602370:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653733248 00000100:00100000:2.0:1787119549.602400:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653732608:12345-0@lo:400:kworker.0 Request processed in 60us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119549.602409:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1787119549.602418:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653732864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119549.602422:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1787119549.602485:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653732864:12345-0@lo:400:kworker.0 Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119549.602492:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1787119549.602509:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1787119549.602514:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653733376 00000100:00100000:3.0:1787119549.602517:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653733248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119549.602520:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653733376 00000100:00100000:3.0:1787119549.602568:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653733248:12345-0@lo:400:kworker.0 Request processed in 52us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119549.602569:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1787119549.602581:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653733376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119549.602585:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1787119549.602640:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653733248:0@lo:400:kworker.0 00000100:00100000:1.0:1787119549.602887:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653733120:0@lo:400:kworker.0 00000100:00100000:0.0:1787119549.603032:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653732736 00000100:00100000:0.0:1787119549.603038:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653732736 00000100:00100000:0.0:1787119549.603070:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787119549.603078:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653732736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787119549.603109:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:2.0:1787119549.609241:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653733376:12345-0@lo:400:kworker.0 Request processed in 6651us (7039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119549.609256:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1787119549.609324:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653732992:0@lo:400:kworker.0 00000100:00100000:2.0:1787119549.609396:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119549.609467:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653733504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119549.609507:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119549.609562:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653732992 00000100:00100000:2.0:1787119549.609570:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653732992 00000100:00100000:2.0:1787119549.609617:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1787119549.609627:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653732992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119549.609681:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653732992:12345-0@lo:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119549.609688:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1787119549.609707:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653733504 00000100:00100000:2.0:1787119549.609710:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653733504 00000100:00100000:2.0:1787119549.609725:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787119549.609731:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653733504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787119549.609881:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1787119549.609915:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653733504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119549.609922:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787119549.609982:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653732992:0@lo:400:kworker.0 00000100:00100000:2.0:1787119549.609999:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653733504:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787119549.610066:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787119549.610071:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787119549.610073:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119549.615944:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653732864:0@lo:400:kworker.0 00000100:00100000:3.0:1787119549.615974:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653733376:0@lo:400:kworker.0 00000100:00100000:1.0:1787119549.621239:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119549.621354:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653732608:0@lo:400:kworker.0 00000100:00100000:3.0:1787119549.622044:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653733120 00000100:00100000:3.0:1787119549.622056:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653733120 00000100:00100000:3.0:1787119549.622136:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1787119549.622147:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653733120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119549.622234:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653733120:12345-0@lo:400:kworker.0 Request processed in 88us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119549.622243:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1787119549.622844:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653733120:0@lo:400:kworker.0 00000100:00100000:0.0:1787119549.628108:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653732736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 25018us (25848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119549.628616:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787119549.628684:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653732736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787119550.434199:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119551.457939:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119552.405524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119552.405570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119552.405606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119552.405640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119552.405659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119552.405679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119552.405705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119552.405736:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633782272 00000100:00100000:3.0:1787119552.405746:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633782272 00000100:00100000:3.0:1787119552.405801:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633782784 00000100:00100000:3.0:1787119552.405804:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633782784 00000100:00100000:3.0:1787119552.405826:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633782400 00000100:00100000:3.0:1787119552.405829:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633782400 00000100:00100000:3.0:1787119552.405847:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633782656 00000100:00100000:3.0:1787119552.405849:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633782656 00000100:00100000:3.0:1787119552.405866:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 625 00000100:00100000:3.0:1787119552.405875:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633782272:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119552.405942:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633782272:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 68us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119552.405949:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 625 00000100:00100000:3.0:1787119552.405964:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 626 00000100:00100000:3.0:1787119552.405969:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633782784:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119552.405989:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633782784:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 21us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119552.405994:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 626 00000100:00100000:3.0:1787119552.406003:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 627 00000100:00100000:3.0:1787119552.406008:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633782400:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119552.406026:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633782400:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 18us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119552.406031:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 627 00000100:00100000:3.0:1787119552.406039:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 628 00000100:00100000:3.0:1787119552.406044:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633782656:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119552.406060:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633782656:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 16us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119552.406065:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 628 00000100:00100000:3.0:1787119552.406086:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633782528 00000100:00100000:3.0:1787119552.406089:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633782528 00000100:00100000:3.0:1787119552.406108:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633782144 00000100:00100000:3.0:1787119552.406110:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633782144 00000100:00100000:3.0:1787119552.406124:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 731 00000100:00100000:3.0:1787119552.406129:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633782528:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119552.406153:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633782528:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119552.406159:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 731 00000100:00100000:3.0:1787119552.406169:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 732 00000100:00100000:3.0:1787119552.406174:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633782144:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119552.406199:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633782144:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119552.406204:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 732 00000100:00100000:2.0:1787119552.406359:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633782016 00000100:00100000:2.0:1787119552.406364:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633782016 00000100:00100000:2.0:1787119552.406398:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 536 00000100:00100000:2.0:1787119552.406404:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633782016:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119552.406429:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633782016:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119552.406435:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 536 00000100:00080000:2.0:1787119552.406506:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787119552.406511:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787119552.406513:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787119552.482282:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119553.506985:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119554.531756:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119554.722339:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653733888:0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.722415:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119554.722500:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653734400:0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.722527:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119554.722565:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653734400 00000100:00100000:3.0:1787119554.722573:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653734400 00000100:00100000:3.0:1787119554.722630:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1787119554.722640:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653734400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.722690:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653734400:12345-0@lo:400:kworker.0 Request processed in 51us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119554.722697:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1787119554.722744:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653734400:0@lo:400:kworker.0 00000100:00100000:1.0:1787119554.722749:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653733632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119554.722763:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787119554.722769:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653733760:0@lo:400:kworker.0 00000100:00100000:1.0:1787119554.722780:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119554.722791:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119554.722797:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653734144:0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.722809:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653733760 00000100:00100000:3.0:1787119554.722812:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653733760 00000100:00100000:1.0:1787119554.722817:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119554.722834:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787119554.722835:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1787119554.722840:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653734016:0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.722841:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119554.722859:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119554.722883:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653734144 00000100:00100000:1.0:1787119554.722887:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653734144 00000100:00100000:1.0:1787119554.722914:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1787119554.722920:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653734144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.722944:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653733760:12345-0@lo:400:kworker.0 Request processed in 25us (72us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119554.722951:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1787119554.722955:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653734144:12345-0@lo:400:kworker.0 Request processed in 36us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119554.722960:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1787119554.722983:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653733760:0@lo:400:kworker.0 00000100:00100000:1.0:1787119554.722983:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653734144:0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.722989:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653734272:0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.723011:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119554.723648:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653733888 00000100:00100000:2.0:1787119554.723652:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653733888 00000100:00100000:2.0:1787119554.723680:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653734016 00000100:00100000:2.0:1787119554.723683:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653734016 00000100:00100000:2.0:1787119554.723702:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653734272 00000100:00100000:2.0:1787119554.723705:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653734272 00000100:00100000:2.0:1787119554.723727:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1787119554.723733:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653733888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119554.723748:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653734528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119554.723780:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119554.723790:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653733888:12345-0@lo:400:kworker.0 Request processed in 57us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119554.723796:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1787119554.723809:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1787119554.723815:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653734016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119554.723832:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1787119554.723839:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653734272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119554.723841:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653734016:12345-0@lo:400:kworker.0 Request processed in 27us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119554.723846:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1787119554.723866:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653734272:12345-0@lo:400:kworker.0 Request processed in 28us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119554.723872:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1787119554.723881:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653733632 00000100:00100000:2.0:1787119554.723885:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653733632 00000100:00100000:2.0:1787119554.723906:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653734528 00000100:00100000:2.0:1787119554.723908:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653734528 00000100:00100000:0.0:1787119554.723910:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787119554.723916:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653733632:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119554.723919:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787119554.723924:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653734528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787119554.723942:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00002000:00000024:0.0:1787119554.723943:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1787119554.723977:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653734528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119554.723977:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653733632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119554.723984:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787119554.724013:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653734528:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787119554.724029:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787119554.724033:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787119554.724035:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119554.724039:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653734272:0@lo:400:kworker.0 00000100:00100000:2.0:1787119554.724265:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653733888:0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.725903:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653734016:0@lo:400:kworker.0 00000100:00100000:3.0:1787119554.725926:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653733632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119554.728483:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:1.0:1787119555.553905:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119556.577635:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119557.522804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119557.522857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119557.522904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119557.522937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119557.522955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119557.522975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119557.522994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119557.523036:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633783296 00000100:00100000:0.0:1787119557.523046:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633783296 00000100:00100000:0.0:1787119557.523095:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633783552 00000100:00100000:0.0:1787119557.523098:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633783552 00000100:00100000:0.0:1787119557.523119:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633783168 00000100:00100000:0.0:1787119557.523121:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633783168 00000100:00100000:0.0:1787119557.523139:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633783680 00000100:00100000:0.0:1787119557.523142:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633783680 00000100:00100000:0.0:1787119557.523159:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 631 00000100:00100000:0.0:1787119557.523168:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633783296:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119557.523242:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2375:x1873929633783296:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 74us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119557.523251:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 631 00000100:00100000:0.0:1787119557.523280:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 632 00000100:00100000:0.0:1787119557.523288:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633783552:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119557.523313:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2375:x1873929633783552:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119557.523320:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 632 00000100:00100000:0.0:1787119557.523331:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 633 00000100:00100000:0.0:1787119557.523336:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633783168:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119557.523358:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633783168:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 21us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119557.523364:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 633 00000100:00100000:0.0:1787119557.523375:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 634 00000100:00100000:0.0:1787119557.523380:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633783680:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119557.523418:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633783680:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119557.523424:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 634 00000100:00100000:2.0:1787119557.523821:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633783040 00000100:00100000:2.0:1787119557.523827:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633783040 00000100:00100000:2.0:1787119557.523879:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633783424 00000100:00100000:2.0:1787119557.523883:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633783424 00000100:00100000:2.0:1787119557.523911:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 736 00000100:00100000:2.0:1787119557.523919:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633783040:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119557.523957:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2375:x1873929633783040:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 39us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119557.523963:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 736 00000100:00100000:2.0:1787119557.523977:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 737 00000100:00100000:2.0:1787119557.523983:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633783424:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119557.524373:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2375:x1873929633783424:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 388us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119557.524380:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 737 00000100:00100000:3.0:1787119557.524501:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633782912 00000100:00100000:3.0:1787119557.524506:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633782912 00000100:00100000:3.0:1787119557.524545:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 538 00000100:00100000:3.0:1787119557.524552:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633782912:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119557.524590:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2375:x1873929633782912:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 37us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119557.524597:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 538 00000100:00080000:1.0:1787119557.525475:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787119557.525483:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787119557.525485:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787119557.606119:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119558.625870:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119559.649721:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119559.842019:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653734656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119559.842114:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119559.842508:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653734656 00000100:00100000:2.0:1787119559.842519:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653734656 00000100:00100000:2.0:1787119559.842592:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787119559.842604:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653734656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787119559.842641:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:2.0:1787119559.842694:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653734656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119559.842701:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787119559.842723:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787119559.842733:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653734784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119559.842764:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119559.842909:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653734784 00000100:00100000:0.0:1787119559.842914:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653734784 00000100:00100000:0.0:1787119559.842955:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787119559.842963:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653734784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787119559.842984:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1787119559.843026:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653734784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119559.843032:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787119559.843308:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653734784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119559.843631:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653734656:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787119559.845255:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787119559.845265:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119559.845431:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653735040:0@lo:400:kworker.0 00000100:00100000:1.0:1787119559.845532:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119559.845589:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787119559.845596:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653735168:0@lo:400:kworker.0 00000100:00100000:1.0:1787119559.845620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119559.845654:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653735040 00000100:00100000:1.0:1787119559.845661:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653735040 00000100:00100000:1.0:1787119559.845703:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653735168 00000100:00100000:1.0:1787119559.845706:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653735168 00000100:00100000:1.0:1787119559.845733:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1787119559.845742:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653735040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119559.845811:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653735040:12345-0@lo:400:kworker.0 Request processed in 69us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119559.845818:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1787119559.845837:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1787119559.845843:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653735168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119559.845869:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653735168:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119559.845874:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00080000:1.0:1787119559.845896:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119559.845925:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653735168:0@lo:400:kworker.0 00000100:00100000:1.0:1787119559.845935:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653735040:0@lo:400:kworker.0 00000100:00100000:3.0:1787119559.846280:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653735296:0@lo:400:kworker.0 00000100:00100000:3.0:1787119559.846315:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119559.846347:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787119559.846353:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653734912:0@lo:400:kworker.0 00000100:00100000:3.0:1787119559.846395:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119559.848707:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653734912 00000100:00100000:1.0:1787119559.848725:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653734912 00000100:00100000:1.0:1787119559.848794:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1787119559.848804:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653734912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119559.848897:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653734912:12345-0@lo:400:kworker.0 Request processed in 94us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119559.848904:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1787119559.849321:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653735296 00000100:00100000:2.0:1787119559.849326:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653735296 00000100:00100000:2.0:1787119559.849385:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1787119559.849392:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653735296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119559.849434:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653735296:12345-0@lo:400:kworker.0 Request processed in 43us (3119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119559.849467:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1787119559.852379:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653734912:0@lo:400:kworker.0 00000100:00100000:1.0:1787119559.852407:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653735296:0@lo:400:kworker.0 00000100:00080000:3.0:1787119559.853831:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787119560.673854:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119561.699058:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119562.642737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119562.642786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119562.642824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119562.642848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119562.642866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119562.642887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119562.642911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119562.642940:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633784320 00000100:00100000:0.0:1787119562.642950:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633784320 00000100:00100000:0.0:1787119562.643008:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633783936 00000100:00100000:0.0:1787119562.643011:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633783936 00000100:00100000:0.0:1787119562.643034:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 741 00000100:00100000:0.0:1787119562.643044:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633784320:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119562.643119:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633784320:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 76us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119562.643126:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 741 00000100:00100000:0.0:1787119562.643143:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 742 00000100:00100000:0.0:1787119562.643149:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633783936:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119562.643173:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633783936:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119562.643178:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 742 00000100:00100000:3.0:1787119562.643274:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633784064 00000100:00100000:3.0:1787119562.643279:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633784064 00000100:00100000:3.0:1787119562.643307:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633784576 00000100:00100000:3.0:1787119562.643310:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633784576 00000100:00100000:3.0:1787119562.643340:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633784192 00000100:00100000:3.0:1787119562.643343:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633784192 00000100:00100000:3.0:1787119562.643360:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633784448 00000100:00100000:3.0:1787119562.643363:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633784448 00000100:00100000:3.0:1787119562.643377:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 635 00000100:00100000:3.0:1787119562.643384:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633784064:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119562.643412:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633784064:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 29us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119562.643419:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 635 00000100:00100000:3.0:1787119562.643430:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 636 00000100:00100000:3.0:1787119562.643435:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633784576:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119562.643486:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633784576:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 51us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119562.643492:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 636 00000100:00100000:3.0:1787119562.643502:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 637 00000100:00100000:3.0:1787119562.643525:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633784192:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119562.643549:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633784192:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 30us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119562.643554:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 637 00000100:00100000:3.0:1787119562.643564:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 638 00000100:00100000:3.0:1787119562.643569:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633784448:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119562.643587:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633784448:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 18us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119562.643592:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 638 00000100:00080000:3.0:1787119562.643607:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787119562.643611:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787119562.643613:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119562.644112:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633783808 00000100:00100000:2.0:1787119562.644119:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633783808 00000100:00100000:2.0:1787119562.644156:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 540 00000100:00100000:2.0:1787119562.644163:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633783808:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119562.644210:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633783808:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 47us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119562.644217:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 540 00010000:00010000:2.0:1787119562.722640:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119563.746736:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119564.769900:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119564.961815:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787119564.961841:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653735808:0@lo:400:kworker.0 00000100:00100000:1.0:1787119564.961926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119564.962004:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653735424:0@lo:400:kworker.0 00000100:00100000:1.0:1787119564.962035:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119564.962044:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653735552:0@lo:400:kworker.0 00000100:00100000:1.0:1787119564.962060:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787119564.962065:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653735936:0@lo:400:kworker.0 00000100:00100000:2.0:1787119564.962076:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119564.962091:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653735680:0@lo:400:kworker.0 00000100:00100000:3.0:1787119564.962142:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653735808 00000100:00100000:3.0:1787119564.962236:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653735808 00000100:00100000:3.0:1787119564.962303:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1787119564.962312:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653735808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119564.962513:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653735424 00000100:00100000:0.0:1787119564.962518:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653735424 00000100:00100000:0.0:1787119564.962545:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1787119564.962552:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653735424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119564.982016:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119564.982083:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653736192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787119564.982132:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119564.982191:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653736192 00000100:00100000:1.0:1787119564.982200:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653736192 00000100:00100000:1.0:1787119564.982248:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787119564.982257:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653736192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787119564.982455:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:1.0:1787119564.982508:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653736192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 251us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119564.982515:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787119564.982569:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653736192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787119564.982798:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653735552 00000100:00100000:1.0:1787119564.982803:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653735552 00000100:00100000:1.0:1787119564.982840:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653735680 00000100:00100000:1.0:1787119564.982843:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653735680 00000100:00100000:1.0:1787119564.982866:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1787119564.982873:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653735552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119564.982910:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653735552:12345-0@lo:400:kworker.0 Request processed in 38us (20833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119564.982917:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1787119564.982929:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1787119564.982935:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653735680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119564.982965:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653735680:12345-0@lo:400:kworker.0 Request processed in 30us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119564.982970:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1787119564.982998:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653735680:0@lo:400:kworker.0 00000100:00100000:1.0:1787119564.983078:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119564.983935:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653736320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119564.983982:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119564.984049:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653735936 00000100:00100000:1.0:1787119564.984054:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653735936 00000100:00100000:1.0:1787119564.984087:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00080000:3.0:1787119564.984840:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787119564.984845:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119564.984891:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653735808:12345-0@lo:400:kworker.0 Request processed in 22579us (22963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119564.984901:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1787119564.984943:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653735808:0@lo:400:kworker.0 00000100:00100000:3.0:1787119564.984980:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653736320 00000100:00100000:3.0:1787119564.984984:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653736320 00000100:00100000:3.0:1787119564.985016:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787119564.985024:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653736320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119564.985052:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1787119564.985090:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653736320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119564.985342:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653735936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119564.985383:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653735936:12345-0@lo:400:kworker.0 Request processed in 1290us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119564.985391:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:3.0:1787119564.985487:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:3.0:1787119564.985500:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119564.985523:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653736320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119564.985535:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653735936:0@lo:400:kworker.0 00000100:00100000:0.0:1787119564.991159:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653735424:12345-0@lo:400:kworker.0 Request processed in 28598us (29113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119564.991174:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1787119564.991559:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653735424:0@lo:400:kworker.0 00000100:00100000:2.0:1787119564.998722:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653735552:0@lo:400:kworker.0 00000100:00100000:2.0:1787119564.998740:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653736064:0@lo:400:kworker.0 00000100:00100000:2.0:1787119564.998804:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119564.999804:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653736064 00000100:00100000:3.0:1787119564.999814:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653736064 00000100:00100000:3.0:1787119564.999888:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1787119564.999898:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653736064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119564.999979:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653736064:12345-0@lo:400:kworker.0 Request processed in 83us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119564.999986:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1787119565.000164:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653736064:0@lo:400:kworker.0 00010000:00010000:1.0:1787119565.796692:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119566.822816:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119567.759628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119567.759668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119567.759697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119567.759739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119567.759760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119567.759802:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633784832 00000100:00100000:1.0:1787119567.759813:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633784832 00000100:00100000:0.0:1787119567.759848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119567.759875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119567.759893:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633785216 00000100:00100000:0.0:1787119567.759897:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633785216 00000100:00100000:1.0:1787119567.759936:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 746 00000100:00100000:1.0:1787119567.759947:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a512845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633784832:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119567.759969:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633785088 00000100:00100000:2.0:1787119567.759974:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633785088 00000100:00100000:2.0:1787119567.760001:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633785344 00000100:00100000:2.0:1787119567.760003:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633785344 00000100:00100000:2.0:1787119567.760018:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633784960 00000100:00100000:2.0:1787119567.760021:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633784960 00000100:00100000:2.0:1787119567.760043:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633785472 00000100:00100000:2.0:1787119567.760046:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633785472 00000100:00100000:2.0:1787119567.760065:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 641 00000100:00100000:2.0:1787119567.760073:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2376:x1873929633785088:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119567.760085:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a512845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633784832:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 138us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119567.760094:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 746 00000100:00100000:2.0:1787119567.760107:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2376:x1873929633785088:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 33us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119567.760115:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 641 00000100:00100000:1.0:1787119567.760126:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 747 00000100:00100000:2.0:1787119567.760135:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 642 00000100:00100000:1.0:1787119567.760138:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633785216:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119567.760147:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633785344:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119567.760171:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633785216:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 36us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119567.760178:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 747 00000100:00100000:2.0:1787119567.760182:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633785344:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 36us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119567.760190:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 642 00000100:00100000:3.0:1787119567.760260:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 643 00000100:00100000:3.0:1787119567.760275:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6072f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633784960:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119567.760303:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6072f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633784960:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 31us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119567.760309:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 643 00000100:00100000:3.0:1787119567.760323:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 644 00000100:00100000:3.0:1787119567.760329:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633785472:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119567.760364:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633785472:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 35us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119567.760370:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 644 00000100:00080000:0.0:1787119567.760711:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119567.760716:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119567.760718:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119567.760730:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633784704 00000100:00100000:0.0:1787119567.760735:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633784704 00000100:00100000:0.0:1787119567.760762:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 542 00000100:00100000:0.0:1787119567.760768:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633784704:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119567.760796:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633784704:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 27us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119567.760802:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 542 00010000:00010000:1.0:1787119567.842342:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119568.865670:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119569.889684:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119570.082062:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653736448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119570.082141:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787119570.082177:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653736576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119570.082187:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119570.082339:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787119570.082359:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653736704:0@lo:400:kworker.0 00000100:00100000:3.0:1787119570.082466:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119570.082528:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653736832:0@lo:400:kworker.0 00000100:00100000:3.0:1787119570.082560:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119570.082593:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653736448 00000100:00100000:3.0:1787119570.082601:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653736448 00000100:00100000:3.0:1787119570.082652:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653736576 00000100:00100000:3.0:1787119570.082656:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653736576 00000100:00100000:3.0:1787119570.082675:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787119570.082684:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653736448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787119570.082722:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00080000:0.0:1787119570.083752:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787119570.083765:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653736960:0@lo:400:kworker.0 00000100:00080000:0.0:1787119570.083867:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119570.083890:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787119570.083905:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653737088:0@lo:400:kworker.0 00000100:00100000:1.0:1787119570.084012:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119570.084281:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653736448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787119570.084349:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119570.084437:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653736832 00000100:00100000:2.0:1787119570.084483:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653736832 00000100:00100000:0.0:1787119570.084485:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787119570.084505:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653736576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787119570.084541:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1787119570.084556:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653736960 00000100:00100000:2.0:1787119570.084567:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653736960 00000100:00100000:2.0:1787119570.084621:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1787119570.084633:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653736832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119570.084677:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653736576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119570.084690:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787119570.084722:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653736832:12345-0@lo:400:kworker.0 Request processed in 90us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119570.084729:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653736704 00000100:00100000:2.0:1787119570.084736:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1787119570.084740:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653736704 00000100:00100000:2.0:1787119570.084773:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1787119570.084897:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1787119570.084906:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653736704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119570.084932:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653736960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119570.084988:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653736960:12345-0@lo:400:kworker.0 Request processed in 207us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119570.084996:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1787119570.085032:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653736448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2345us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119570.085041:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:2.0:1787119570.085162:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119570.085211:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653736832:0@lo:400:kworker.0 00000100:00100000:0.0:1787119570.086409:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653736704:12345-0@lo:400:kworker.0 Request processed in 1498us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119570.086421:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1787119570.086498:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119570.086561:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653736576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119570.086875:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653737088 00000100:00100000:0.0:1787119570.086882:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653737088 00000100:00100000:0.0:1787119570.087067:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1787119570.087077:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653737088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119570.087138:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653737088:12345-0@lo:400:kworker.0 Request processed in 63us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119570.087145:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1787119570.087176:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653737088:0@lo:400:kworker.0 00000100:00080000:3.0:1787119570.088407:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119570.088408:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653736704:0@lo:400:kworker.0 00000100:00100000:1.0:1787119570.088907:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653736960:0@lo:400:kworker.0 00010000:00010000:2.0:1787119570.914838:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119571.937728:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119572.879804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119572.879856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119572.879902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119572.879931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119572.879956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119572.879972:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633785600 00000100:00100000:2.0:1787119572.879979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119572.879982:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633785600 00000100:00100000:2.0:1787119572.880000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119572.880090:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633786112 00000100:00100000:2.0:1787119572.880094:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633786112 00000100:00100000:0.0:1787119572.882024:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 544 00000100:00100000:0.0:1787119572.882046:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633785600:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119572.882204:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633785600:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 167us (2409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119572.882213:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 544 00000100:00100000:2.0:1787119572.886078:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633785728 00000100:00100000:2.0:1787119572.886095:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633785728 00000100:00100000:1.0:1787119572.886209:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633785856 00000100:00100000:1.0:1787119572.886214:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633785856 00000100:00100000:1.0:1787119572.886258:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633786368 00000100:00100000:1.0:1787119572.886261:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633786368 00000100:00100000:1.0:1787119572.886291:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633785984 00000100:00100000:1.0:1787119572.886298:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633785984 00000100:00100000:1.0:1787119572.886323:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633786240 00000100:00100000:1.0:1787119572.886326:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633786240 00000100:00100000:1.0:1787119572.886349:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 645 00000100:00100000:1.0:1787119572.886360:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633785856:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119572.886460:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633785856:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 101us (6603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119572.886468:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 645 00000100:00100000:1.0:1787119572.886489:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 646 00000100:00100000:1.0:1787119572.886495:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633786368:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119572.886525:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633786368:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 30us (6593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119572.886531:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 646 00000100:00100000:1.0:1787119572.886542:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 647 00000100:00100000:1.0:1787119572.886547:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633785984:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119572.886583:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633785984:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 23us (6590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119572.886590:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 647 00000100:00100000:1.0:1787119572.886604:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 648 00000100:00100000:1.0:1787119572.886610:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633786240:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119572.886634:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633786240:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (6633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119572.886640:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 648 00000100:00080000:0.0:1787119572.889254:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119572.889266:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119572.889269:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119572.890236:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 751 00000100:00100000:3.0:1787119572.890265:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633786112:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119572.890416:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633786112:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 168us (10513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119572.890424:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 751 00000100:00100000:3.0:1787119572.890469:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 752 00000100:00100000:3.0:1787119572.890478:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633785728:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119572.890509:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633785728:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 32us (10551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119572.890795:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 752 00010000:00010000:2.0:1787119572.968176:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119573.985741:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119575.010424:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119575.201810:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787119575.201836:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653737216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119575.201927:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119575.202178:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653737216 00000100:00100000:3.0:1787119575.202186:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653737216 00000100:00100000:3.0:1787119575.202251:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787119575.202260:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653737216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119575.202295:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1787119575.202347:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653737216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119575.202354:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787119575.202400:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653737216:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787119575.202506:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787119575.202879:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653737728:0@lo:400:kworker.0 00000100:00100000:0.0:1787119575.202994:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653737344:0@lo:400:kworker.0 00000100:00100000:3.0:1787119575.203053:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653737472:0@lo:400:kworker.0 00000100:00100000:0.0:1787119575.211420:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119575.211504:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653737856:0@lo:400:kworker.0 00000100:00100000:0.0:1787119575.211557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119575.211587:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787119575.211596:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a506154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653737984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119575.211623:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119575.211821:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653737984 00000100:00100000:2.0:1787119575.211830:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653737984 00000100:00100000:3.0:1787119575.211924:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119575.211949:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653737344 00000100:00100000:0.0:1787119575.211953:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653737344 00000100:00100000:1.0:1787119575.212038:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119575.212073:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787119575.212081:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653737600:0@lo:400:kworker.0 00000100:00100000:1.0:1787119575.212124:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653737728 00000100:00100000:1.0:1787119575.212127:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653737728 00000100:00100000:1.0:1787119575.212158:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1787119575.212167:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653737728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119575.212228:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3312:x1873929653737728:12345-0@lo:400:kworker.0 Request processed in 62us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119575.212236:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1787119575.214225:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787119575.214243:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653737984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787119575.214282:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:2.0:1787119575.214364:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653737984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119575.214372:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787119575.216498:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653737856 00000100:00100000:3.0:1787119575.216512:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653737856 00000100:00100000:3.0:1787119575.216561:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653737472 00000100:00100000:3.0:1787119575.216564:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653737472 00000100:00100000:3.0:1787119575.216589:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1787119575.216598:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653737856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119575.216671:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653737856:12345-0@lo:400:kworker.0 Request processed in 75us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119575.216677:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1787119575.216694:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1787119575.216699:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653737472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119575.216734:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653737472:12345-0@lo:400:kworker.0 Request processed in 34us (4813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119575.216741:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1787119575.216784:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653737472:0@lo:400:kworker.0 00000100:00100000:2.0:1787119575.216972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119575.217020:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653737728:0@lo:400:kworker.0 00000100:00100000:2.0:1787119575.217044:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653737600 00000100:00100000:2.0:1787119575.217048:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653737600 00000100:00100000:2.0:1787119575.217082:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1787119575.217089:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653737600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119575.217141:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653737600:12345-0@lo:400:kworker.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119575.217147:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1787119575.217172:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653737600:0@lo:400:kworker.0 00000100:00080000:3.0:1787119575.220937:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787119575.220949:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119575.221024:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a506154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653737984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119575.221042:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653737856:0@lo:400:kworker.0 00000100:00100000:0.0:1787119575.222474:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1787119575.222496:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653737344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119575.222602:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653737344:12345-0@lo:400:kworker.0 Request processed in 116us (11190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119575.222610:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:3.0:1787119575.222837:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653737344:0@lo:400:kworker.0 00010000:00010000:1.0:1787119576.033757:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119577.060495:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119578.002896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119578.002937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119578.002980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119578.003008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119578.003026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119578.003052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119578.003087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119578.003113:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633787008 00000100:00100000:2.0:1787119578.003123:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633787008 00000100:00100000:2.0:1787119578.003180:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633786624 00000100:00100000:2.0:1787119578.003183:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633786624 00000100:00100000:2.0:1787119578.003207:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 756 00000100:00100000:2.0:1787119578.003218:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633787008:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119578.003288:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633787008:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 72us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119578.003295:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 756 00000100:00100000:2.0:1787119578.003313:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 757 00000100:00100000:2.0:1787119578.003318:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633786624:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119578.003343:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633786624:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119578.003348:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 757 00000100:00080000:2.0:1787119578.003371:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119578.003430:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633786496 00000100:00100000:1.0:1787119578.003434:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633786496 00000100:00100000:1.0:1787119578.003518:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 546 00000100:00100000:1.0:1787119578.003525:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633786496:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119578.003554:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633786496:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 30us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119578.003561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 546 00000100:00100000:1.0:1787119578.003588:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633786752 00000100:00100000:1.0:1787119578.003592:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633786752 00000100:00100000:1.0:1787119578.003619:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633787264 00000100:00100000:1.0:1787119578.003622:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633787264 00000100:00100000:1.0:1787119578.003639:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633786880 00000100:00100000:1.0:1787119578.003641:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633786880 00000100:00100000:1.0:1787119578.003657:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633787136 00000100:00100000:1.0:1787119578.003659:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633787136 00000100:00100000:1.0:1787119578.003673:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 650 00000100:00100000:1.0:1787119578.003679:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633786752:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119578.003705:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633786752:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119578.003712:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 650 00000100:00100000:1.0:1787119578.003861:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 651 00000100:00100000:1.0:1787119578.003868:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633787264:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119578.003892:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633787264:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119578.003898:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 651 00000100:00100000:1.0:1787119578.003908:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 652 00000100:00100000:1.0:1787119578.003914:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2376:x1873929633786880:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119578.003935:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a506154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2376:x1873929633786880:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 21us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119578.003941:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 652 00000100:00100000:1.0:1787119578.003953:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 653 00000100:00100000:1.0:1787119578.003959:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633787136:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119578.003983:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2376:x1873929633787136:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119578.003989:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 653 00000100:00080000:1.0:1787119578.004173:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787119578.004177:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787119578.082215:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119579.105688:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119580.129661:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119580.321782:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787119580.321803:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653738112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119580.321865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119580.322486:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653738112 00000100:00100000:3.0:1787119580.322494:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653738112 00000100:00080000:2.0:1787119580.322534:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119580.322553:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787119580.322563:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653738112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119580.322599:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1787119580.322615:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787119580.322625:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653738240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119580.322648:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653738112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119580.322653:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119580.322733:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653738112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119580.322910:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653738624:0@lo:400:kworker.0 00000100:00100000:1.0:1787119580.322937:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119580.322956:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787119580.322962:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653738752:0@lo:400:kworker.0 00000100:00100000:1.0:1787119580.322985:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119580.323012:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653738752 00000100:00100000:1.0:1787119580.323026:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653738752 00000100:00100000:1.0:1787119580.323063:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1787119580.323070:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653738752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119580.323107:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653738752:12345-0@lo:400:kworker.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119580.323113:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1787119580.323147:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653738752:0@lo:400:kworker.0 00000100:00100000:1.0:1787119580.323195:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653738624 00000100:00100000:1.0:1787119580.323198:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653738624 00000100:00100000:1.0:1787119580.323228:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1787119580.323235:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653738624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119580.323269:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653738624:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119580.323276:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1787119580.323302:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653738240 00000100:00100000:1.0:1787119580.323306:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653738240 00000100:00100000:3.0:1787119580.326633:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:2.0:1787119580.326648:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787119580.326655:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787119580.327011:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653738368:0@lo:400:kworker.0 00000100:00100000:2.0:1787119580.327101:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119580.327151:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653738880:0@lo:400:kworker.0 00000100:00100000:2.0:1787119580.327181:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119580.327208:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787119580.327215:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653738496:0@lo:400:kworker.0 00000100:00100000:2.0:1787119580.327239:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119580.327268:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653738368 00000100:00100000:2.0:1787119580.327275:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653738368 00000100:00100000:2.0:1787119580.327312:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1787119580.327326:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653738368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119580.327379:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653738368:12345-0@lo:400:kworker.0 Request processed in 60us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119580.327387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1787119580.327414:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653738880 00000100:00100000:2.0:1787119580.327417:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653738880 00000100:00100000:2.0:1787119580.327470:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653738496 00000100:00100000:2.0:1787119580.327474:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653738496 00000100:00100000:2.0:1787119580.327496:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1787119580.327503:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653738880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119580.327534:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653738880:12345-0@lo:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119580.327541:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1787119580.327554:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:2.0:1787119580.327560:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653738496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119580.327590:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653738496:12345-0@lo:400:kworker.0 Request processed in 30us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119580.327596:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00080000:2.0:1787119580.327623:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119580.327649:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653738496:0@lo:400:kworker.0 00000100:00100000:2.0:1787119580.327659:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653738368:0@lo:400:kworker.0 00000100:00100000:2.0:1787119580.327667:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653738880:0@lo:400:kworker.0 00000100:00100000:3.0:1787119580.327835:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653738624:0@lo:400:kworker.0 00000100:00100000:1.0:1787119580.328252:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787119580.328264:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653738240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787119580.328297:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:1.0:1787119580.328358:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653738240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (5703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119580.328365:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787119580.329198:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653738240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787119581.153784:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119582.179853:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119583.120008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119583.120054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119583.120093:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119583.120113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119583.120138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119583.120159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119583.120182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119583.120211:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633787648 00000100:00100000:3.0:1787119583.120219:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633787648 00000100:00100000:3.0:1787119583.120287:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633788160 00000100:00100000:3.0:1787119583.120291:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633788160 00000100:00100000:3.0:1787119583.120312:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633787776 00000100:00100000:3.0:1787119583.120315:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633787776 00000100:00100000:3.0:1787119583.120342:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633788032 00000100:00100000:3.0:1787119583.120345:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633788032 00000100:00100000:3.0:1787119583.120364:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 655 00000100:00100000:3.0:1787119583.120373:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633787648:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119583.120480:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633787648:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 107us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119583.120488:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 655 00000100:00100000:3.0:1787119583.120505:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 656 00000100:00100000:3.0:1787119583.120512:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633788160:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119583.120539:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633788160:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119583.120545:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 656 00000100:00100000:3.0:1787119583.120556:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 657 00000100:00100000:3.0:1787119583.120562:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633787776:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119583.120584:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633787776:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 22us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119583.120589:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 657 00000100:00100000:3.0:1787119583.120601:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 658 00000100:00100000:3.0:1787119583.120606:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633788032:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119583.120629:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633788032:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 22us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119583.120634:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 658 00000100:00080000:3.0:1787119583.120658:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787119583.120662:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119583.120790:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633787904 00000100:00100000:3.0:1787119583.120794:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633787904 00000100:00100000:3.0:1787119583.120826:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633787520 00000100:00100000:3.0:1787119583.120829:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633787520 00000100:00100000:3.0:1787119583.120850:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 761 00000100:00100000:3.0:1787119583.120857:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633787904:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119583.120891:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633787904:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 34us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119583.120898:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 761 00000100:00100000:3.0:1787119583.120910:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 762 00000100:00100000:3.0:1787119583.120918:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633787520:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119583.120938:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633787520:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 22us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119583.120953:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 762 00000100:00080000:3.0:1787119583.121006:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119583.121153:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633787392 00000100:00100000:2.0:1787119583.121157:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633787392 00000100:00100000:2.0:1787119583.121197:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 548 00000100:00100000:2.0:1787119583.121204:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633787392:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119583.121237:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633787392:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 34us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119583.121244:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 548 00010000:00010000:2.0:1787119583.203276:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119584.225673:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119585.250849:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119585.441690:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653739136:0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.441737:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873929653739264:0@lo:400:kworker.0 00000100:00100000:0.0:1787119585.441795:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653739008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119585.441862:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653739392:0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.449251:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119585.450502:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653739776:0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.450567:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119585.450601:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119585.450638:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653739520:0@lo:400:kworker.0 00000100:00100000:0.0:1787119585.450661:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119585.450703:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653739008 00000100:00100000:0.0:1787119585.450711:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653739008 00000100:00100000:0.0:1787119585.450769:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787119585.450779:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653739008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787119585.450819:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1787119585.450873:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653739008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119585.450881:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787119585.450902:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653739776 00000100:00100000:0.0:1787119585.450905:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653739776 00000100:00100000:0.0:1787119585.450925:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653739520 00000100:00100000:0.0:1787119585.450942:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653739520 00000100:00100000:0.0:1787119585.450966:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1787119585.450973:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653739776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119585.451006:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653739776:12345-0@lo:400:kworker.0 Request processed in 34us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119585.451012:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1787119585.451024:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1787119585.451029:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653739520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119585.451055:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653739520:12345-0@lo:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119585.451061:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1787119585.452136:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653739776:0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.452159:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787119585.452169:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653739648:0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.452216:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119585.452262:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653739264 00000100:00100000:2.0:1787119585.452267:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653739264 00000100:00100000:2.0:1787119585.454125:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653739648 00000100:00100000:2.0:1787119585.454137:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653739648 00000100:00100000:2.0:1787119585.454189:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1787119585.454199:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873929653739264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.454291:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873929653739264:12345-0@lo:400:kworker.0 Request processed in 94us (5047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119585.454305:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1787119585.454320:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1787119585.455451:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653739648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.455526:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653739648:12345-0@lo:400:kworker.0 Request processed in 1200us (3309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119585.455534:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1787119585.455626:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653739648:0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.456978:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873929653739264:0@lo:400:kworker.0 00000100:00080000:2.0:1787119585.458066:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787119585.458076:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787119585.458080:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119585.461031:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653739008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119585.461110:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653739520:0@lo:400:kworker.0 00000100:00100000:1.0:1787119585.472316:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119585.472416:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653739904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787119585.472482:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653739392 00000100:00100000:1.0:1787119585.472489:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119585.472493:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653739392 00000100:00080000:1.0:1787119585.472559:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119585.472565:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:2.0:1787119585.472577:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653739392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.472696:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653739392:12345-0@lo:400:kworker.0 Request processed in 122us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119585.472703:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1787119585.472943:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653739904 00000100:00100000:0.0:1787119585.472948:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653739904 00000100:00100000:0.0:1787119585.472988:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787119585.472997:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653739904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787119585.473027:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:0.0:1787119585.473063:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653739904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119585.473070:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787119585.474541:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119585.474677:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653739136 00000100:00100000:0.0:1787119585.474685:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653739136 00000100:00100000:0.0:1787119585.474736:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1787119585.474745:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653739136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119585.474811:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653739136:12345-0@lo:400:kworker.0 Request processed in 67us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119585.474819:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1787119585.475213:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653739136:0@lo:400:kworker.0 00000100:00100000:1.0:1787119585.476022:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653739392:0@lo:400:kworker.0 00000100:00100000:2.0:1787119585.476545:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653739904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787119586.278310:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119587.297974:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119588.241635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119588.241673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119588.241706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119588.241743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119588.241783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119588.241804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119588.241901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119588.241934:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633788672 00000100:00100000:3.0:1787119588.241944:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633788672 00000100:00100000:3.0:1787119588.241996:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633788928 00000100:00100000:3.0:1787119588.242000:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633788928 00000100:00100000:3.0:1787119588.242018:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633788544 00000100:00100000:3.0:1787119588.242021:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633788544 00000100:00100000:3.0:1787119588.242158:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633789056 00000100:00100000:3.0:1787119588.242162:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633789056 00000100:00100000:3.0:1787119588.242256:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 661 00000100:00100000:3.0:1787119588.242269:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633788672:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119588.242344:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633788672:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 77us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119588.242353:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 661 00000100:00100000:3.0:1787119588.242372:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 662 00000100:00100000:3.0:1787119588.242378:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633788928:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119588.242403:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633788928:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119588.242410:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 662 00000100:00100000:3.0:1787119588.242421:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 663 00000100:00100000:3.0:1787119588.242427:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633788544:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119588.242490:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633788544:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 62us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119588.242496:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 663 00000100:00100000:3.0:1787119588.242509:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 664 00000100:00100000:3.0:1787119588.242515:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633789056:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119588.242538:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633789056:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119588.242544:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 664 00000100:00080000:1.0:1787119588.242968:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787119588.242973:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119588.243109:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633788416 00000100:00100000:2.0:1787119588.243115:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633788416 00000100:00100000:2.0:1787119588.243180:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633788800 00000100:00100000:2.0:1787119588.243184:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633788800 00000100:00100000:2.0:1787119588.243213:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 766 00000100:00100000:0.0:1787119588.243218:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633788288 00000100:00100000:2.0:1787119588.243223:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633788416:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119588.243225:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633788288 00000100:00100000:0.0:1787119588.243266:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 550 00000100:00100000:0.0:1787119588.243275:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633788288:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119588.243278:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 767 00000100:00100000:2.0:1787119588.243278:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633788416:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 55us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119588.243291:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633788800:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119588.243292:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 766 00000100:00100000:0.0:1787119588.243307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633788288:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 33us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119588.243315:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 550 00000100:00100000:3.0:1787119588.243318:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633788800:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 31us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119588.243324:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 767 00000100:00080000:1.0:1787119588.243604:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787119588.322152:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119589.345749:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119590.370734:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119590.563392:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653740032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119590.563513:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119590.563940:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653740032 00000100:00100000:1.0:1787119590.563949:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653740032 00000100:00100000:1.0:1787119590.564044:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787119590.564054:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653740032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787119590.564091:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1787119590.564142:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653740032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119590.564150:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:3.0:1787119590.564327:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119590.564551:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787119590.564564:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653740160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787119590.564601:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119590.564689:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653740160 00000100:00100000:3.0:1787119590.564693:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653740160 00000100:00100000:3.0:1787119590.564742:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787119590.564751:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653740160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787119590.564771:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1787119590.564823:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653740160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119590.564830:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787119590.564880:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653740160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787119590.565156:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119590.566481:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653740032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119590.567225:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873929653740672:0@lo:400:kworker.0 00000100:00100000:2.0:1787119590.567310:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119590.567347:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787119590.567354:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653740288:0@lo:400:kworker.0 00000100:00100000:2.0:1787119590.567385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119590.567427:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653740672 00000100:00100000:2.0:1787119590.567433:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653740672 00000100:00100000:2.0:1787119590.567508:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1787119590.567518:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873929653740672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119590.567567:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873929653740672:12345-0@lo:400:kworker.0 Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119590.567573:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1787119590.567594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653740288 00000100:00100000:2.0:1787119590.567598:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653740288 00000100:00100000:2.0:1787119590.567637:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1787119590.567652:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653740288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119590.567691:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653740288:12345-0@lo:400:kworker.0 Request processed in 37us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119590.567698:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00080000:1.0:1787119590.567864:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119590.568206:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653740288:0@lo:400:kworker.0 00000100:00100000:2.0:1787119590.568224:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873929653740672:0@lo:400:kworker.0 00000100:00100000:0.0:1787119590.568315:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653740416:0@lo:400:kworker.0 00000100:00100000:0.0:1787119590.568344:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119590.568368:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787119590.568374:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63dfbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653740544:0@lo:400:kworker.0 00000100:00100000:0.0:1787119590.568392:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119590.568898:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653740416 00000100:00100000:2.0:1787119590.568903:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653740416 00000100:00100000:2.0:1787119590.569239:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653740544 00000100:00100000:2.0:1787119590.569243:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653740544 00000100:00080000:0.0:1787119590.569308:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119590.570924:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1787119590.570971:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653740416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119590.574273:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653740416:12345-0@lo:400:kworker.0 Request processed in 3330us (5918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119590.574289:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1787119590.574327:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1787119590.574341:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653740544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119590.574386:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653740544:12345-0@lo:400:kworker.0 Request processed in 51us (5993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119590.574393:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:0.0:1787119590.579152:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653740544:0@lo:400:kworker.0 00000100:00100000:0.0:1787119590.579172:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63dfb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653740416:0@lo:400:kworker.0 00010000:00010000:2.0:1787119591.394510:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119592.417671:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119593.362492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119593.362538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119593.362574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119593.362605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119593.362607:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633789184 00000100:00100000:0.0:1787119593.362620:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633789184 00000100:00100000:3.0:1787119593.362635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119593.362676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119593.362677:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 552 00000100:00100000:0.0:1787119593.362691:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633789184:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119593.362709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119593.362734:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633789440 00000100:00100000:3.0:1787119593.362739:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633789440 00000100:00100000:0.0:1787119593.362773:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633789184:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119593.362783:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633789952 00000100:00100000:0.0:1787119593.362784:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 552 00000100:00100000:3.0:1787119593.362789:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633789952 00000100:00100000:3.0:1787119593.362828:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633789568 00000100:00080000:0.0:1787119593.362831:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119593.362837:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787119593.362841:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633789568 00000100:00100000:3.0:1787119593.362870:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633789824 00000100:00100000:3.0:1787119593.362874:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633789824 00000100:00100000:3.0:1787119593.362903:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 665 00000100:00100000:3.0:1787119593.362912:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633789440:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119593.362946:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633789440:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 35us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119593.362954:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 665 00000100:00080000:0.0:1787119593.362962:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119593.362967:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787119593.362971:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 666 00000100:00100000:2.0:1787119593.363053:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633789696 00000100:00100000:2.0:1787119593.363058:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633789696 00000100:00100000:2.0:1787119593.363108:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633789312 00000100:00100000:2.0:1787119593.363112:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633789312 00000100:00100000:2.0:1787119593.363138:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 771 00000100:00100000:2.0:1787119593.363145:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633789696:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119593.363182:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633789696:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 37us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119593.363189:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 771 00000100:00100000:2.0:1787119593.363203:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 772 00000100:00100000:2.0:1787119593.363210:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633789312:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119593.363235:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633789312:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119593.363241:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 772 00000100:00100000:3.0:1787119593.364370:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633789952:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119593.364424:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633789952:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 65us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119593.369345:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 667 00000100:00100000:0.0:1787119593.369372:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633789568:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119593.369485:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633789568:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 127us (6822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119593.369494:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 667 00000100:00100000:0.0:1787119593.369529:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 668 00000100:00100000:0.0:1787119593.369538:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633789824:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119593.369567:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633789824:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 30us (6859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119593.369575:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 668 00000100:00080000:0.0:1787119593.369650:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119593.380857:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 666 00010000:00010000:2.0:1787119593.441732:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119594.466108:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119595.489657:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119595.681938:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653741056:0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.682012:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119595.682072:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653741568:0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.682101:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119595.682130:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787119595.682137:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653740928:0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.682164:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119595.682183:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653741440:0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.682207:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119595.682238:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653741056 00000100:00100000:3.0:1787119595.682245:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653741056 00000100:00100000:3.0:1787119595.682287:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653741440 00000100:00100000:3.0:1787119595.682290:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653741440 00000100:00100000:3.0:1787119595.682319:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1787119595.682327:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653741056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.682379:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653741056:12345-0@lo:400:kworker.0 Request processed in 52us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119595.682386:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1787119595.682402:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1787119595.682409:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653741440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.682436:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653741440:12345-0@lo:400:kworker.0 Request processed in 29us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119595.682463:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1787119595.682497:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653741440:0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.682507:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653741056:0@lo:400:kworker.0 00000100:00100000:2.0:1787119595.682590:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653740800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787119595.682624:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119595.682653:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653741312:0@lo:400:kworker.0 00000100:00100000:2.0:1787119595.682673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119595.682689:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787119595.682694:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653741184:0@lo:400:kworker.0 00000100:00100000:2.0:1787119595.682716:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119595.682740:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653741184 00000100:00100000:2.0:1787119595.682744:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653741184 00000100:00100000:3.0:1787119595.682915:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653740800 00000100:00100000:3.0:1787119595.682919:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653740800 00000100:00100000:3.0:1787119595.682948:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787119595.682955:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653740800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787119595.682983:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1787119595.683020:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653740800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119595.683026:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787119595.683077:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653740800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787119595.683413:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1787119595.683422:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653741184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119595.683487:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873929653741184:12345-0@lo:400:kworker.0 Request processed in 66us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119595.683493:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1787119595.683518:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873929653741184:0@lo:400:kworker.0 00000100:00080000:1.0:1787119595.687691:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787119595.687702:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119595.687721:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653740928 00000100:00100000:1.0:1787119595.687729:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653740928 00000100:00100000:2.0:1787119595.687829:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787119595.687847:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653741696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787119595.687923:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119595.690979:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653741568 00000100:00100000:0.0:1787119595.690994:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653741568 00000100:00100000:0.0:1787119595.692290:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653741312 00000100:00100000:0.0:1787119595.692298:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653741312 00000100:00100000:0.0:1787119595.692336:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1787119595.692490:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653741568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119595.692598:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653741568:12345-0@lo:400:kworker.0 Request processed in 253us (10495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119595.692607:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1787119595.693533:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1787119595.693547:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653741312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.693615:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653741696 00000100:00100000:0.0:1787119595.693615:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653741312:12345-0@lo:400:kworker.0 Request processed in 74us (10941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119595.693622:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653741696 00000100:00100000:3.0:1787119595.693657:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787119595.693664:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653741696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119595.693694:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1787119595.693732:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653741696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (5809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119595.693738:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787119595.693829:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1787119595.693837:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653741696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119595.693852:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653741312:0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.693891:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653741568:0@lo:400:kworker.0 00000100:00080000:0.0:1787119595.693901:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119595.697566:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1787119595.697590:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653740928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119595.699274:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653740928:0@lo:400:kworker.0 00000100:00100000:0.0:1787119595.707966:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653740928:12345-0@lo:400:kworker.0 Request processed in 10376us (25790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119595.707986:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00010000:00010000:1.0:1787119596.513819:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119597.538059:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119598.479193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119598.479237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119598.479264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119598.479294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119598.479508:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633790464 00000100:00100000:1.0:1787119598.479518:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633790464 00000100:00100000:1.0:1787119598.479572:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633790720 00000100:00100000:1.0:1787119598.479576:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633790720 00000100:00100000:1.0:1787119598.479601:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 671 00000100:00100000:1.0:1787119598.479611:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633790464:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119598.479683:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633790464:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 74us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119598.479690:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 671 00000100:00100000:1.0:1787119598.479738:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 672 00000100:00100000:1.0:1787119598.479745:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633790720:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119598.479772:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633790720:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119598.479779:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 672 00000100:00100000:3.0:1787119598.479921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119598.480006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119598.480094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119598.480115:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633790080 00000100:00100000:3.0:1787119598.480118:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633790080 00000100:00100000:3.0:1787119598.480143:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 554 00000100:00100000:3.0:1787119598.480149:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633790080:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119598.480176:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633790080:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 28us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119598.480182:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 554 00000100:00100000:3.0:1787119598.480206:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633790208 00000100:00100000:3.0:1787119598.480209:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633790208 00000100:00100000:3.0:1787119598.480228:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633790592 00000100:00100000:3.0:1787119598.480230:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633790592 00000100:00100000:3.0:1787119598.480246:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 776 00000100:00100000:3.0:1787119598.480251:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633790208:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119598.480387:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633790336 00000100:00100000:2.0:1787119598.480391:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633790336 00000100:00100000:2.0:1787119598.480412:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633790848 00000100:00100000:2.0:1787119598.480414:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633790848 00000100:00100000:2.0:1787119598.480430:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 673 00000100:00100000:2.0:1787119598.480435:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633790336:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119598.480478:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633790336:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 42us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119598.480484:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 673 00000100:00100000:2.0:1787119598.480495:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 674 00000100:00100000:2.0:1787119598.480500:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633790848:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119598.480518:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633790848:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 18us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119598.480523:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 674 00000100:00100000:2.0:1787119598.480540:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 777 00000100:00100000:2.0:1787119598.480546:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633790592:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119598.480566:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633790592:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 20us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119598.480571:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 777 00000100:00100000:3.0:1787119598.481208:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633790208:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 952us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119598.481219:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 776 00000100:00080000:3.0:1787119598.481257:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787119598.481262:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787119598.481264:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787119598.561772:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119599.586061:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119600.609769:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119600.801884:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653741824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119600.801988:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119600.802281:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653741824 00000100:00100000:3.0:1787119600.802291:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653741824 00000100:00100000:3.0:1787119600.802375:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787119600.802396:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653741824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119600.802465:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1787119600.802522:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653741824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119600.802531:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787119600.802571:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653742080:0@lo:400:kworker.0 00000100:00100000:3.0:1787119600.802578:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653742208:0@lo:400:kworker.0 00000100:00100000:0.0:1787119600.802621:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119600.802659:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787119600.802678:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653741952:0@lo:400:kworker.0 00000100:00100000:0.0:1787119600.802712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119600.802737:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653742464:0@lo:400:kworker.0 00000100:00080000:1.0:1787119600.802761:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119600.802785:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653742080 00000100:00100000:1.0:1787119600.802787:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a519d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653742336:0@lo:400:kworker.0 00000100:00100000:0.0:1787119600.802790:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653742080 00000100:00100000:1.0:1787119600.802824:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119600.802833:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1787119600.802854:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653742080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119600.802881:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653741824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119600.802916:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653742336 00000100:00100000:0.0:1787119600.802917:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653742080:12345-0@lo:400:kworker.0 Request processed in 62us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119600.802922:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653742336 00000100:00100000:1.0:1787119600.802960:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1787119600.802967:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653742336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119600.803001:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653742336:12345-0@lo:400:kworker.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119600.803008:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00080000:1.0:1787119600.803027:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119600.803042:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653742336:0@lo:400:kworker.0 00000100:00100000:1.0:1787119600.803071:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653741952 00000100:00100000:1.0:1787119600.803074:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653741952 00000100:00100000:1.0:1787119600.803100:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1787119600.803106:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653741952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119600.803137:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653741952:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119600.803143:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1787119600.803376:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1787119600.803733:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119600.803844:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119600.803883:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653742080:0@lo:400:kworker.0 00000100:00100000:1.0:1787119600.803901:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653741952:0@lo:400:kworker.0 00000100:00100000:1.0:1787119600.804047:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787119600.804057:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653742592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787119600.804092:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119600.804168:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653742592 00000100:00100000:2.0:1787119600.804174:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653742592 00000100:00100000:2.0:1787119600.804212:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787119600.804221:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653742592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787119600.804251:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:2.0:1787119600.804288:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653742592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119600.804295:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787119600.804361:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653742592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119600.804487:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653742208 00000100:00100000:3.0:1787119600.804492:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653742208 00000100:00100000:3.0:1787119600.804547:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653742464 00000100:00100000:3.0:1787119600.804550:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653742464 00000100:00100000:3.0:1787119600.804585:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1787119600.804592:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653742208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119600.804636:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653742208:12345-0@lo:400:kworker.0 Request processed in 45us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119600.804642:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1787119600.804656:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1787119600.804661:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653742464:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787119600.804856:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119600.804943:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873929653742464:12345-0@lo:400:kworker.0 Request processed in 281us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119600.804950:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1787119600.804980:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653742208:0@lo:400:kworker.0 00000100:00100000:1.0:1787119600.805050:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a519d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873929653742464:0@lo:400:kworker.0 00010000:00010000:2.0:1787119601.633802:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119602.658045:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119603.601657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119603.601710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119603.601817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633790976 00000100:00100000:2.0:1787119603.601831:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633790976 00000100:00100000:2.0:1787119603.601924:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 556 00000100:00100000:2.0:1787119603.601935:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633790976:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119603.602035:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633790976:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 102us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119603.602044:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 556 00000100:00100000:0.0:1787119603.603104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119603.603145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119603.603211:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633791488 00000100:00100000:2.0:1787119603.603219:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633791488 00000100:00100000:2.0:1787119603.603279:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 781 00000100:00100000:2.0:1787119603.603289:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633791488:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119603.603356:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633791488:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00080000:1.0:1787119603.603526:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119603.604534:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 781 00000100:00100000:0.0:1787119603.607043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119603.607085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119603.607161:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633791104 00000100:00100000:1.0:1787119603.607174:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633791104 00000100:00100000:1.0:1787119603.607262:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 782 00000100:00100000:1.0:1787119603.607275:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633791104:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119603.607387:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633791104:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 113us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119603.607397:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 782 00000100:00080000:1.0:1787119603.607430:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119603.612157:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633791232 00000100:00100000:3.0:1787119603.612178:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633791232 00000100:00100000:0.0:1787119603.612458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119603.612498:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633791744 00000100:00100000:0.0:1787119603.612503:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633791744 00000100:00100000:3.0:1787119603.612767:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633791360 00000100:00100000:3.0:1787119603.612772:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633791360 00000100:00100000:2.0:1787119603.613494:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633791616 00000100:00100000:2.0:1787119603.613504:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633791616 00000100:00080000:1.0:1787119603.616126:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787119603.616142:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119603.616335:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 676 00000100:00100000:1.0:1787119603.616774:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633791232:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119603.617172:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633791232:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 822us (15460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119603.617184:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 676 00000100:00100000:0.0:1787119603.617741:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 677 00000100:00100000:0.0:1787119603.617755:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633791744:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119603.617809:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633791744:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 59us (14663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119603.617816:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 677 00000100:00100000:2.0:1787119603.622218:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 678 00000100:00100000:2.0:1787119603.622237:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633791616:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119603.622354:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633791616:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 122us (9917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119603.623097:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 678 00000100:00100000:3.0:1787119603.624191:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 679 00000100:00100000:3.0:1787119603.624213:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633791360:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119603.626590:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633791360:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 2369us (19486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119603.626608:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 679 00010000:00010000:2.0:1787119603.683553:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119604.705975:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119605.729891:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119605.921884:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653742720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119605.921987:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119605.922383:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653742720 00000100:00100000:3.0:1787119605.922394:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653742720 00000100:00100000:3.0:1787119605.922518:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1787119605.922529:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653742720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119605.922575:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1787119605.922651:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653742720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119605.922658:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:2.0:1787119605.922842:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787119605.922849:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653742848:0@lo:400:kworker.0 00000100:00100000:1.0:1787119605.922898:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119605.922940:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653743360:0@lo:400:kworker.0 00000100:00100000:1.0:1787119605.922972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119605.923070:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787119605.923078:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653743232:0@lo:400:kworker.0 00000100:00100000:1.0:1787119605.923109:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119605.923142:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653742976:0@lo:400:kworker.0 00000100:00100000:1.0:1787119605.923169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119605.923218:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653742848 00000100:00100000:3.0:1787119605.923223:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653742848 00000100:00100000:3.0:1787119605.923259:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1787119605.923266:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653742848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119605.923311:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653742848:12345-0@lo:400:kworker.0 Request processed in 46us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119605.923318:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1787119605.923371:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653742848:0@lo:400:kworker.0 00000100:00100000:0.0:1787119605.923388:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653742720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119605.923415:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653743104:0@lo:400:kworker.0 00000100:00100000:0.0:1787119605.923415:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653743232 00000100:00100000:0.0:1787119605.923418:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653743232 00000100:00080000:3.0:1787119605.923476:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119605.923709:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1787119605.923719:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653743232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119605.923767:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653743232:12345-0@lo:400:kworker.0 Request processed in 51us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119605.923774:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1787119605.923804:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653743232:0@lo:400:kworker.0 00000100:00100000:1.0:1787119605.936101:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653743488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787119605.936209:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119605.936278:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653743488 00000100:00100000:1.0:1787119605.936288:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653743488 00000100:00100000:1.0:1787119605.936354:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787119605.936364:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653743488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787119605.936415:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:1.0:1787119605.936490:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653743488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119605.936512:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787119605.936589:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653743488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119605.936904:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119605.941736:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653743360 00000100:00100000:2.0:1787119605.941758:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653743360 00000100:00100000:2.0:1787119605.941877:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653742976 00000100:00100000:2.0:1787119605.941881:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653742976 00000100:00100000:2.0:1787119605.941918:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1787119605.941929:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653743360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119605.942322:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873929653743360:12345-0@lo:400:kworker.0 Request processed in 393us (19346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119605.942331:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1787119605.942353:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1787119605.942359:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653742976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119605.942398:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653742976:12345-0@lo:400:kworker.0 Request processed in 39us (19228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119605.942405:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1787119605.942568:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653742976:0@lo:400:kworker.0 00000100:00080000:2.0:1787119605.942641:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119605.942861:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873929653743360:0@lo:400:kworker.0 00000100:00100000:1.0:1787119605.953257:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653743104 00000100:00100000:1.0:1787119605.953280:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653743104 00000100:00100000:1.0:1787119605.953396:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1787119605.953407:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653743104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119605.953902:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653743104:12345-0@lo:400:kworker.0 Request processed in 494us (16996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119605.953912:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00080000:2.0:1787119605.954027:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119605.954316:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653743104:0@lo:400:kworker.0 00010000:00010000:1.0:1787119606.754753:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119607.777804:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119608.719776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119608.719831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119608.719876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119608.719911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119608.719939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119608.720095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119608.720121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119608.720163:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633792128 00000100:00100000:0.0:1787119608.720176:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633792128 00000100:00100000:0.0:1787119608.720245:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633792640 00000100:00100000:0.0:1787119608.720249:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633792640 00000100:00100000:0.0:1787119608.720270:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633792256 00000100:00100000:0.0:1787119608.720272:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633792256 00000100:00100000:0.0:1787119608.720288:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633792512 00000100:00100000:0.0:1787119608.720291:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633792512 00000100:00100000:0.0:1787119608.720312:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 681 00000100:00100000:0.0:1787119608.720323:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633792128:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119608.720426:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6068bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633792128:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 103us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119608.720434:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 681 00000100:00100000:0.0:1787119608.720522:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 682 00000100:00100000:0.0:1787119608.720529:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633792640:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119608.720570:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633792640:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 41us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119608.720577:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 682 00000100:00100000:3.0:1787119608.720704:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633792384 00000100:00100000:3.0:1787119608.720710:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633792384 00000100:00100000:3.0:1787119608.720744:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633792000 00000100:00100000:3.0:1787119608.720746:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633792000 00000100:00100000:3.0:1787119608.720770:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 786 00000100:00100000:3.0:1787119608.720778:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633792384:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119608.720812:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633792384:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 35us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119608.720819:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 786 00000100:00100000:3.0:1787119608.720831:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 787 00000100:00100000:3.0:1787119608.720838:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633792000:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119608.720863:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633792000:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119608.720869:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 787 00000100:00100000:3.0:1787119608.720893:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 683 00000100:00100000:3.0:1787119608.720900:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633792256:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119608.720926:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633792256:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 27us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119608.720933:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 683 00000100:00100000:3.0:1787119608.720945:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 684 00000100:00100000:3.0:1787119608.720964:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633792512:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119608.720991:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633792512:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 40us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119608.720997:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 684 00000100:00080000:2.0:1787119608.721384:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787119608.721391:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787119608.721393:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119608.723866:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633791872 00000100:00100000:1.0:1787119608.723890:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633791872 00000100:00100000:1.0:1787119608.723996:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 558 00000100:00100000:1.0:1787119608.724019:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633791872:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119608.724118:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633791872:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 100us (4356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119608.724125:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 558 00010000:00010000:1.0:1787119608.809725:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119609.825870:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119610.850264:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119611.042048:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787119611.042095:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653743616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787119611.042202:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119611.042608:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653744000:0@lo:400:kworker.0 00000100:00100000:0.0:1787119611.042650:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119611.042674:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787119611.042680:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653744128:0@lo:400:kworker.0 00000100:00100000:0.0:1787119611.042705:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119611.042787:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873929653743872:0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.042824:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119611.042860:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787119611.042866:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653743744:0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.042899:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119611.042923:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653744256:0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.042954:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119611.042989:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653744000 00000100:00100000:1.0:1787119611.042997:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653744000 00000100:00100000:1.0:1787119611.043064:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653744128 00000100:00100000:1.0:1787119611.043067:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653744128 00000100:00100000:1.0:1787119611.043102:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653743872 00000100:00100000:1.0:1787119611.043105:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653743872 00000100:00100000:1.0:1787119611.043129:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1787119611.043142:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653744000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.043215:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653744000:12345-0@lo:400:kworker.0 Request processed in 74us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119611.043224:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1787119611.043248:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1787119611.043254:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653744128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.043284:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653744128:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119611.043289:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1787119611.043300:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1787119611.043306:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873929653743872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.043339:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a519d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873929653743872:12345-0@lo:400:kworker.0 Request processed in 33us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119611.043345:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00080000:1.0:1787119611.043364:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119611.043414:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873929653743872:0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.043477:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653744128:0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.043487:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653744000:0@lo:400:kworker.0 00000100:00100000:3.0:1787119611.045517:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653743616 00000100:00100000:3.0:1787119611.045530:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653743616 00000100:00100000:3.0:1787119611.045609:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787119611.045620:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653743616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787119611.045667:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1787119611.045765:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653743616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119611.045773:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787119611.045809:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653743744 00000100:00100000:3.0:1787119611.045813:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653743744 00000100:00100000:3.0:1787119611.045839:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1787119611.045846:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653743744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119611.045882:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653743744:12345-0@lo:400:kworker.0 Request processed in 37us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119611.045889:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1787119611.045928:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653744256 00000100:00100000:3.0:1787119611.045932:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653744256 00000100:00100000:3.0:1787119611.045967:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1787119611.045974:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653744256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119611.046009:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653744256:12345-0@lo:400:kworker.0 Request processed in 36us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119611.046015:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00080000:0.0:1787119611.046277:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787119611.046283:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787119611.046500:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653744384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119611.046551:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119611.046609:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653743744:0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.046624:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653744256:0@lo:400:kworker.0 00000100:00100000:1.0:1787119611.046686:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653743616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119611.047900:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653744384 00000100:00100000:3.0:1787119611.047912:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653744384 00000100:00100000:3.0:1787119611.048033:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1787119611.048044:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653744384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787119611.048111:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1787119611.048205:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653744384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119611.048212:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787119611.048305:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653744384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787119611.874012:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119612.898168:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119613.844074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119613.844123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119613.844230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119613.844281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119613.844309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119613.844336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119613.844396:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633792768 00000100:00100000:3.0:1787119613.844411:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633792768 00000100:00100000:3.0:1787119613.844536:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 560 00000100:00100000:3.0:1787119613.844549:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633792768:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119613.844655:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633792768:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 109us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119613.844664:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 560 00000100:00100000:3.0:1787119613.844898:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633793152 00000100:00100000:3.0:1787119613.844903:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633793152 00000100:00100000:3.0:1787119613.844950:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633793408 00000100:00100000:3.0:1787119613.844954:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633793408 00000100:00100000:3.0:1787119613.844976:0:20843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633793024 00000100:00100000:3.0:1787119613.844978:0:20843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633793024 00000100:00100000:3.0:1787119613.845002:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 686 00000100:00100000:3.0:1787119613.845009:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633793152:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119613.845052:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633793152:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 44us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119613.845059:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 686 00000100:00100000:3.0:1787119613.845073:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 687 00000100:00100000:3.0:1787119613.845079:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633793408:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119613.845169:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633793408:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 90us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119613.845176:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 687 00000100:00100000:3.0:1787119613.845188:0:20843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 688 00000100:00100000:3.0:1787119613.845195:0:20843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633793024:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119613.845219:0:20843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633793024:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119613.845225:0:20843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 688 00000100:00080000:3.0:1787119613.845251:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787119613.845256:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119613.848190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119613.848357:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633793536 00000100:00100000:3.0:1787119613.848371:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633793536 00000100:00100000:3.0:1787119613.848500:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 689 00000100:00100000:3.0:1787119613.848513:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633793536:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119613.848623:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633793536:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 113us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119613.848634:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 689 00000100:00080000:2.0:1787119613.849386:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787119613.851800:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633792896 00000100:00100000:1.0:1787119613.851824:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633792896 00000100:00100000:1.0:1787119613.851957:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633793280 00000100:00100000:1.0:1787119613.851961:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633793280 00000100:00100000:1.0:1787119613.852022:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 791 00000100:00100000:1.0:1787119613.852035:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633792896:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119613.852151:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 792 00000100:00100000:1.0:1787119613.852158:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633792896:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 126us (8034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119613.852161:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633793280:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119613.852166:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 791 00000100:00100000:3.0:1787119613.852192:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633793280:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 33us (7854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119613.852198:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 792 00000100:00080000:2.0:1787119613.852483:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787119613.923629:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119614.945720:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119615.969631:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119616.162613:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653744512:0@lo:400:kworker.0 00000100:00100000:3.0:1787119616.162696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119616.162752:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653745024:0@lo:400:kworker.0 00000100:00100000:3.0:1787119616.162782:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119616.162812:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787119616.162818:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653744640:0@lo:400:kworker.0 00000100:00100000:3.0:1787119616.162844:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119616.162861:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653745152:0@lo:400:kworker.0 00000100:00100000:3.0:1787119616.162881:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119616.162906:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653744768:0@lo:400:kworker.0 00000100:00100000:3.0:1787119616.162928:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119616.162949:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787119616.162954:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a62041ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653744896:0@lo:400:kworker.0 00000100:00100000:3.0:1787119616.162977:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119616.164155:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653745024 00000100:00100000:0.0:1787119616.164168:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653745024 00000100:00100000:0.0:1787119616.164235:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653744640 00000100:00100000:0.0:1787119616.164239:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653744640 00000100:00100000:0.0:1787119616.164257:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653744768 00000100:00100000:0.0:1787119616.164260:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653744768 00000100:00100000:0.0:1787119616.164284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1787119616.164293:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653745024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.164379:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653745024:12345-0@lo:400:kworker.0 Request processed in 87us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119616.164771:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1787119616.164791:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1787119616.164799:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653744640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.164829:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873929653744640:12345-0@lo:400:kworker.0 Request processed in 32us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119616.164834:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1787119616.164843:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1787119616.164848:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653744768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.164884:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653744768:12345-0@lo:400:kworker.0 Request processed in 35us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119616.164889:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1787119616.164913:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653744512 00000100:00100000:0.0:1787119616.164917:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653744512 00000100:00100000:0.0:1787119616.164940:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1787119616.164946:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653744512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.164987:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653744512:12345-0@lo:400:kworker.0 Request processed in 41us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119616.164993:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1787119616.165069:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653745152 00000100:00100000:0.0:1787119616.165073:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653745152 00000100:00100000:0.0:1787119616.165101:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653744896 00000100:00100000:0.0:1787119616.165103:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653744896 00000100:00100000:0.0:1787119616.165121:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1787119616.165127:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653745152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.165159:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653745152:12345-0@lo:400:kworker.0 Request processed in 32us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119616.165166:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1787119616.165177:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1787119616.165183:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653744896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.165211:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653744896:12345-0@lo:400:kworker.0 Request processed in 29us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119616.165216:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1787119616.165275:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873929653744640:0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.165287:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653745152:0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.165296:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653744512:0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.165305:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653745024:0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.165696:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653744896:0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.165709:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a62041f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653744768:0@lo:400:kworker.0 00000100:00100000:0.0:1787119616.168551:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653745280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119616.168751:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119616.168790:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787119616.168796:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653745408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119616.168819:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119616.168858:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653745280 00000100:00100000:0.0:1787119616.168865:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653745280 00000100:00100000:0.0:1787119616.168915:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653745408 00000100:00100000:0.0:1787119616.168918:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653745408 00000100:00100000:0.0:1787119616.168935:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787119616.168942:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653745280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787119616.168981:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1787119616.169039:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653745280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119616.169046:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787119616.169064:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787119616.169069:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653745408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787119616.169089:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:0.0:1787119616.169116:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653745408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119616.169122:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787119616.169164:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653745408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119616.169178:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653745280:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787119616.178430:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787119616.178476:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787119616.178480:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787119616.994154:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119618.018598:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119618.964906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119618.964949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119618.964982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119618.965018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119618.965038:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119618.965053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119618.965094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119618.965148:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633794176 00000100:00100000:1.0:1787119618.965159:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633794176 00000100:00100000:3.0:1787119618.965206:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633793664 00000100:00100000:3.0:1787119618.965212:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633793664 00000100:00100000:1.0:1787119618.965224:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633793792 00000100:00100000:1.0:1787119618.965229:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633793792 00000100:00100000:3.0:1787119618.965252:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 562 00000100:00100000:1.0:1787119618.965261:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 796 00000100:00100000:3.0:1787119618.965267:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633793664:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119618.965276:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633794176:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119618.965354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633793664:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 92us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119618.965412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 562 00000100:00100000:1.0:1787119618.968929:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633794176:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 3640us (3928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119618.968947:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 796 00000100:00100000:1.0:1787119618.968989:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 797 00000100:00100000:1.0:1787119618.969002:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633793792:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119618.969125:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633793792:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 127us (4085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119618.969136:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 797 00000100:00080000:1.0:1787119618.969161:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119618.969272:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633793920 00000100:00100000:0.0:1787119618.969281:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633793920 00000100:00080000:0.0:1787119618.969311:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119618.969348:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633794432 00000100:00100000:0.0:1787119618.969352:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633794432 00000100:00100000:0.0:1787119618.969384:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633794048 00000100:00100000:0.0:1787119618.969387:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633794048 00000100:00100000:0.0:1787119618.969522:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633794304 00000100:00100000:0.0:1787119618.969526:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633794304 00000100:00100000:0.0:1787119618.969546:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 692 00000100:00100000:0.0:1787119618.969552:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633793920:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119618.969585:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633793920:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 33us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119618.969592:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 692 00000100:00100000:0.0:1787119618.969604:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 693 00000100:00100000:0.0:1787119618.969610:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633794432:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119618.969639:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63dc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633794432:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 28us (4620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119618.969645:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 693 00000100:00100000:0.0:1787119618.969656:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 694 00000100:00100000:0.0:1787119618.969662:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633794048:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119618.969687:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633794048:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (4633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119618.969693:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 694 00000100:00100000:0.0:1787119618.969703:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 695 00000100:00100000:0.0:1787119618.969708:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633794304:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119618.969732:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633794304:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 23us (4638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119618.969738:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 695 00000100:00080000:0.0:1787119618.969754:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119618.969757:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787119619.042881:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119620.066215:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119621.089688:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119621.282174:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653745792:0@lo:400:kworker.0 00000100:00100000:3.0:1787119621.282356:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653745536:0@lo:400:kworker.0 00000100:00100000:1.0:1787119621.282492:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653745920:0@lo:400:kworker.0 00000100:00100000:2.0:1787119621.292889:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653745664:0@lo:400:kworker.0 00000100:00100000:3.0:1787119621.293043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119621.293116:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653746048:0@lo:400:kworker.0 00000100:00100000:3.0:1787119621.293149:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119621.293184:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653746048 00000100:00100000:3.0:1787119621.293193:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653746048 00000100:00100000:3.0:1787119621.293276:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1787119621.293287:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653746048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119621.293350:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653746048:12345-0@lo:400:kworker.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119621.293360:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00080000:3.0:1787119621.293383:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119621.293420:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653746048:0@lo:400:kworker.0 00000100:00100000:3.0:1787119621.293484:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653745536 00000100:00100000:3.0:1787119621.293488:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653745536 00000100:00100000:3.0:1787119621.293513:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1787119621.293519:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653745536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119621.293553:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3313:x1873929653745536:12345-0@lo:400:kworker.0 Request processed in 34us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119621.293559:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1787119621.293593:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13a76f2e-afb8-44aa-9a00-b0908522ce08:3313:1873929653745536:0@lo:400:kworker.0 00000100:00100000:0.0:1787119621.296513:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119621.296598:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653746304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119621.296664:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119621.296704:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653746304 00000100:00100000:0.0:1787119621.296712:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653746304 00000100:00100000:0.0:1787119621.296788:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787119621.296800:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653746304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787119621.296841:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:0.0:1787119621.296885:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653746304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119621.296892:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787119621.296942:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653746304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787119621.296959:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787119621.296965:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653746432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119621.296989:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119621.297034:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653746432 00000100:00100000:0.0:1787119621.297038:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653746432 00000100:00100000:0.0:1787119621.297061:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787119621.297067:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653746432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787119621.297085:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:0.0:1787119621.297117:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653746432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119621.297123:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787119621.297151:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a509233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653746432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119621.302768:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653745792 00000100:00100000:3.0:1787119621.302786:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653745792 00000100:00100000:3.0:1787119621.302879:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1787119621.302901:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653745792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119621.303003:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653745792:12345-0@lo:400:kworker.0 Request processed in 114us (6496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119621.303010:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00080000:3.0:1787119621.303035:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787119621.303040:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787119621.303042:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119621.305033:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653745792:0@lo:400:kworker.0 00000100:00100000:1.0:1787119621.305880:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119621.306001:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653745920 00000100:00100000:0.0:1787119621.306011:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653745920 00000100:00100000:0.0:1787119621.306072:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1787119621.306081:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653745920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119621.306155:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653745920:12345-0@lo:400:kworker.0 Request processed in 74us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119621.306163:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1787119621.306264:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653745920:0@lo:400:kworker.0 00000100:00100000:2.0:1787119621.312039:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119621.312102:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a606156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653746176:0@lo:400:kworker.0 00000100:00100000:2.0:1787119621.312138:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119621.312263:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653745664 00000100:00100000:1.0:1787119621.312273:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653745664 00000100:00100000:1.0:1787119621.312345:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1787119621.312355:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653745664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119621.312431:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653745664:12345-0@lo:400:kworker.0 Request processed in 77us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119621.312467:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:3.0:1787119621.312629:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653745664:0@lo:400:kworker.0 00000100:00100000:0.0:1787119621.312825:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653746176 00000100:00100000:0.0:1787119621.312830:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653746176 00000100:00100000:0.0:1787119621.312873:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1787119621.312881:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653746176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119621.312931:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653746176:12345-0@lo:400:kworker.0 Request processed in 51us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119621.312938:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1787119621.313037:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a606156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653746176:0@lo:400:kworker.0 00010000:00010000:2.0:1787119622.113735:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119623.138017:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119624.079157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119624.079262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119624.079359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119624.079388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119624.079418:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633794560 00000100:00100000:3.0:1787119624.079548:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633795072 00000100:00100000:3.0:1787119624.079555:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633795072 00000100:00100000:3.0:1787119624.079620:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 801 00000100:00100000:3.0:1787119624.079633:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633795072:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119624.079731:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2374:x1873929633795072:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 101us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119624.079739:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 801 00000100:00080000:3.0:1787119624.079764:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787119624.080409:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633794560 00000100:00100000:1.0:1787119624.080497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 564 00000100:00100000:1.0:1787119624.080507:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633794560:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119624.080557:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2374:x1873929633794560:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 51us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119624.080564:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 564 00000100:00100000:2.0:1787119624.081644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119624.081680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119624.081720:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633794688 00000100:00100000:1.0:1787119624.081729:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633794688 00000100:00100000:1.0:1787119624.081777:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 802 00000100:00100000:1.0:1787119624.081786:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633794688:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119624.081839:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2374:x1873929633794688:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 55us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119624.081846:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 802 00000100:00080000:1.0:1787119624.081865:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119624.082203:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633794816 00000100:00100000:0.0:1787119624.082208:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633794816 00000100:00100000:0.0:1787119624.082257:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633795328 00000100:00100000:0.0:1787119624.082260:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633795328 00000100:00100000:0.0:1787119624.082293:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 698 00000100:00100000:0.0:1787119624.082301:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633794816:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119624.082338:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a509233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633794816:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 39us (3076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119624.082345:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 698 00000100:00100000:0.0:1787119624.082358:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 699 00000100:00100000:0.0:1787119624.082364:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633795328:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119624.082390:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633795328:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119624.082395:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 699 00000100:00080000:1.0:1787119624.083088:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787119624.083103:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787119624.084062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119624.084805:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633794944 00000100:00100000:1.0:1787119624.084817:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633794944 00000100:00100000:1.0:1787119624.084925:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633795200 00000100:00100000:1.0:1787119624.084930:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633795200 00000100:00080000:3.0:1787119624.084982:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787119624.084987:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119624.085028:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 700 00000100:00100000:0.0:1787119624.085042:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633794944:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119624.085125:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2374:x1873929633794944:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 87us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119624.085141:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 700 00000100:00100000:0.0:1787119624.085159:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 701 00000100:00100000:0.0:1787119624.085165:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633795200:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119624.085190:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2374:x1873929633795200:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119624.085196:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 701 00010000:00010000:2.0:1787119624.161766:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119625.196658:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119626.209735:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119626.401974:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787119626.402000:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653746560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787119626.402082:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119626.402181:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653746560 00000100:00100000:2.0:1787119626.402189:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653746560 00000100:00100000:2.0:1787119626.402254:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787119626.402263:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653746560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787119626.402297:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:2.0:1787119626.402340:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653746560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119626.402347:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787119626.402390:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653746560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119626.405883:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787119626.405906:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653746688:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787119626.405971:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787119626.405976:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119626.405983:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873929653746944:0@lo:400:kworker.0 00000100:00100000:3.0:1787119626.406014:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119626.406024:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653747072:0@lo:400:kworker.0 00000100:00100000:3.0:1787119626.406034:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787119626.406039:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653746816:0@lo:400:kworker.0 00000100:00100000:0.0:1787119626.406045:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119626.406063:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787119626.406067:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653747200:0@lo:400:kworker.0 00000100:00100000:3.0:1787119626.406068:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119626.406086:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653747328:0@lo:400:kworker.0 00000100:00100000:0.0:1787119626.406086:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119626.406106:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119626.406129:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653746688 00000100:00100000:3.0:1787119626.406131:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653746944 00000100:00100000:3.0:1787119626.406136:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653746944 00000100:00100000:0.0:1787119626.406136:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653746688 00000100:00100000:3.0:1787119626.406182:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653747072 00000100:00100000:3.0:1787119626.406186:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653747072 00000100:00100000:0.0:1787119626.406186:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787119626.406194:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653746688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119626.406204:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653747200 00000100:00100000:3.0:1787119626.406206:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653747200 00000100:00100000:3.0:1787119626.406224:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1787119626.406241:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873929653746944:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787119626.406242:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:3.0:1787119626.406283:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873929653746944:12345-0@lo:400:kworker.0 Request processed in 52us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119626.406283:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653746688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119626.406291:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:0.0:1787119626.406291:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787119626.406306:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:3.0:1787119626.406311:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653747072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119626.406313:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1787119626.406319:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653747200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119626.406338:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873929653747072:12345-0@lo:400:kworker.0 Request processed in 27us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119626.406341:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873929653747200:12345-0@lo:400:kworker.0 Request processed in 23us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119626.406350:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1787119626.406388:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873929653747200:0@lo:400:kworker.0 00000100:00100000:0.0:1787119626.406398:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873929653747072:0@lo:400:kworker.0 00000100:00100000:0.0:1787119626.406410:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653746688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119626.406414:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:3.0:1787119626.406434:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653746816 00000100:00100000:3.0:1787119626.406464:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653746816 00000100:00100000:0.0:1787119626.406508:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653747328 00000100:00100000:0.0:1787119626.406511:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653747328 00000100:00100000:0.0:1787119626.406538:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1787119626.406544:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653747328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119626.406577:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653747328:12345-0@lo:400:kworker.0 Request processed in 33us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119626.406582:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1787119626.406675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1787119626.406684:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653746816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119626.406717:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3312:x1873929653746816:12345-0@lo:400:kworker.0 Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119626.406723:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00080000:3.0:1787119626.406754:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787119626.406757:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787119626.406767:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13a76f2e-afb8-44aa-9a00-b0908522ce08:3312:1873929653746816:0@lo:400:kworker.0 00000100:00100000:2.0:1787119626.406778:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653747328:0@lo:400:kworker.0 00000100:00100000:2.0:1787119626.406787:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873929653746944:0@lo:400:kworker.0 00010000:00010000:1.0:1787119627.233705:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119628.257716:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787119629.203433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119629.203576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119629.203619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119629.203703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119629.203724:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633795712 00000100:00100000:0.0:1787119629.203724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119629.203734:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633795712 00000100:00100000:3.0:1787119629.203768:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633795456 00000100:00100000:3.0:1787119629.203773:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633795456 00000100:00100000:1.0:1787119629.203790:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633796224 00000100:00100000:1.0:1787119629.203793:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633796224 00000100:00100000:3.0:1787119629.203803:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 566 00000100:00100000:3.0:1787119629.203812:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633795456:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119629.203813:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 703 00000100:00100000:1.0:1787119629.203819:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633795712:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119629.203880:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633795712:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 61us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119629.203888:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 703 00000100:00100000:1.0:1787119629.203903:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 704 00000100:00100000:1.0:1787119629.203910:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633796224:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119629.215987:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633796224:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 12055us (12261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119629.216004:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 704 00000100:00080000:1.0:1787119629.216124:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787119629.216131:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787119629.216481:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633795968 00000100:00100000:2.0:1787119629.216503:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633795968 00000100:00080000:2.0:1787119629.216633:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119629.216681:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633795584 00000100:00100000:2.0:1787119629.216685:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633795584 00000100:00080000:2.0:1787119629.216699:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119629.216722:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 806 00000100:00100000:2.0:1787119629.216730:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633795968:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119629.216785:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2373:x1873929633795968:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 56us (13165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119629.216792:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 806 00000100:00100000:2.0:1787119629.216805:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 807 00000100:00100000:2.0:1787119629.216811:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633795584:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119629.216835:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2373:x1873929633795584:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 24us (13110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119629.216841:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 807 00000100:00100000:2.0:1787119629.216886:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633795456:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 13074us (13464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119629.216895:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 566 00000100:00100000:0.0:1787119629.218542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119629.218587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119629.218841:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633795840 00000100:00100000:2.0:1787119629.218850:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633795840 00000100:00100000:1.0:1787119629.219467:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633796096 00000100:00100000:1.0:1787119629.219474:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633796096 00000100:00100000:2.0:1787119629.219560:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 705 00000100:00100000:2.0:1787119629.219570:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633795840:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119629.219659:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+7:2373:x1873929633795840:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 77us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119629.219668:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 705 00000100:00080000:0.0:1787119629.226349:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119629.226364:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787119629.227243:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 706 00000100:00100000:1.0:1787119629.227259:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633796096:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119629.227347:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+8:2373:x1873929633796096:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 93us (8760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119629.227354:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 706 00010000:00010000:1.0:1787119629.283953:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119630.305663:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119631.334928:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119631.522555:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653747456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119631.522626:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119631.522841:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653747712:0@lo:400:kworker.0 00000100:00100000:2.0:1787119631.522874:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119631.522892:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787119631.522897:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653747584:0@lo:400:kworker.0 00000100:00100000:2.0:1787119631.522921:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119631.522934:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653748096:0@lo:400:kworker.0 00000100:00100000:2.0:1787119631.522948:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119631.522969:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653748096 00000100:00100000:2.0:1787119631.522976:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653748096 00000100:00100000:2.0:1787119631.523031:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1787119631.523040:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653748096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119631.523092:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653748096:12345-0@lo:400:kworker.0 Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119631.523100:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1787119631.523142:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653748096:0@lo:400:kworker.0 00000100:00100000:0.0:1787119631.523559:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653747840:0@lo:400:kworker.0 00000100:00100000:0.0:1787119631.523597:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119631.523631:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787119631.523638:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873929653747968:0@lo:400:kworker.0 00000100:00100000:0.0:1787119631.523664:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787119631.523705:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653747456 00000100:00100000:0.0:1787119631.523709:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653747456 00000100:00100000:0.0:1787119631.523742:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1787119631.523749:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653747456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787119631.523780:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323551232 pending 0 free 3854565376 avail 3852468224 00000100:00100000:0.0:1787119631.523814:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873929653747456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119631.523821:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1787119631.523841:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653747712 00000100:00100000:0.0:1787119631.523845:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653747712 00000100:00100000:0.0:1787119631.523866:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653747840 00000100:00100000:0.0:1787119631.523868:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653747840 00000100:00100000:0.0:1787119631.523883:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653747968 00000100:00100000:0.0:1787119631.523886:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653747968 00000100:00100000:0.0:1787119631.523907:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:0.0:1787119631.523913:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653747712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119631.523948:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873929653747712:12345-0@lo:400:kworker.0 Request processed in 35us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119631.523954:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:0.0:1787119631.523966:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1787119631.523972:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a606156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653747840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119631.524005:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a606156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873929653747840:12345-0@lo:400:kworker.0 Request processed in 33us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119631.524011:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1787119631.524021:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:0.0:1787119631.524026:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873929653747968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787119631.524052:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873929653747968:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119631.524056:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00080000:0.0:1787119631.524068:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787119631.524071:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787119631.524072:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119631.524092:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873929653747968:0@lo:400:kworker.0 00000100:00100000:0.0:1787119631.524102:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873929653747840:0@lo:400:kworker.0 00000100:00100000:0.0:1787119631.524129:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873929653747712:0@lo:400:kworker.0 00000100:00100000:3.0:1787119631.524401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653747584 00000100:00100000:3.0:1787119631.524406:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653747584 00000100:00100000:3.0:1787119631.524482:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1787119631.524489:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653747584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787119631.524528:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3314:x1873929653747584:12345-0@lo:400:kworker.0 Request processed in 40us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119631.524539:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1787119631.524595:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873929653747456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787119631.524818:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13a76f2e-afb8-44aa-9a00-b0908522ce08:3314:1873929653747584:0@lo:400:kworker.0 00000100:00100000:3.0:1787119631.536488:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787119631.536525:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653748224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119631.536620:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119631.536971:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653748224 00000100:00100000:2.0:1787119631.536980:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653748224 00000100:00100000:2.0:1787119631.537050:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787119631.537061:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653748224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787119631.537102:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 80084992 granted 820576256 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1787119631.537169:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653748224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119631.537178:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787119631.537510:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653748224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787119632.353708:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119633.378163:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00020000:1.0:1787119634.082221:0:5838:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 101s: evicting client at 192.168.201.59@tcp ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 8 pid: 20841 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787119634.127753:0:5838:0:(genops.c:1655:class_fail_export()) disconnecting export ffff92a506d5b800/d46c42c6-98a3-4170-b3f4-2388127f1660 00000020:00000080:1.0:1787119634.127769:0:5838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcaba3de8463dc7bd 00000020:00010000:1.0:1787119634.127779:0:5838:0:(genops.c:1942:obd_stale_export_put()) Put export ffff92a506d5b800: total 0 00000100:00080000:1.0:1787119634.127784:0:5838:0:(import.c:65:import_set_state_nolock()) ffff92a506d58800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787119634.127918:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968933 00000020:00080000:1.0:1787119634.128191:0:5838:0:(genops.c:1672:class_fail_export()) disconnected export ffff92a506d5b800/d46c42c6-98a3-4170-b3f4-2388127f1660 00010000:00020000:1.0:1787119634.128208:0:5838:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 101s: evicting client at 192.168.201.59@tcp ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 7 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787119634.128219:0:5838:0:(genops.c:1655:class_fail_export()) disconnecting export ffff92a509eb1800/93d672e6-b8e0-4996-8f5c-43d805e23cd1 00000020:00000080:1.0:1787119634.128224:0:5838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcaba3de8463db112 00000020:00010000:1.0:1787119634.128228:0:5838:0:(genops.c:1942:obd_stale_export_put()) Put export ffff92a509eb1800: total 0 00000100:00080000:1.0:1787119634.128231:0:5838:0:(import.c:65:import_set_state_nolock()) ffff92a509eb7800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787119634.130666:0:5836:0:(genops.c:1928:obd_stale_export_get()) Get export ffff92a506d5b800: total 0 00010000:00010000:2.0:1787119634.130739:0:5836:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92a506d5b800, canceled 0 locks, left on hash table 3. 00002000:00010000:2.0:1787119634.130775:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb size from disk: 0 -> 10 00002000:00010000:2.0:1787119634.130779:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb mtime from disk: 0 -> 1787119507 00002000:00010000:2.0:1787119634.130781:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb atime from disk: 0 -> 1787119509 00002000:00010000:2.0:1787119634.130783:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb ctime from disk: 0 -> 1787119507 00002000:00010000:2.0:1787119634.130785:0:5836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787119634.130822:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec6ef8e0/0xcaba3de8463e369e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715f05 expref: 5 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119634.130852:0:5836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1787119634.130863:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e83b97c0/0xcaba3de8463e3689 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715ef7 expref: 4 pid: 12469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787119634.130877:0:5836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb blocks from disk: 1 -> 1027 00010000:00010000:2.0:1787119634.130883:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 3 pid: 20841 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119634.130896:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=101s v=(2 0) 00010000:00010000:2.0:1787119634.130901:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787119634.130910:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000567df3e5/0xcaba3de8463e4afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170af expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119634.130921:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000567df3e5/0xcaba3de8463e4afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170af expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119634.133192:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000567df3e5/0xcaba3de8463e4afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170af expref: 7 pid: 20843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119634.133222:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414f480 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_01:lustre-OST0000_UUID:5836:1873929653748352:192.168.201.59@tcp:105: 00000100:00100000:2.0:1787119634.134188:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a61bfc3d80 going to sleep for 11 seconds 00000001:00000004:3.0:1787119634.136085:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969278 00000020:00080000:3.0:1787119634.136313:0:5838:0:(genops.c:1672:class_fail_export()) disconnected export ffff92a509eb1800/93d672e6-b8e0-4996-8f5c-43d805e23cd1 00000020:00010000:2.0:1787119634.136471:0:5837:0:(genops.c:1928:obd_stale_export_get()) Get export ffff92a509eb1800: total 0 00010000:00010000:2.0:1787119634.136484:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119634.141624:0:21353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119634.141630:0:21353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119634.141632:0:21353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787119634.142088:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92a509eb1800, canceled 0 locks, left on hash table 2. 00002000:00010000:3.0:1787119634.142129:0:5837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb size from disk: 0 -> 10 00002000:00010000:3.0:1787119634.142133:0:5837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb mtime from disk: 0 -> 1787119509 00002000:00010000:3.0:1787119634.142136:0:5837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb atime from disk: 0 -> 1787119509 00002000:00010000:3.0:1787119634.142138:0:5837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb ctime from disk: 0 -> 1787119509 00002000:00010000:3.0:1787119634.142141:0:5837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1787119634.142170:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbad708c/0xcaba3de8463e3700 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.59@tcp remote: 0xa889273204715f28 expref: 4 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787119634.142198:0:5837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb blocks from disk: 3 -> 1027 00010000:00010000:3.0:1787119634.142204:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 3 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119634.142217:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=101s v=(3 0) 00010000:00010000:3.0:1787119634.142221:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787119634.142230:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d244a24/0xcaba3de8463e4af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a8 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119634.142246:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d244a24/0xcaba3de8463e4af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a8 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119634.142288:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000d244a24/0xcaba3de8463e4af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a8 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119634.142302:0:5837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:lustre-OST0001_UUID:5837:1873929653748480:192.168.201.59@tcp:105: 00000100:00100000:3.0:1787119634.142374:0:5837:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a604ef0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787119634.146977:0:5837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eabc000 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:lustre-OST0001_UUID:5837:1873929653748480:192.168.201.59@tcp:105: 00010000:00010000:3.0:1787119634.147011:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734fbce5/0xcaba3de8463e4aef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa8892732047170a1 expref: 3 pid: 6693 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119634.147034:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92a509eb1800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787119634.147071:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787119634.147073:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787119634.147075:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119634.148735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119634.148945:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633796352 00000100:00100000:2.0:1787119634.148956:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633796352 00002000:00100000:2.0:1787119634.149040:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2c:0x0] (0->65535) req@ffff92a63eabc000 x1873929633796352/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.149054:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633796352 ext(0->65535) 00002000:00010000:2.0:1787119634.149061:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc000 00000100:00100000:2.0:1787119634.149096:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10805 00000100:00100000:2.0:1787119634.149116:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633796352:12345-192.168.201.59@tcp:3:kworker.0 00000100:00080000:1.0:1787119634.149390:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119634.150716:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414f480 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_01:lustre-OST0000_UUID:5836:1873929653748352:192.168.201.59@tcp:105: 00010000:00010000:0.0:1787119634.150749:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b174518e/0xcaba3de8463e4ae8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.59@tcp remote: 0xa88927320471709a expref: 3 pid: 20841 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119634.150775:0:5836:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92a506d5b800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1787119634.150811:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119634.150814:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119634.150816:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119634.160556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119634.160835:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633796480 00000100:00100000:1.0:1787119634.160846:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633796480 00002000:00100000:1.0:1787119634.160916:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (0->65535) req@ffff92a63414f800 x1873929633796480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.160928:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f800 with x1873929633796480 ext(0->65535) 00002000:00010000:1.0:1787119634.160934:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414f800 00000100:00100000:1.0:1787119634.160967:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10806 00000100:00100000:1.0:1787119634.160976:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633796480:12345-192.168.201.59@tcp:3:kworker.0 00000100:00080000:0.0:1787119634.161849:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787119634.201966:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633796352:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 52841us (53237us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1787119634.201979:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10805 00002000:00100000:2.0:1787119634.201992:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2c:0x0] (0->65535) req@ffff92a63eabc000 x1873929633796352/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.202002:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc000 with x1873929633796352 ext(0->65535) 00002000:00010000:2.0:1787119634.202008:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc000 00000100:00100000:1.0:1787119634.202863:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633796480:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 41884us (42314us total) trans 0 rc 65536/65536 00000100:00100000:1.0:1787119634.202874:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10806 00002000:00100000:1.0:1787119634.202882:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (0->65535) req@ffff92a63414f800 x1873929633796480/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.202892:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f800 with x1873929633796480 ext(0->65535) 00002000:00010000:1.0:1787119634.202897:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63414f800 00000100:00100000:2.0:1787119634.226173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.226272:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633796736 00000100:00100000:0.0:1787119634.226283:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633796736 00002000:00100000:0.0:1787119634.226331:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2c:0x0] (65536->102399) req@ffff92a63414f100 x1873929633796736/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.226344:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f100 with x1873929633796736 ext(65536->102399) 00002000:00010000:0.0:1787119634.226350:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414f100 00000100:00100000:0.0:1787119634.226385:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10807 00000100:00100000:0.0:1787119634.226395:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633796736:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.235723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119634.235959:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633796608 00000100:00100000:2.0:1787119634.235976:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633796608 00002000:00100000:2.0:1787119634.236026:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2d:0x0] (65536->102399) req@ffff92a508da4a80 x1873929633796608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.236038:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4a80 with x1873929633796608 ext(65536->102399) 00002000:00010000:2.0:1787119634.236046:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da4a80 00000100:00100000:2.0:1787119634.236083:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10808 00000100:00100000:2.0:1787119634.236092:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633796608:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119634.239576:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633796736:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 13172us (13402us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119634.239588:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10807 00002000:00100000:2.0:1787119634.239600:0:18547:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2c:0x0] (65536->102399) req@ffff92a63414f100 x1873929633796736/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.239610:0:18547:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63414f100 with x1873929633796736 ext(65536->102399) 00002000:00010000:2.0:1787119634.239616:0:18547:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63414f100 00000100:00100000:2.0:1787119634.243173:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633796608:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7071us (7450us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119634.243187:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10808 00002000:00100000:2.0:1787119634.243199:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2d:0x0] (65536->102399) req@ffff92a508da4a80 x1873929633796608/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.243211:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a508da4a80 with x1873929633796608 ext(65536->102399) 00002000:00010000:2.0:1787119634.243217:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a508da4a80 00000100:00100000:3.0:1787119634.248240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119634.248431:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633796864 00000100:00100000:1.0:1787119634.248488:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633796864 00002000:00100000:1.0:1787119634.248546:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2c:0x0] (102400->139263) req@ffff92a63eabed80 x1873929633796864/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.248559:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabed80 with x1873929633796864 ext(102400->139263) 00002000:00010000:1.0:1787119634.248565:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabed80 00000100:00100000:1.0:1787119634.248602:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10809 00000100:00100000:1.0:1787119634.248612:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633796864:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.254207:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633796864:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 5582us (5963us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119634.254224:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10809 00002000:00100000:1.0:1787119634.254237:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2c:0x0] (102400->139263) req@ffff92a63eabed80 x1873929633796864/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.254250:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabed80 with x1873929633796864 ext(102400->139263) 00002000:00010000:1.0:1787119634.254256:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabed80 00000100:00100000:0.0:1787119634.255783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119634.256046:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633796992 00000100:00100000:1.0:1787119634.256055:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633796992 00002000:00100000:1.0:1787119634.256114:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2d:0x0] (102400->139263) req@ffff92a62041ea00 x1873929633796992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.256125:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ea00 with x1873929633796992 ext(102400->139263) 00002000:00010000:1.0:1787119634.256131:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041ea00 00000100:00100000:1.0:1787119634.256163:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10810 00000100:00100000:1.0:1787119634.256172:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633796992:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119634.267683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119634.267815:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633797120 00000100:00100000:2.0:1787119634.267826:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633797120 00002000:00100000:2.0:1787119634.267875:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2c:0x0] (139264->176127) req@ffff92a62041d500 x1873929633797120/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.267886:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633797120 ext(139264->176127) 00002000:00010000:2.0:1787119634.267892:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d500 00000100:00100000:2.0:1787119634.267921:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10811 00000100:00100000:2.0:1787119634.267931:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633797120:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.268796:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633796992:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 12621us (13017us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119634.268806:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10810 00002000:00100000:1.0:1787119634.268815:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2d:0x0] (102400->139263) req@ffff92a62041ea00 x1873929633796992/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.268824:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041ea00 with x1873929633796992 ext(102400->139263) 00002000:00010000:1.0:1787119634.268828:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041ea00 00000100:00100000:2.0:1787119634.281920:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633797120:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 13978us (14235us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119634.281936:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10811 00002000:00100000:2.0:1787119634.281950:0:19242:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2c:0x0] (139264->176127) req@ffff92a62041d500 x1873929633797120/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.281971:0:19242:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041d500 with x1873929633797120 ext(139264->176127) 00002000:00010000:2.0:1787119634.281978:0:19242:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041d500 00000100:00100000:3.0:1787119634.289010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119634.289054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.289193:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633797376 00000100:00100000:0.0:1787119634.289205:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633797376 00002000:00100000:0.0:1787119634.289252:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (176128->212991) req@ffff92a63eabe680 x1873929633797376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.289264:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe680 with x1873929633797376 ext(176128->212991) 00002000:00010000:0.0:1787119634.289269:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabe680 00000100:00100000:0.0:1787119634.289295:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633797248 00000100:00100000:0.0:1787119634.289297:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633797248 00002000:00100000:0.0:1787119634.289313:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2d:0x0] (139264->176127) req@ffff92a63eabdf80 x1873929633797248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.289321:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdf80 with x1873929633797248 ext(139264->176127) 00002000:00010000:0.0:1787119634.289325:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabdf80 00000100:00100000:0.0:1787119634.289347:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10812 00000100:00100000:0.0:1787119634.289355:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633797376:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.289997:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10813 00000100:00100000:1.0:1787119634.290010:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633797248:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.296346:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633797376:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 6980us (7335us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119634.296360:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10812 00002000:00100000:1.0:1787119634.296374:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (176128->212991) req@ffff92a63eabe680 x1873929633797376/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.296385:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabe680 with x1873929633797376 ext(176128->212991) 00002000:00010000:1.0:1787119634.296391:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabe680 00000100:00100000:1.0:1787119634.297736:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633797248:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7719us (8671us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119634.297750:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10813 00002000:00100000:1.0:1787119634.297760:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2d:0x0] (139264->176127) req@ffff92a63eabdf80 x1873929633797248/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.297772:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabdf80 with x1873929633797248 ext(139264->176127) 00002000:00010000:1.0:1787119634.297778:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabdf80 00000100:00100000:0.0:1787119634.316574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119634.318125:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633797504 00000100:00100000:1.0:1787119634.318141:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633797504 00002000:00100000:1.0:1787119634.318197:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (212992->249855) req@ffff92a62041dc00 x1873929633797504/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.318209:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041dc00 with x1873929633797504 ext(212992->249855) 00002000:00010000:1.0:1787119634.318216:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041dc00 00000100:00100000:1.0:1787119634.318254:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10814 00000100:00100000:1.0:1787119634.318263:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633797504:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119634.321730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.321773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.321806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.321835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.321856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.321874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.321921:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633797888 00000100:00100000:0.0:1787119634.321930:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633797888 00000100:00100000:0.0:1787119634.321991:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633798144 00000100:00100000:0.0:1787119634.321994:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633798144 00000100:00100000:0.0:1787119634.322021:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 811 00000100:00100000:0.0:1787119634.322030:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633797888:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119634.322114:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:2376:x1873929633797888:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 85us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119634.322122:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 811 00000100:00100000:0.0:1787119634.322140:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 812 00000100:00100000:0.0:1787119634.322146:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633798144:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119634.322173:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633798144:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119634.322179:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 812 00000100:00100000:0.0:1787119634.322198:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633798016 00000100:00100000:0.0:1787119634.322201:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633798016 00000100:00100000:0.0:1787119634.322219:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633798272 00000100:00100000:0.0:1787119634.322221:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633798272 00000100:00100000:0.0:1787119634.322233:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5732 00000100:00100000:0.0:1787119634.322238:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2376:x1873929633798016:12345-192.168.201.59@tcp:400:kworker.0 00000020:00080000:0.0:1787119634.322244:0:6695:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.59@tcp 00000100:00100000:0.0:1787119634.322266:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2376:x1873929633798016:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 27us (409us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787119634.322272:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5732 00000100:00100000:0.0:1787119634.322282:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5733 00000100:00100000:0.0:1787119634.322286:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2376:x1873929633798272:12345-192.168.201.59@tcp:400:kworker.0 00000020:00080000:0.0:1787119634.322291:0:6695:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.59@tcp 00000100:00100000:0.0:1787119634.322306:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2376:x1873929633798272:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 19us (432us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787119634.322312:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5733 00000100:00080000:0.0:1787119634.322325:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787119634.322392:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2376:x1873929633797504:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 4130us (5830us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1787119634.322400:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10814 00002000:00100000:0.0:1787119634.322410:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (212992->249855) req@ffff92a62041dc00 x1873929633797504/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.322420:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041dc00 with x1873929633797504 ext(212992->249855) 00002000:00010000:0.0:1787119634.322425:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a62041dc00 00000100:00100000:0.0:1787119634.322475:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633797632 00000100:00100000:0.0:1787119634.322479:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633797632 00002000:00100000:0.0:1787119634.322503:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (176128->212991) req@ffff92a62041df80 x1873929633797632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.322511:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041df80 with x1873929633797632 ext(176128->212991) 00002000:00010000:0.0:1787119634.322514:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041df80 00000100:00100000:0.0:1787119634.322527:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10815 00000100:00100000:0.0:1787119634.322534:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633797632:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119634.323111:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633797760 00000100:00100000:2.0:1787119634.323118:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633797760 00000100:00100000:2.0:1787119634.323157:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 568 00000100:00100000:2.0:1787119634.323164:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633797760:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119634.323207:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2376:x1873929633797760:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 42us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119634.323214:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 568 00000100:00100000:1.0:1787119634.331317:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a62041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633797632:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 8770us (9584us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119634.331331:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10815 00002000:00100000:1.0:1787119634.331344:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (176128->212991) req@ffff92a62041df80 x1873929633797632/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.331354:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a62041df80 with x1873929633797632 ext(176128->212991) 00002000:00010000:1.0:1787119634.331362:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a62041df80 00000100:00100000:3.0:1787119634.355483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119634.355521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119634.355554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119634.355644:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633798400 00000100:00100000:1.0:1787119634.355655:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633798400 00000100:00100000:1.0:1787119634.355701:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633798528 00000100:00100000:1.0:1787119634.355704:0:8267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633798528 00000100:00100000:1.0:1787119634.355722:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5734 00000100:00100000:1.0:1787119634.355730:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2372:x1873929633798400:12345-192.168.201.59@tcp:8:ptlrpcd_01_01.0 00010000:00080000:1.0:1787119634.355761:0:8267:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp t0 exp 0000000000000000 cur 1160 last 0 00000020:00000080:1.0:1787119634.355792:0:8267:0:(genops.c:1406:class_connect()) connect: client 93d672e6-b8e0-4996-8f5c-43d805e23cd1, cookie 0xcaba3de8463e4b0b 00002000:00100000:1.0:1787119634.355804:0:8267:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 93d672e6-b8e0-4996-8f5c-43d805e23cd1/ffff92a60ceff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 2097152 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787119634.355828:0:8267:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:1.0:1787119634.355928:0:8267:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787119634.355957:0:8267:0:(import.c:65:import_set_state_nolock()) ffff92a60cefb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787119634.356031:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+6:2372:x1873929633798400:12345-192.168.201.59@tcp:8:ptlrpcd_01_01.0 Request processed in 300us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119634.356038:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5734 00000100:00100000:1.0:1787119634.356059:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5735 00000100:00100000:1.0:1787119634.356064:0:8267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2372:x1873929633798528:12345-192.168.201.59@tcp:8:ptlrpcd_01_01.0 00010000:00080000:1.0:1787119634.356079:0:8267:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp t0 exp 0000000000000000 cur 1160 last 0 00000020:00000080:1.0:1787119634.356108:0:8267:0:(genops.c:1406:class_connect()) connect: client d46c42c6-98a3-4170-b3f4-2388127f1660, cookie 0xcaba3de8463e4b12 00002000:00100000:1.0:1787119634.356114:0:8267:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d46c42c6-98a3-4170-b3f4-2388127f1660/ffff92a60cefd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 2097152 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787119634.356129:0:8267:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:1.0:1787119634.356179:0:8267:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787119634.356195:0:8267:0:(import.c:65:import_set_state_nolock()) ffff92a505cbc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787119634.356221:0:8267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2372:x1873929633798528:12345-192.168.201.59@tcp:8:ptlrpcd_01_01.0 Request processed in 155us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119634.356227:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5735 00000100:00100000:0.0:1787119634.356469:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633798656 00000100:00100000:0.0:1787119634.356474:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633798656 00002000:00100000:0.0:1787119634.356505:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (249856->286719) req@ffff92a63eabca80 x1873929633798656/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.356522:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabca80 with x1873929633798656 ext(249856->286719) 00002000:00010000:0.0:1787119634.356527:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabca80 00000100:00100000:0.0:1787119634.356545:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10816 00000100:00100000:0.0:1787119634.356553:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633798656:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119634.378345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119634.378558:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633798656:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 22004us (23000us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119634.378571:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10816 00002000:00100000:2.0:1787119634.378585:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (249856->286719) req@ffff92a63eabca80 x1873929633798656/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.378598:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabca80 with x1873929633798656 ext(249856->286719) 00002000:00010000:2.0:1787119634.378605:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabca80 00000100:00100000:2.0:1787119634.378632:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633798784 00000100:00100000:2.0:1787119634.378639:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633798784 00002000:00100000:2.0:1787119634.378673:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2d:0x0] (212992->249855) req@ffff92a634967100 x1873929633798784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.378682:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967100 with x1873929633798784 ext(212992->249855) 00002000:00010000:2.0:1787119634.378686:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634967100 00000100:00100000:2.0:1787119634.378715:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10817 00000100:00100000:2.0:1787119634.378725:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633798784:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119634.401757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.401913:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633798912 00000100:00100000:0.0:1787119634.401922:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633798912 00002000:00100000:0.0:1787119634.401980:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2c:0x0] (286720->323583) req@ffff92a63eabd180 x1873929633798912/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.401991:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd180 with x1873929633798912 ext(286720->323583) 00002000:00010000:0.0:1787119634.401997:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd180 00000100:00100000:0.0:1787119634.402044:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10818 00000100:00100000:0.0:1787119634.402054:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633798912:12345-192.168.201.59@tcp:3:kworker.0 00010000:00010000:1.0:1787119634.402667:0:21353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787119634.414020:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2374:x1873929633798784:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 35285us (35672us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119634.414034:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10817 00002000:00100000:2.0:1787119634.414046:0:19255:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2d:0x0] (212992->249855) req@ffff92a634967100 x1873929633798784/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.414057:0:19255:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967100 with x1873929633798784 ext(212992->249855) 00002000:00010000:2.0:1787119634.414064:0:19255:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a634967100 00000100:00100000:2.0:1787119634.415263:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633798912:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 13204us (13510us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119634.415274:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10818 00002000:00100000:2.0:1787119634.415284:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2c:0x0] (286720->323583) req@ffff92a63eabd180 x1873929633798912/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.415295:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd180 with x1873929633798912 ext(286720->323583) 00002000:00010000:2.0:1787119634.415300:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabd180 00000100:00100000:3.0:1787119634.423291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119634.423334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.423436:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633799040 00000100:00100000:0.0:1787119634.423486:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633799040 00002000:00100000:0.0:1787119634.423538:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2d:0x0] (249856->286719) req@ffff92a63eabc380 x1873929633799040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.423549:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc380 with x1873929633799040 ext(249856->286719) 00002000:00010000:0.0:1787119634.423555:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabc380 00000100:00100000:0.0:1787119634.423583:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633799168 00000100:00100000:0.0:1787119634.423586:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633799168 00002000:00100000:0.0:1787119634.423602:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2c:0x0] (323584->360447) req@ffff92a63eabce00 x1873929633799168/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.423617:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabce00 with x1873929633799168 ext(323584->360447) 00002000:00010000:0.0:1787119634.423620:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabce00 00000100:00100000:0.0:1787119634.423636:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10819 00000100:00100000:0.0:1787119634.423645:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633799040:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.424140:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10820 00000100:00100000:1.0:1787119634.424152:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633799168:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.464170:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633799168:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 40009us (40822us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119634.464185:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10820 00002000:00100000:1.0:1787119634.464198:0:6699:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (323584->360447) req@ffff92a63eabce00 x1873929633799168/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.464208:0:6699:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabce00 with x1873929633799168 ext(323584->360447) 00002000:00010000:1.0:1787119634.464215:0:6699:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabce00 00000100:00100000:2.0:1787119634.464951:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2376:x1873929633799040:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 41302us (41678us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119634.464970:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10819 00002000:00100000:2.0:1787119634.465186:0:18546:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2d:0x0] (249856->286719) req@ffff92a63eabc380 x1873929633799040/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.465196:0:18546:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc380 with x1873929633799040 ext(249856->286719) 00002000:00010000:2.0:1787119634.465200:0:18546:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabc380 00000100:00100000:0.0:1787119634.472333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119634.472512:0:20838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633799296 00000100:00100000:1.0:1787119634.472523:0:20838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633799296 00002000:00100000:1.0:1787119634.472572:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2c:0x0] (360448->397311) req@ffff92a634967b80 x1873929633799296/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.472590:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967b80 with x1873929633799296 ext(360448->397311) 00002000:00010000:1.0:1787119634.472596:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634967b80 00000100:00100000:1.0:1787119634.472629:0:20838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10821 00000100:00100000:1.0:1787119634.472638:0:20838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a634967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633799296:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:3.0:1787119634.479782:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119634.480081:0:20836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633799424 00000100:00100000:2.0:1787119634.480092:0:20836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633799424 00002000:00100000:2.0:1787119634.480153:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2d:0x0] (286720->323583) req@ffff92a63eabea00 x1873929633799424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.480164:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabea00 with x1873929633799424 ext(286720->323583) 00002000:00010000:2.0:1787119634.480170:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabea00 00000100:00100000:2.0:1787119634.480206:0:20836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10822 00000100:00100000:2.0:1787119634.480216:0:20836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633799424:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:2.0:1787119634.500585:0:20836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633799424:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 20361us (20804us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1787119634.500600:0:20836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10822 00002000:00100000:2.0:1787119634.500613:0:20836:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2d:0x0] (286720->323583) req@ffff92a63eabea00 x1873929633799424/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1787119634.500624:0:20836:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabea00 with x1873929633799424 ext(286720->323583) 00002000:00010000:2.0:1787119634.500630:0:20836:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabea00 00000100:00100000:1.0:1787119634.500921:0:20838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a634967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2375:x1873929633799296:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 28282us (28596us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119634.500929:0:20838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10821 00002000:00100000:1.0:1787119634.500936:0:20838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2c:0x0] (360448->397311) req@ffff92a634967b80 x1873929633799296/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.500944:0:20838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a634967b80 with x1873929633799296 ext(360448->397311) 00002000:00010000:1.0:1787119634.500948:0:20838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a634967b80 00000100:00100000:0.0:1787119634.505332:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119634.505427:0:19243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633799552 00000100:00100000:1.0:1787119634.505471:0:19243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633799552 00002000:00100000:1.0:1787119634.505522:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (323584->360447) req@ffff92a63eb2aa00 x1873929633799552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.505535:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2aa00 with x1873929633799552 ext(323584->360447) 00002000:00010000:1.0:1787119634.505540:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2aa00 00000100:00100000:1.0:1787119634.505575:0:19243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10823 00000100:00100000:1.0:1787119634.505584:0:19243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633799552:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.508759:0:19243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633799552:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 3164us (3427us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119634.508773:0:19243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10823 00002000:00100000:1.0:1787119634.508786:0:19243:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (323584->360447) req@ffff92a63eb2aa00 x1873929633799552/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.508798:0:19243:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eb2aa00 with x1873929633799552 ext(323584->360447) 00002000:00010000:1.0:1787119634.508804:0:19243:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eb2aa00 00000100:00100000:3.0:1787119634.517222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119634.520027:0:20606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633799680 00000100:00100000:1.0:1787119634.520043:0:20606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633799680 00002000:00100000:1.0:1787119634.520110:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2c:0x0] (397312->409599) req@ffff92a63eabc700 x1873929633799680/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.520123:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633799680 ext(397312->409599) 00002000:00010000:1.0:1787119634.520129:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc700 00000100:00100000:1.0:1787119634.520165:0:20606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10824 00000100:00100000:1.0:1787119634.520175:0:20606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633799680:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.520403:0:20606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2374:x1873929633799680:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 229us (3191us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1787119634.520412:0:20606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10824 00002000:00100000:1.0:1787119634.520418:0:20606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2c:0x0] (397312->409599) req@ffff92a63eabc700 x1873929633799680/t0(0) o3->d46c42c6-98a3-4170-b3f4-2388127f1660@192.168.201.59@tcp:670/0 lens 488/12728 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.520427:0:20606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabc700 with x1873929633799680 ext(397312->409599) 00002000:00010000:1.0:1787119634.520430:0:20606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92a63eabc700 00000100:00100000:3.0:1787119634.528129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119634.528386:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633799808 00000100:00100000:1.0:1787119634.528397:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633799808 00002000:00100000:1.0:1787119634.528484:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2d:0x0] (360448->397311) req@ffff92a63eabd500 x1873929633799808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.528495:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd500 with x1873929633799808 ext(360448->397311) 00002000:00010000:1.0:1787119634.528502:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabd500 00000100:00100000:1.0:1787119634.528537:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10825 00000100:00100000:1.0:1787119634.528547:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633799808:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:1.0:1787119634.535705:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2375:x1873929633799808:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 7148us (7575us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1787119634.535719:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10825 00002000:00100000:1.0:1787119634.535731:0:18555:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2d:0x0] (360448->397311) req@ffff92a63eabd500 x1873929633799808/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/440 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1787119634.535743:0:18555:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a63eabd500 with x1873929633799808 ext(360448->397311) 00002000:00010000:1.0:1787119634.535749:0:18555:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a63eabd500 00000100:00100000:3.0:1787119634.538173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119634.543757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.544341:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633800192 00000100:00100000:0.0:1787119634.544351:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633800192 00002000:00100000:0.0:1787119634.544402:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2d:0x0] (397312->409599) req@ffff92a511f57800 x1873929633800192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/0 e 0 to 0 dl 1787119645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.544413:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633800192 ext(397312->409599) 00002000:00010000:0.0:1787119634.544419:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f57800 00000100:00100000:0.0:1787119634.544485:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 10826 00000100:00100000:0.0:1787119634.544495:0:18579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633800192:12345-192.168.201.59@tcp:3:kworker.0 00000100:00100000:0.0:1787119634.544727:0:18579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633800192:12345-192.168.201.59@tcp:3:kworker.0 Request processed in 232us (980us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1787119634.544735:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 10826 00002000:00100000:0.0:1787119634.544742:0:18579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2d:0x0] (397312->409599) req@ffff92a511f57800 x1873929633800192/t0(0) o3->93d672e6-b8e0-4996-8f5c-43d805e23cd1@192.168.201.59@tcp:670/0 lens 488/12728 e 0 to 0 dl 1787119645 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1787119634.544751:0:18579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92a511f57800 with x1873929633800192 ext(397312->409599) 00002000:00010000:0.0:1787119634.544754:0:18579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92a511f57800 00000100:00100000:2.0:1787119634.547152:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633800064 00000100:00100000:2.0:1787119634.547165:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633800064 00000100:00100000:2.0:1787119634.547233:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 231 00000100:00100000:2.0:1787119634.547243:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+18:33961:x1873929633800064:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1787119634.547607:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33961:x1873929633800064:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 363us (9440us total) trans 4294976620 rc 0/0 00000100:00100000:2.0:1787119634.547615:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 231 00000100:00100000:3.0:1787119634.560112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119634.562213:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633800448 00000100:00100000:0.0:1787119634.562230:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633800448 00000100:00100000:0.0:1787119634.562305:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 232 00000100:00100000:0.0:1787119634.562317:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+19:33961:x1873929633800448:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1787119634.562677:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+20:33961:x1873929633800448:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 361us (2585us total) trans 4294976621 rc 0/0 00000100:00100000:0.0:1787119634.562686:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 232 00000001:00100000:3.0:1787119635.161520:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 93d672e6-b8e0-4996-8f5c-43d805e23cd1 00000001:00100000:3.0:1787119635.161540:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 93d672e6-b8e0-4996-8f5c-43d805e23cd1 00000020:00000080:3.0:1787119635.161544:0:7642:0:(genops.c:906:class_export_put()) final put ffff92a509eb1800/93d672e6-b8e0-4996-8f5c-43d805e23cd1 00000020:00000080:2.0:1787119635.161687:0:17891:0:(genops.c:865:class_export_destroy()) destroying export ffff92a509eb1800/93d672e6-b8e0-4996-8f5c-43d805e23cd1 for lustre-OST0001 00000020:00000080:2.0:1787119635.161743:0:17891:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92a509eb7800 for lustre-OST0001 00010000:00010000:3.0:1787119635.425620:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787119635.683419:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d46c42c6-98a3-4170-b3f4-2388127f1660 00000001:00100000:0.0:1787119635.683434:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d46c42c6-98a3-4170-b3f4-2388127f1660 00000020:00000080:0.0:1787119635.683465:0:6718:0:(genops.c:906:class_export_put()) final put ffff92a506d5b800/d46c42c6-98a3-4170-b3f4-2388127f1660 00000020:00000080:1.0:1787119635.683539:0:12756:0:(genops.c:865:class_export_destroy()) destroying export ffff92a506d5b800/d46c42c6-98a3-4170-b3f4-2388127f1660 for lustre-OST0000 00000020:00000080:1.0:1787119635.683601:0:12756:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92a506d58800 for lustre-OST0000 00000001:00080000:2.0:1787119635.706095:0:21333:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976621 is committed 00010000:00010000:0.0:1787119636.449856:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787119636.555076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119636.555312:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633800704 00000100:00100000:0.0:1787119636.555324:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633800704 00000100:00100000:0.0:1787119636.555412:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 233 00000100:00100000:0.0:1787119636.555423:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+41:33946:x1873929633800704:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1787119636.555760:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633800704:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 338us (701us total) trans 4294976622 rc 0/0 00000100:00100000:0.0:1787119636.555768:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 233 00000100:00080000:2.0:1787119636.556680:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787119636.562051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119636.562360:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633800960 00000100:00100000:0.0:1787119636.562371:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633800960 00000100:00100000:0.0:1787119636.562431:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 234 00000100:00100000:0.0:1787119636.562468:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6080be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+42:33946:x1873929633800960:12345-192.168.201.59@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1787119636.563303:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6080be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633800960:12345-192.168.201.59@tcp:35:mmap_sanity.0 Request processed in 860us (1259us total) trans 4294976623 rc 0/0 00000100:00100000:0.0:1787119636.563311:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 234 00000100:00100000:3.0:1787119636.572617:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119636.576207:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633801088 00000100:00100000:2.0:1787119636.576223:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633801088 00000100:00100000:2.0:1787119636.576304:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19802 00000100:00100000:2.0:1787119636.576314:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633801088:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119636.576339:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119636.576361:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6400/0xcaba3de8463e4b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047170b6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.576425:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4b20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.576462:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.576472:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119636.576670:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1787119636.576674:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 48 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119636.579184:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.579234:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6400/0xcaba3de8463e4b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170b6 expref: 45 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.579254:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4b20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170b6 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.579263:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:2.0:1787119636.579266:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787119636.579270:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e6e00, rc 0) 00000100:00100000:2.0:1787119636.579407:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633801088:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 3093us (6797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119636.579416:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19802 00000100:00100000:3.0:1787119636.595594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119636.595722:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633801216 00000100:00100000:0.0:1787119636.595735:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633801216 00000100:00100000:0.0:1787119636.595804:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19803 00000100:00100000:0.0:1787119636.595814:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633801216:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1787119636.595835:0:12121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787119636.595870:0:12121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38400/0xcaba3de8463e4b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047170bd expref: -99 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.595949:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.596106:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.596120:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.596136:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.596143:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.596150:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.601669:0:12121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68c00/0xcaba3de8463e4b3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.601694:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68c00/0xcaba3de8463e4b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.601707:0:12121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68c00/0xcaba3de8463e4b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787119636.601764:0:12121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6e:0x0]: returning size 409600 00000004:00200000:1.0:1787119636.601770:0:12121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787119636.601791:0:12121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68c00/0xcaba3de8463e4b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.601803:0:12121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68c00/0xcaba3de8463e4b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.601818:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.601824:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.601831:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.601837:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a510a38c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119636.603366:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603385:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603402:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:1.0:1787119636.603405:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119636.603409:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603415:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38c00/0xcaba3de8463e4b2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603473:0:12121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603480:0:12121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603486:0:12121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603492:0:12121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a510a38a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119636.603495:0:12121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603500:0:12121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603507:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff92a609aaf300) 00010000:00010000:1.0:1787119636.603510:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119636.603512:0:12121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603517:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38a00/0xcaba3de8463e4b35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603564:0:12121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38400/0xcaba3de8463e4b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170bd expref: 46 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603581:0:12121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68c00/0xcaba3de8463e4b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170bd expref: 45 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.603588:0:12121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a609aafe00) 00010000:00010000:1.0:1787119636.603591:0:12121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787119636.603593:0:12121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a506e68c00, rc 0) 00000100:00100000:1.0:1787119636.603675:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633801216:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 7861us (8089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119636.603684:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19803 00000100:00100000:3.0:1787119636.615669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119636.615772:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633801472 00000100:00100000:0.0:1787119636.615781:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633801472 00000100:00100000:0.0:1787119636.615840:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19804 00000100:00100000:0.0:1787119636.615859:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633801472:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1787119636.615928:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787119636.615967:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68c00/0xcaba3de8463e4b3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170bd expref: 45 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.616183:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39600/0xcaba3de8463e4a78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717069 expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.616200:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a609aafe00) 00010000:00010000:0.0:1787119636.616210:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6e00/0xcaba3de8463e4b20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170b6 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.616218:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:0.0:1787119636.616221:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787119636.616242:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.616437:0:15720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717077 expref: 17 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.616604:0:15720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.616643:0:15720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204717077 expref: 17 pid: 12121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.616672:0:15720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717077 expref: 17 pid: 12121 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119636.616688:0:15720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63eb29880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653748608:192.168.201.59@tcp:104: 00000100:00100000:0.0:1787119636.616878:0:15720:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506f54c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787119636.634301:0:15720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63eb29880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653748608:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119636.634332:0:15720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119636.635387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:0.0:1787119636.636859:0:21335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633801600 00000100:00100000:0.0:1787119636.636874:0:21335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633801600 00010000:00010000:0.0:1787119636.636966:0:21335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717077 expref: 18 pid: 12121 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119636.637017:0:21335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5815 00000100:00100000:0.0:1787119636.637027:0:21335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+18:2376:x1873929633801600:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787119636.637042:0:21335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787119636.637049:0:21335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717077 expref: 18 pid: 12121 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.637085:0:21335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717077 expref: 18 pid: 12121 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.637110:0:21335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39400/0xcaba3de8463e4a8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717077 expref: 18 pid: 12121 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.637132:0:21335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:0.0:1787119636.637137:0:21335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.637146:0:21335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.637153:0:21335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.637188:0:21335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787119636.637252:0:21335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+17:2376:x1873929633801600:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 225us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119636.637260:0:21335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5815 00010000:00010000:1.0:1787119636.637371:0:15720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.637380:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.637405:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.637415:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.637423:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.637840:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.637853:0:15720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471707e expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.637861:0:15720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.637894:0:15720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa88927320471707e expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.637911:0:15720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471707e expref: 16 pid: 5849 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119636.637925:0:15720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653748736:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119636.637985:0:15720:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a506999cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1787119636.638349:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119636.642757:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653749248:0@lo:400:kworker.0 00000100:00100000:2.0:1787119636.642854:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119636.642902:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787119636.642909:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653749120:0@lo:400:kworker.0 00000100:00100000:2.0:1787119636.642949:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787119636.643282:0:12469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653749248 00000100:00100000:2.0:1787119636.643290:0:12469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653749248 00000100:00100000:2.0:1787119636.643342:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1787119636.643350:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653749248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119636.643398:0:12469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653749248:12345-0@lo:400:kworker.0 Request processed in 49us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119636.643405:0:12469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1787119636.643428:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653749120 00000100:00100000:2.0:1787119636.643431:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653749120 00000100:00100000:2.0:1787119636.643476:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:2.0:1787119636.643482:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653749120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119636.643508:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63497b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873929653749120:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119636.643514:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00080000:2.0:1787119636.643527:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787119636.643531:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787119636.643557:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873929653749120:0@lo:400:kworker.0 00000100:00100000:2.0:1787119636.643566:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653749248:0@lo:400:kworker.0 00000100:00100000:1.0:1787119636.643723:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653748864:0@lo:400:kworker.0 00000100:00100000:1.0:1787119636.643760:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119636.643796:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a634979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873929653749376:0@lo:400:kworker.0 00000100:00100000:1.0:1787119636.643817:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119636.643832:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787119636.643837:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653748992:0@lo:400:kworker.0 00000100:00100000:1.0:1787119636.643867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119636.643882:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653749504:0@lo:400:kworker.0 00000100:00100000:1.0:1787119636.643901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119636.643933:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653749376 00000100:00100000:1.0:1787119636.643936:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653749376 00000100:00100000:1.0:1787119636.643966:0:12121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653748992 00000100:00100000:1.0:1787119636.643973:0:12121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653748992 00000100:00100000:1.0:1787119636.643987:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1787119636.643993:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873929653749376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119636.644025:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873929653749376:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119636.644031:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1787119636.644042:0:12121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1787119636.644047:0:12121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653748992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787119636.644081:0:12121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a508da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873929653748992:12345-0@lo:400:kworker.0 Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119636.644086:0:12121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1787119636.644107:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873929653748992:0@lo:400:kworker.0 00000100:00100000:1.0:1787119636.644118:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a634979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873929653749376:0@lo:400:kworker.0 00000100:00100000:3.0:1787119636.646008:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a511f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653749632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787119636.646078:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119636.646129:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653749632 00000100:00100000:3.0:1787119636.646136:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653749632 00000100:00100000:3.0:1787119636.646193:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787119636.646201:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653749632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787119636.646237:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 173998080 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1787119636.646285:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873929653749632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119636.646292:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787119636.646340:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a511f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873929653749632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787119636.646948:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653748864 00000100:00100000:2.0:1787119636.646960:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653748864 00000100:00100000:2.0:1787119636.647007:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1787119636.647015:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653748864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119636.647077:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13a76f2e-afb8-44aa-9a00-b0908522ce08+19:3311:x1873929653748864:12345-0@lo:400:kworker.0 Request processed in 63us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119636.647083:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1787119636.647114:0:20841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653749504 00000100:00100000:2.0:1787119636.647118:0:20841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653749504 00000100:00100000:2.0:1787119636.647162:0:20841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1787119636.647170:0:20841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653749504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787119636.647202:0:20841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653749504:12345-0@lo:400:kworker.0 Request processed in 33us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119636.647209:0:20841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00080000:2.0:1787119636.647231:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787119636.647236:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787119636.647262:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653749504:0@lo:400:kworker.0 00000100:00100000:2.0:1787119636.647272:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63414e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13a76f2e-afb8-44aa-9a00-b0908522ce08:3311:1873929653748864:0@lo:400:kworker.0 00000100:00100000:3.0:1787119636.648233:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653749760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787119636.648282:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119636.649518:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653749760 00000100:00100000:1.0:1787119636.649531:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653749760 00000100:00100000:1.0:1787119636.649589:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787119636.649598:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653749760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787119636.649636:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 291569664 pending 0 free 3827302400 avail 3825205248 00000100:00100000:1.0:1787119636.649705:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873929653749760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119636.649931:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787119636.650488:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873929653749760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787119636.654198:0:15720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a508da5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15720:1873929653748736:192.168.201.59@tcp:104: 00010000:00010000:1.0:1787119636.654229:0:15720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119636.655793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119636.662951:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633801728 00000100:00100000:2.0:1787119636.663309:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633801728 00010000:00010000:2.0:1787119636.663367:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471707e expref: 17 pid: 5849 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119636.663410:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5816 00000100:00100000:2.0:1787119636.663420:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+17:2375:x1873929633801728:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787119636.663437:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787119636.663476:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471707e expref: 17 pid: 5849 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.663501:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471707e expref: 17 pid: 5849 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.663524:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a38e00/0xcaba3de8463e4aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa88927320471707e expref: 17 pid: 5849 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.663548:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a609aafe00) 00010000:00010000:2.0:1787119636.663554:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.663563:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.663570:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.663599:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787119636.663778:0:15720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.663786:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787119636.664852:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 64 off9728 00000004:00080000:1.0:1787119636.664864:0:15720:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1162742424009ns, next at 1163742421122ns, rc = 0 00010000:00010000:1.0:1787119636.664932:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.664946:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.664956:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.664965:0:15720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.664972:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.664978:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.664997:0:15720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787119636.665018:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665023:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665029:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665035:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a506e69600 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119636.665039:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665045:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665066:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a609aafe00) 00010000:00010000:1.0:1787119636.665070:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787119636.665074:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665084:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69600/0xcaba3de8463e4b51 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665103:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665109:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665115:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665120:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a510a39c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119636.665123:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665128:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665136:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a609aafb00) 00010000:00010000:1.0:1787119636.665138:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119636.665141:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.665147:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a510a39c00/0xcaba3de8463e4b43 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787119636.665169:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037348018 reply state 00000000d4231e7e transno 4294976624 ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119636.665178:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119636.665459:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2375:x1873929633801728:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 2035us (9669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119636.665469:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5816 00010000:00010000:0.0:1787119636.666625:0:21353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787119636.666636:0:21353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.666647:0:21353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a506e69c00 already unused, calling callback (ffffffffc163d010) 00010000:00010000:0.0:1787119636.666652:0:21353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.666660:0:21353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.666676:0:21353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff92a609aafe00) 00010000:00010000:0.0:1787119636.666679:0:21353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787119636.666684:0:21353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.666689:0:21353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69c00/0xcaba3de8463e4b58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.666720:0:21353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119636.666723:0:21353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119636.666725:0:21353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787119636.667288:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633801472:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 51426us (51622us total) trans 4294976624 rc 0/0 00000100:00100000:1.0:1787119636.667300:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19804 00010000:00010000:3.0:1787119636.669705:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.669731:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.669739:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.669745:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a506e69800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:3.0:1787119636.669750:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.669757:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.669775:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff92a61bc19100) 00010000:00010000:3.0:1787119636.669778:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787119636.669783:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.669789:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e69800/0xcaba3de8463e4b4a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119636.680546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119636.680664:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633801856 00000100:00100000:2.0:1787119636.680675:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633801856 00000100:00100000:2.0:1787119636.680743:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19805 00000100:00100000:2.0:1787119636.680754:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633801856:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119636.680780:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119636.680802:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047170c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.680882:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.680901:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.680913:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119636.681335:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1787119636.681341:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 47 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119636.681368:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.681393:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170c4 expref: 45 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.681411:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170c4 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.681420:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038400) 00010000:00010000:2.0:1787119636.681422:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787119636.681425:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e7800, rc 0) 00000100:00100000:2.0:1787119636.681532:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a6181ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633801856:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 780us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119636.681540:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19805 00000100:00100000:0.0:1787119636.683950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119636.694138:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633801984 00000100:00100000:3.0:1787119636.694167:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633801984 00000100:00100000:2.0:1787119636.694377:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19806 00000100:00100000:2.0:1787119636.694388:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633801984:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119636.694409:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119636.694432:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047170cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694542:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694556:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694567:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694581:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694588:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694595:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694708:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4b82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694730:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694737:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119636.694769:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6d:0x0]: returning size 409600 00000004:00200000:2.0:1787119636.694774:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119636.694793:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694810:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694819:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694825:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694832:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694838:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6a00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119636.694854:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694861:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694873:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038400) 00010000:00010000:2.0:1787119636.694876:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119636.694880:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694886:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6a00/0xcaba3de8463e4b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694899:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694905:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694911:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694915:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e7200 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119636.694918:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694933:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694940:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff92a620038d00) 00010000:00010000:2.0:1787119636.694942:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119636.694952:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.694958:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4b7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.695732:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170cb expref: 46 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.695751:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4b82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170cb expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.695758:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a61bc19600) 00010000:00010000:2.0:1787119636.695760:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787119636.695763:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e7400, rc 0) 00000100:00100000:2.0:1787119636.695829:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633801984:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 1441us (11886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119636.695908:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19806 00000100:00100000:3.0:1787119636.704819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119636.707138:0:15690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633802240 00000100:00100000:2.0:1787119636.707313:0:15690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633802240 00000100:00100000:2.0:1787119636.707392:0:15690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19807 00000100:00100000:2.0:1787119636.707403:0:15690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+45:33946:x1873929633802240:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1787119636.707481:0:15690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787119636.707512:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4b82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170cb expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.707536:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a506e68200/0xcaba3de8463e4a32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.59@tcp remote: 0xa88927320471704d expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.707548:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a61bc19600) 00010000:00010000:2.0:1787119636.707559:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170c4 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.707568:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038400) 00010000:00010000:2.0:1787119636.707578:0:15690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119636.707605:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.707619:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.707631:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.707643:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.707651:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.707657:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.709221:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.709255:0:15690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa889273204717085 expref: 15 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.709265:0:15690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.709311:0:15690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.59@tcp remote: 0xa889273204717085 expref: 15 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.709341:0:15690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717085 expref: 15 pid: 15720 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119636.709358:0:15690:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a63497a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15690:1873929653749888:192.168.201.59@tcp:104: 00000100:00100000:2.0:1787119636.709483:0:15690:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a602df2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787119636.715791:0:15690:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff92a63497a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15690:1873929653749888:192.168.201.59@tcp:104: 00010000:00010000:2.0:1787119636.715821:0:15690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787119636.717645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:1.0:1787119636.717737:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633802368 00000100:00100000:1.0:1787119636.717747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633802368 00010000:00010000:1.0:1787119636.717787:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717085 expref: 16 pid: 15720 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119636.717830:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 5817 00000100:00100000:1.0:1787119636.717849:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+16:2376:x1873929633802368:12345-192.168.201.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787119636.717865:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787119636.717873:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717085 expref: 16 pid: 15720 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.717900:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717085 expref: 16 pid: 15720 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.717927:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7600/0xcaba3de8463e4acc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.59@tcp remote: 0xa889273204717085 expref: 16 pid: 15720 timeout: 1262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.717945:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a61bc19600) 00010000:00010000:1.0:1787119636.717950:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.717959:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.717974:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.717999:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787119636.718050:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d46c42c6-98a3-4170-b3f4-2388127f1660+15:2376:x1873929633802368:12345-192.168.201.59@tcp:103:ldlm_bl.0 Request processed in 211us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119636.718068:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 5817 00010000:00010000:2.0:1787119636.718509:0:15690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.718518:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787119636.721602:0:15690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 64 off9472 00000004:00080000:2.0:1787119636.721619:0:15690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1162799179504ns, next at 1163799176038ns, rc = 0 00010000:00010000:2.0:1787119636.721696:0:15690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721713:0:15690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721725:0:15690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721734:0:15690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721741:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721747:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721772:0:15690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787119636.721795:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721802:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721808:0:15690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721814:0:15690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e7000 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119636.721818:0:15690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721826:0:15690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721839:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a61bc19600) 00010000:00010000:2.0:1787119636.721842:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787119636.721846:0:15690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721852:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4b97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721871:0:15690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721877:0:15690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721882:0:15690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721886:0:15690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e7e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119636.721889:0:15690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721894:0:15690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721904:0:15690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038b00) 00010000:00010000:2.0:1787119636.721906:0:15690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119636.721909:0:15690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.721913:0:15690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4b89 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787119636.721927:0:15690:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008dcf7ef2 reply state 00000000b2558a73 transno 4294976625 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119636.721936:0:15690:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119636.722028:0:15690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633802240:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 14621us (17213us total) trans 4294976625 rc 0/0 00000100:00100000:2.0:1787119636.722037:0:15690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19807 00010000:00010000:3.0:1787119636.724278:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787119636.724293:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.724303:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e7800 already unused, calling callback (ffffffffc163d010) 00010000:00010000:3.0:1787119636.724307:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.724317:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.724335:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff92a61bc19600) 00010000:00010000:3.0:1787119636.724338:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787119636.724341:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.724347:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7800/0xcaba3de8463e4b9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787119636.724369:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787119636.724371:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787119636.724373:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119636.729106:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.729126:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.729137:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.729144:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6800 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:1.0:1787119636.729149:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.729157:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.729174:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff92a620038100) 00010000:00010000:1.0:1787119636.729177:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787119636.729182:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.729188:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6800/0xcaba3de8463e4b90 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787119636.736730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119636.736809:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633802496 00000100:00100000:2.0:1787119636.736820:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633802496 00000100:00100000:2.0:1787119636.736889:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19808 00000100:00100000:2.0:1787119636.736899:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:33946:x1873929633802496:12345-192.168.201.59@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1787119636.736928:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787119636.736953:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4ba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8892732047170d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.737031:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4bac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.737044:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4bac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.737069:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4bac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787119636.737133:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1787119636.737137:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 46 stripe count 1 MDT count 1 00000004:00010000:2.0:1787119636.737162:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4bac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.737186:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4ba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170d2 expref: 45 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.737203:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4bac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170d2 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.737211:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038b00) 00010000:00010000:2.0:1787119636.737214:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787119636.737217:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92a6050e7000, rc 0) 00000100:00100000:2.0:1787119636.737284:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633802496:12345-192.168.201.59@tcp:101:mmap_sanity.0 Request processed in 386us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119636.737291:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19808 00000100:00100000:3.0:1787119636.742755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:2.0:1787119636.742851:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633802752 00000100:00100000:2.0:1787119636.742862:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633802752 00000100:00100000:2.0:1787119636.742924:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 19809 00000100:00100000:2.0:1787119636.742942:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633802752:12345-192.168.201.59@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1787119636.743013:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787119636.743040:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a519d80400/0xcaba3de8463e3754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa889273204715f44 expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743079:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x69:0x0].0x0 (ffff92a603b3e900) 00010000:00010000:2.0:1787119636.743096:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7000/0xcaba3de8463e4bac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.59@tcp remote: 0xa8892732047170d2 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743105:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038b00) 00010000:00010000:2.0:1787119636.743111:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787119636.743136:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743148:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743158:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743169:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743176:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743182:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743303:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x69:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743311:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743321:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787119636.743881:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 64 off9536 00010000:00010000:2.0:1787119636.743941:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x69:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743951:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743958:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743965:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743971:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743977:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.743993:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787119636.744012:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744018:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744025:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744036:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e6c00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119636.744041:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744048:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744067:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x69:0x0].0x0 (ffff92a620038600) 00010000:00010000:2.0:1787119636.744070:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787119636.744074:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744080:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e6c00/0xcaba3de8463e4bc1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744097:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744102:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744107:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744113:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e7e00 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:2.0:1787119636.744116:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744122:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744133:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92a620038400) 00010000:00010000:2.0:1787119636.744135:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787119636.744138:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787119636.744143:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7e00/0xcaba3de8463e4bb3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787119636.744156:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de142081 reply state 000000001099ef8e transno 4294976626 ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787119636.744165:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787119636.744237:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+44:33946:x1873929633802752:12345-192.168.201.59@tcp:36:mmap_sanity.0 Request processed in 1294us (1489us total) trans 4294976626 rc 0/0 00000100:00100000:2.0:1787119636.744245:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 19809 00010000:00010000:1.0:1787119636.744483:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787119636.744490:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.744496:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e7200 already unused, calling callback (ffffffffc163d010) 00010000:00010000:1.0:1787119636.744500:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.744505:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.744515:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x69:0x0].0x0 (ffff92a620038600) 00010000:00010000:1.0:1787119636.744517:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787119636.744520:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.744526:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7200/0xcaba3de8463e4bc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119636.744539:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119636.744541:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787119636.744543:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119636.759269:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.759288:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.759297:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.759304:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92a6050e7400 already unused, calling callback (ffffffffc20804f0) 00010000:00010000:0.0:1787119636.759309:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.759317:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.759334:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcf1d5a2f (ffff92a620038d00) 00010000:00010000:0.0:1787119636.759337:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787119636.759342:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119636.759347:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92a6050e7400/0xcaba3de8463e4bba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787119637.476684:0:21353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787119638.499710:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787119639.050041:0:21409:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_18: @@@@@@ FAIL: mmap_sanity test failed 00000100:00100000:3.0:1787119639.445063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119639.445115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119639.445160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119639.445189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119639.445211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119639.445231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119639.445276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.59@tcp (source: 12345-192.168.201.59@tcp) 00000100:00100000:3.0:1787119639.445310:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633803136 00000100:00100000:3.0:1787119639.445319:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633803136 00000100:00100000:1.0:1787119639.445417:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633803648 00000100:00100000:1.0:1787119639.445422:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633803648 00000100:00100000:1.0:1787119639.445515:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633803264 00000100:00100000:1.0:1787119639.445519:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633803264 00000100:00100000:1.0:1787119639.445536:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633803520 00000100:00100000:1.0:1787119639.445548:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633803520 00000100:00100000:1.0:1787119639.445574:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 710 00000100:00100000:1.0:1787119639.445583:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633803648:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119639.445649:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+6:2373:x1873929633803648:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 67us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119639.445657:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 710 00000100:00100000:1.0:1787119639.445687:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 711 00000100:00100000:1.0:1787119639.445694:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+5:2373:x1873929633803264:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119639.445718:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d672e6-b8e0-4996-8f5c-43d805e23cd1+5:2373:x1873929633803264:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 25us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119639.445725:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 711 00000100:00100000:1.0:1787119639.445736:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 712 00000100:00100000:1.0:1787119639.445743:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a63ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+5:2373:x1873929633803520:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:1.0:1787119639.445765:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a63ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d46c42c6-98a3-4170-b3f4-2388127f1660+5:2373:x1873929633803520:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 23us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787119639.445771:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 712 00000100:00100000:3.0:1787119639.446304:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 713 00000100:00100000:3.0:1787119639.446313:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633803136:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:3.0:1787119639.446480:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d672e6-b8e0-4996-8f5c-43d805e23cd1+8:2373:x1873929633803136:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 168us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787119639.446488:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 713 00000100:00100000:2.0:1787119639.447715:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633803392 00000100:00100000:2.0:1787119639.447727:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633803392 00000100:00100000:2.0:1787119639.447782:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633803008 00000100:00100000:2.0:1787119639.447786:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633803008 00000100:00100000:2.0:1787119639.447819:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 816 00000100:00100000:2.0:1787119639.447828:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+15:2373:x1873929633803392:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119639.447883:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d46c42c6-98a3-4170-b3f4-2388127f1660+15:2373:x1873929633803392:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 57us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119639.447891:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 816 00000100:00100000:2.0:1787119639.447907:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 817 00000100:00100000:2.0:1787119639.447914:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2373:x1873929633803008:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:2.0:1787119639.447943:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a511f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:93d672e6-b8e0-4996-8f5c-43d805e23cd1+43:2373:x1873929633803008:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 30us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787119639.447950:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 817 00000100:00080000:2.0:1787119639.447975:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787119639.447979:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787119639.447982:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787119639.448134:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929633802880 00000100:00100000:0.0:1787119639.448139:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929633802880 00000100:00100000:0.0:1787119639.448177:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.59@tcp, seq: 570 00000100:00100000:0.0:1787119639.448184:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a618d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633802880:12345-192.168.201.59@tcp:400:kworker.0 00000100:00100000:0.0:1787119639.448212:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92a618d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee46c9fc-11fd-4c77-9632-027a43478e3b+13:2373:x1873929633802880:12345-192.168.201.59@tcp:400:kworker.0 Request processed in 29us (3207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787119639.448218:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.59@tcp, seq: 570 00010000:00010000:1.0:1787119639.522199:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787119640.545586:0:21353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787119640.812579:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976623 is committed 00000001:00080000:1.0:1787119640.812601:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976624 is committed 00000004:00080000:1.0:1787119640.812605:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 24 committed 00000001:00080000:1.0:1787119640.812617:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294976626 is committed 00000004:00080000:1.0:1787119640.812623:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000100:00100000:1.0:1787119640.813044:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653750016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787119640.813122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787119640.813292:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787119640.813299:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873929653750144:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787119640.813326:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787119640.813838:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653750016 00000100:00100000:3.0:1787119640.813847:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653750016 00000100:00100000:3.0:1787119640.814017:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929653750144 00000100:00100000:3.0:1787119640.814021:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929653750144 00000100:00100000:1.0:1787119640.814065:0:12469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5736 00000100:00100000:1.0:1787119640.814076:0:12469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92a6181ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1873929653750016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787119640.814108:0:12469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:44 count 1 00010000:00010000:1.0:1787119640.814138:0:12469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b37b84ba/0xcaba3de8463e4bcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119640.814162:0:12469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d244a24/0xcaba3de8463e4af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.59@tcp remote: 0xa8892732047170a8 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119640.814171:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2c:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1787119640.814187:0:12469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787119640.814193:0:12469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b37b84ba/0xcaba3de8463e4bcf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119640.814230:0:12469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d244a24/0xcaba3de8463e4af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.201.59@tcp remote: 0xa8892732047170a8 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787119640.814256:0:12469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d244a24/0xcaba3de8463e4af6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.201.59@tcp remote: 0xa8892732047170a8 expref: 5 pid: 6695 timeout: 1266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787119640.814268:0:12469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff92a6181ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12469:1873929653750272:192.168.201.59@tcp:104: 00000100:00100000:1.0:1787119640.814336:0:12469:0:(client.c:2702:ptlrpc_set_wait()) set ffff92a507972b40 going to sleep for 11 seconds Debug log: 69070 lines, 69070 kept, 0 dropped, 0 bad.